2019-12-05T03:34:18.654 INFO:root:teuthology version: 1.0.0-e0b5789 2019-12-05T03:34:18.655 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.lLrq2Q.tmp -- --verbose --lock --description fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-ec-root.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{ubuntu_latest.yaml} tasks/pool-perm.yaml} --name pdonnell-2019-12-05_02:12:53-fs-wip-pdonnell-testing-20191204.231200-distro-basic-smithi --block --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2019-12-05_02:12:53-fs-wip-pdonnell-testing-20191204.231200-distro-basic-smithi/4567504 2019-12-05T03:34:18.722 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-12-05T03:34:18.794 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2019-12-05_02:12:53-fs-wip-pdonnell-testing-20191204.231200-distro-basic-smithi/4567504 branch: wip-pdonnell-testing-20191204.231200 description: fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-ec-root.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{ubuntu_latest.yaml} tasks/pool-perm.yaml} email: pdonnell@redhat.com first_in_suite: false job_id: '4567504' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2019-12-05_02:12:53-fs-wip-pdonnell-testing-20191204.231200-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: ubuntu os_version: '18.04' overrides: admin_socket: branch: wip-pdonnell-testing-20191204.231200 ceph: cephfs_ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: c5290805033483ba0cec165c06bde07dae5f19ec ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: sha1: c5290805033483ba0cec165c06bde07dae5f19ec thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20191204.231200 sha1: c5290805033483ba0cec165c06bde07dae5f19ec owner: scheduled_pdonnell@teuthology priority: 75 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.1 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - client.2 - client.3 sha1: c5290805033483ba0cec165c06bde07dae5f19ec suite: fs suite_branch: wip-pdonnell-testing-20191204.231200 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20191204.231200/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: c5290805033483ba0cec165c06bde07dae5f19ec tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - ceph: null - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_pool_perm teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.15252 2019-12-05T03:34:18.794 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20191204.231200/qa; will attempt to use it 2019-12-05T03:34:18.795 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20191204.231200/qa/tasks 2019-12-05T03:34:18.795 INFO:teuthology.run_tasks:Running task internal.check_packages... 2019-12-05T03:34:18.797 INFO:teuthology.task.internal:Checking packages... 2019-12-05T03:34:18.814 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'basic' and ceph hash 'c5290805033483ba0cec165c06bde07dae5f19ec' 2019-12-05T03:34:18.815 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2019-12-05T03:34:18.815 INFO:teuthology.packaging:ref: None 2019-12-05T03:34:18.815 INFO:teuthology.packaging:tag: None 2019-12-05T03:34:18.815 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20191204.231200 2019-12-05T03:34:18.815 INFO:teuthology.packaging:sha1: c5290805033483ba0cec165c06bde07dae5f19ec 2019-12-05T03:34:18.815 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=wip-pdonnell-testing-20191204.231200 2019-12-05T03:34:18.974 INFO:teuthology.task.internal:Found packages for ceph version 15.0.0-8014-gc529080-1bionic 2019-12-05T03:34:18.974 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2019-12-05T03:34:19.488 INFO:teuthology.task.internal:no buildpackages task found 2019-12-05T03:34:19.488 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2019-12-05T03:34:19.507 INFO:teuthology.task.internal.lock_machines:Locking machines... 2019-12-05T03:34:19.507 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-12-05T03:34:19.556 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-05T03:34:29.577 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-05T03:34:39.593 DEBUG:teuthology.lock.ops:lock_many request: {'count': 2, 'locked_by': 'scheduled_pdonnell@teuthology', 'description': '/home/teuthworker/archive/pdonnell-2019-12-05_02:12:53-fs-wip-pdonnell-testing-20191204.231200-distro-basic-smithi/4567504', 'machine_type': 'smithi'} 2019-12-05T03:34:39.615 DEBUG:teuthology.lock.ops:locked ubuntu@smithi158.front.sepia.ceph.com, ubuntu@smithi096.front.sepia.ceph.com 2019-12-05T03:34:39.797 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2019-12-05T03:34:40.073 INFO:teuthology.provision.fog.smithi158:Scheduling deploy of ubuntu 18.04 2019-12-05T03:34:40.112 INFO:teuthology.provision.fog.smithi096:Scheduling deploy of ubuntu 18.04 2019-12-05T03:34:40.593 INFO:teuthology.orchestra.console:Power off smithi158 2019-12-05T03:34:40.594 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-12-05T03:34:40.652 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-05T03:34:40.737 INFO:teuthology.orchestra.console:Power off smithi096 2019-12-05T03:34:40.738 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-12-05T03:34:40.783 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-05T03:34:44.772 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-05T03:34:44.829 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-05T03:34:48.910 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-05T03:34:48.958 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-05T03:34:49.140 INFO:teuthology.orchestra.console:Power off for smithi158 completed 2019-12-05T03:34:49.187 INFO:teuthology.orchestra.console:Power off for smithi096 completed 2019-12-05T03:34:49.242 INFO:teuthology.orchestra.console:Power on smithi158 2019-12-05T03:34:49.242 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-12-05T03:34:49.286 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-05T03:34:49.327 INFO:teuthology.orchestra.console:Power on smithi096 2019-12-05T03:34:49.328 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-12-05T03:34:49.371 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-05T03:34:53.368 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-05T03:34:53.410 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-05T03:34:57.500 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-05T03:34:57.546 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-05T03:34:57.740 INFO:teuthology.orchestra.console:Power on for smithi158 completed 2019-12-05T03:34:57.775 INFO:teuthology.orchestra.console:Power on for smithi096 completed 2019-12-05T03:34:57.841 INFO:teuthology.provision.fog.smithi158:Waiting for deploy to finish 2019-12-05T03:34:57.876 INFO:teuthology.provision.fog.smithi096:Waiting for deploy to finish 2019-12-05T03:37:59.277 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi096.front.sepia.ceph.com', 'timeout': 60} 2019-12-05T03:37:59.280 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi158.front.sepia.ceph.com', 'timeout': 60} 2019-12-05T03:38:08.336 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi096.front.sepia.ceph.com', 'timeout': 60} 2019-12-05T03:38:08.361 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi158.front.sepia.ceph.com', 'timeout': 60} 2019-12-05T03:38:17.421 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi096.front.sepia.ceph.com', 'timeout': 60} 2019-12-05T03:38:17.422 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi158.front.sepia.ceph.com', 'timeout': 60} 2019-12-05T03:38:26.481 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi096.front.sepia.ceph.com', 'timeout': 60} 2019-12-05T03:38:26.482 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi158.front.sepia.ceph.com', 'timeout': 60} 2019-12-05T03:38:35.566 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi096.front.sepia.ceph.com', 'timeout': 60} 2019-12-05T03:38:35.567 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi158.front.sepia.ceph.com', 'timeout': 60} 2019-12-05T03:38:44.619 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi096.front.sepia.ceph.com', 'timeout': 60} 2019-12-05T03:38:44.620 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi158.front.sepia.ceph.com', 'timeout': 60} 2019-12-05T03:38:53.681 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi096.front.sepia.ceph.com', 'timeout': 60} 2019-12-05T03:38:53.682 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi158.front.sepia.ceph.com', 'timeout': 60} 2019-12-05T03:39:02.765 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi096.front.sepia.ceph.com', 'timeout': 60} 2019-12-05T03:39:02.766 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi158.front.sepia.ceph.com', 'timeout': 60} 2019-12-05T03:39:11.821 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi096.front.sepia.ceph.com', 'timeout': 60} 2019-12-05T03:39:20.877 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi096.front.sepia.ceph.com', 'timeout': 60} 2019-12-05T03:40:08.809 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi158.front.sepia.ceph.com', 'timeout': 60} 2019-12-05T03:40:08.897 INFO:teuthology.orchestra.run.smithi158:> hostname 2019-12-05T03:40:09.281 INFO:teuthology.orchestra.run.smithi158.stdout:smithi158.front.sepia.ceph.com 2019-12-05T03:40:09.282 INFO:teuthology.orchestra.run.smithi158:> grep smithi158.front.sepia.ceph.com /etc/hosts 2019-12-05T03:40:09.354 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.15.158 smithi158.front.sepia.ceph.com smithi158 2019-12-05T03:40:09.354 INFO:teuthology.orchestra.run.smithi158:> sudo hostname smithi158 2019-12-05T03:40:09.443 INFO:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158.front.sepia.ceph.com/smithi158/g' /etc/hosts 2019-12-05T03:40:09.524 INFO:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/172.21.15.158/172.21.15.158/g' /etc/hosts 2019-12-05T03:40:09.603 INFO:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158.front.sepia.ceph.com/smithi158/g' /etc/hostname 2019-12-05T03:40:09.688 INFO:teuthology.orchestra.run.smithi158:> sudo hostname smithi158 2019-12-05T03:40:09.767 INFO:teuthology.provision.fog.smithi158:Deploy complete! 2019-12-05T03:40:09.769 DEBUG:teuthology.parallel:result is None 2019-12-05T03:40:26.886 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi096.front.sepia.ceph.com', 'timeout': 60} 2019-12-05T03:40:26.970 INFO:teuthology.orchestra.run.smithi096:> hostname 2019-12-05T03:40:27.366 INFO:teuthology.orchestra.run.smithi096.stdout:smithi096.front.sepia.ceph.com 2019-12-05T03:40:27.367 INFO:teuthology.orchestra.run.smithi096:> grep smithi096.front.sepia.ceph.com /etc/hosts 2019-12-05T03:40:27.438 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96 smithi096.front.sepia.ceph.com smithi096 2019-12-05T03:40:27.439 INFO:teuthology.orchestra.run.smithi096:> sudo hostname smithi096 2019-12-05T03:40:27.626 INFO:teuthology.orchestra.run.smithi096:> sudo sed -i -e 's/smithi096.front.sepia.ceph.com/smithi096/g' /etc/hosts 2019-12-05T03:40:27.640 INFO:teuthology.orchestra.run.smithi096:> sudo sed -i -e 's/172.21.15.96/172.21.15.96/g' /etc/hosts 2019-12-05T03:40:27.720 INFO:teuthology.orchestra.run.smithi096:> sudo sed -i -e 's/smithi096.front.sepia.ceph.com/smithi096/g' /etc/hostname 2019-12-05T03:40:27.799 INFO:teuthology.orchestra.run.smithi096:> sudo hostname smithi096 2019-12-05T03:40:27.877 INFO:teuthology.provision.fog.smithi096:Deploy complete! 2019-12-05T03:40:27.879 DEBUG:teuthology.parallel:result is None 2019-12-05T03:40:28.084 INFO:teuthology.lock.ops:Checking smithi158.front.sepia.ceph.com 2019-12-05T03:40:28.084 INFO:teuthology.lock.ops:New key found. Updating... 2019-12-05T03:40:28.099 INFO:teuthology.lock.ops:Checking smithi096.front.sepia.ceph.com 2019-12-05T03:40:28.099 INFO:teuthology.lock.ops:New key found. Updating... 2019-12-05T03:40:28.115 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: set os type and version on server 2019-12-05T03:40:28.115 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-05T03:40:28.116 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi158.front.sepia.ceph.com', 'timeout': 60} 2019-12-05T03:40:28.201 INFO:teuthology.orchestra.run.smithi158:> true 2019-12-05T03:40:28.441 INFO:teuthology.orchestra.run.smithi158:> uname -m 2019-12-05T03:40:28.511 INFO:teuthology.orchestra.run.smithi158.stdout:x86_64 2019-12-05T03:40:28.511 INFO:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2019-12-05T03:40:28.581 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="Ubuntu" 2019-12-05T03:40:28.581 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="18.04.3 LTS (Bionic Beaver)" 2019-12-05T03:40:28.581 INFO:teuthology.orchestra.run.smithi158.stdout:ID=ubuntu 2019-12-05T03:40:28.582 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE=debian 2019-12-05T03:40:28.582 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="Ubuntu 18.04.3 LTS" 2019-12-05T03:40:28.582 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="18.04" 2019-12-05T03:40:28.582 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://www.ubuntu.com/" 2019-12-05T03:40:28.582 INFO:teuthology.orchestra.run.smithi158.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2019-12-05T03:40:28.582 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2019-12-05T03:40:28.582 INFO:teuthology.orchestra.run.smithi158.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2019-12-05T03:40:28.583 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_CODENAME=bionic 2019-12-05T03:40:28.583 INFO:teuthology.orchestra.run.smithi158.stdout:UBUNTU_CODENAME=bionic 2019-12-05T03:40:28.583 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2019-12-05T03:40:28.602 INFO:teuthology.lock.ops:Updating [smithi096.front.sepia.ceph.com]: set os type and version on server 2019-12-05T03:40:28.602 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-05T03:40:28.602 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi096.front.sepia.ceph.com', 'timeout': 60} 2019-12-05T03:40:28.734 INFO:teuthology.orchestra.run.smithi096:> true 2019-12-05T03:40:28.976 INFO:teuthology.orchestra.run.smithi096:> uname -m 2019-12-05T03:40:29.046 INFO:teuthology.orchestra.run.smithi096.stdout:x86_64 2019-12-05T03:40:29.046 INFO:teuthology.orchestra.run.smithi096:> cat /etc/os-release 2019-12-05T03:40:29.123 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="Ubuntu" 2019-12-05T03:40:29.124 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="18.04.3 LTS (Bionic Beaver)" 2019-12-05T03:40:29.124 INFO:teuthology.orchestra.run.smithi096.stdout:ID=ubuntu 2019-12-05T03:40:29.124 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE=debian 2019-12-05T03:40:29.125 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="Ubuntu 18.04.3 LTS" 2019-12-05T03:40:29.125 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="18.04" 2019-12-05T03:40:29.125 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://www.ubuntu.com/" 2019-12-05T03:40:29.125 INFO:teuthology.orchestra.run.smithi096.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2019-12-05T03:40:29.125 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2019-12-05T03:40:29.126 INFO:teuthology.orchestra.run.smithi096.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2019-12-05T03:40:29.126 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_CODENAME=bionic 2019-12-05T03:40:29.126 INFO:teuthology.orchestra.run.smithi096.stdout:UBUNTU_CODENAME=bionic 2019-12-05T03:40:29.126 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2019-12-05T03:40:29.147 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2019-12-05T03:40:29.177 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi096.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtBqicTTT4YxiTXqRGu/s0S3KPGVxX8B5vw/U8kRxP3JScc+/6kZPL/7dqZ+0tkAAdkHwRprmvuH+vOpwphkBxvqDR8NGkhTS60uQlc4d1FobOm+JUW22T9UCXCp8TJqcFwto6x9EzX9B4vgQCIPqjYGIVetpF88QyeWmJ0Nsv4onDtv5ailZPXNrzMKqQGttPjYz74bNJnnoHmDuRjv/q7H3MBX8dfjQhxggOcXkzluEnTF53kcny6qsHhVpsJWzrII1bvlQVenNGtGU/X1ShDFT1LWpRCWhrvLC6gKa5niqqh8UK+9KVyJgDGCR+E9BAT+B/PhkQ3P+G2JInoq8F smithi158.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtEbi8zc4omcg1bgs39gnWDwRiLlw9145gx0um5lO4JDDggjQqw4fonlxI/ZHONZY69I8i88ZQhwB0iCFfXHhMUa9fo+/qn1igpNukX22F875tev/J30Ni4yRlEwhPY959fCdhEaZDUZ4BcKqKIdMEFYotwbtUmsa/ccvWWO8MLnEgze6umSRLiRE6NlLsCSV7aDBHaKNh9oFz5uU7vMoJ+16KrVPoBV3NCX53KgRCz0vLchAWPlc1VKWqAORQ/3/fp1IyeBIuaSLXt065e8F8Tdouj6SBVVZo4IptqR5UccXxhAyEt9Kk0vIVY3nOx7VzoG0fJoHBmKQLos53qke3 2019-12-05T03:40:29.181 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-12-05T03:40:29.249 INFO:teuthology.run_tasks:Running task internal.save_config... 2019-12-05T03:40:29.271 INFO:teuthology.task.internal:Saving configuration 2019-12-05T03:40:29.289 INFO:teuthology.run_tasks:Running task internal.check_lock... 2019-12-05T03:40:29.296 INFO:teuthology.task.internal.check_lock:Checking locks... 2019-12-05T03:40:29.311 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-12-05 03:34:39.604741', u'locked_by': u'scheduled_pdonnell@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi158.front.sepia.ceph.com', u'os_version': u'18.04', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'ubuntu', u'arch': u'x86_64', u'ssh_pub_key': u'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHVzKHnOwp4fuqqqo6Ys79VeJFOdLLpc7fYzMxNZ/MWH', u'description': u'/home/teuthworker/archive/pdonnell-2019-12-05_02:12:53-fs-wip-pdonnell-testing-20191204.231200-distro-basic-smithi/4567504'} 2019-12-05T03:40:29.334 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-12-05 03:34:39.604761', u'locked_by': u'scheduled_pdonnell@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi096.front.sepia.ceph.com', u'os_version': u'18.04', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'ubuntu', u'arch': u'x86_64', u'ssh_pub_key': u'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAeY7/sLMOX8odzAUWTV+kVjlVrT/95Mu0ajlcEM6VfD', u'description': u'/home/teuthworker/archive/pdonnell-2019-12-05_02:12:53-fs-wip-pdonnell-testing-20191204.231200-distro-basic-smithi/4567504'} 2019-12-05T03:40:29.334 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2019-12-05T03:40:29.374 INFO:teuthology.task.internal:roles: ubuntu@smithi158.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.1'] 2019-12-05T03:40:29.473 INFO:teuthology.task.internal:roles: ubuntu@smithi096.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.2', 'client.3'] 2019-12-05T03:40:29.473 INFO:teuthology.run_tasks:Running task console_log... 2019-12-05T03:40:29.630 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2019-12-05T03:40:29.631 INFO:teuthology.run_tasks:Running task internal.connect... 2019-12-05T03:40:29.685 INFO:teuthology.task.internal:Opening connections... 2019-12-05T03:40:29.686 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi158.front.sepia.ceph.com 2019-12-05T03:40:29.687 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi158.front.sepia.ceph.com', 'timeout': 60} 2019-12-05T03:40:29.775 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi096.front.sepia.ceph.com 2019-12-05T03:40:29.776 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi096.front.sepia.ceph.com', 'timeout': 60} 2019-12-05T03:40:29.861 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2019-12-05T03:40:29.872 INFO:teuthology.orchestra.run.smithi158:> uname -m 2019-12-05T03:40:29.979 INFO:teuthology.orchestra.run.smithi158.stdout:x86_64 2019-12-05T03:40:29.979 INFO:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2019-12-05T03:40:30.049 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="Ubuntu" 2019-12-05T03:40:30.050 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="18.04.3 LTS (Bionic Beaver)" 2019-12-05T03:40:30.050 INFO:teuthology.orchestra.run.smithi158.stdout:ID=ubuntu 2019-12-05T03:40:30.050 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE=debian 2019-12-05T03:40:30.050 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="Ubuntu 18.04.3 LTS" 2019-12-05T03:40:30.050 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="18.04" 2019-12-05T03:40:30.050 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://www.ubuntu.com/" 2019-12-05T03:40:30.051 INFO:teuthology.orchestra.run.smithi158.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2019-12-05T03:40:30.051 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2019-12-05T03:40:30.051 INFO:teuthology.orchestra.run.smithi158.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2019-12-05T03:40:30.051 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_CODENAME=bionic 2019-12-05T03:40:30.051 INFO:teuthology.orchestra.run.smithi158.stdout:UBUNTU_CODENAME=bionic 2019-12-05T03:40:30.051 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2019-12-05T03:40:30.065 INFO:teuthology.orchestra.run.smithi096:> uname -m 2019-12-05T03:40:30.072 INFO:teuthology.orchestra.run.smithi096.stdout:x86_64 2019-12-05T03:40:30.073 INFO:teuthology.orchestra.run.smithi096:> cat /etc/os-release 2019-12-05T03:40:30.144 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="Ubuntu" 2019-12-05T03:40:30.144 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="18.04.3 LTS (Bionic Beaver)" 2019-12-05T03:40:30.144 INFO:teuthology.orchestra.run.smithi096.stdout:ID=ubuntu 2019-12-05T03:40:30.145 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE=debian 2019-12-05T03:40:30.145 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="Ubuntu 18.04.3 LTS" 2019-12-05T03:40:30.145 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="18.04" 2019-12-05T03:40:30.145 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://www.ubuntu.com/" 2019-12-05T03:40:30.145 INFO:teuthology.orchestra.run.smithi096.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2019-12-05T03:40:30.145 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2019-12-05T03:40:30.145 INFO:teuthology.orchestra.run.smithi096.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2019-12-05T03:40:30.146 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_CODENAME=bionic 2019-12-05T03:40:30.146 INFO:teuthology.orchestra.run.smithi096.stdout:UBUNTU_CODENAME=bionic 2019-12-05T03:40:30.146 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2019-12-05T03:40:30.158 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2019-12-05T03:40:30.183 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2019-12-05T03:40:30.194 INFO:teuthology.task.internal:Checking for old test directory... 2019-12-05T03:40:30.194 INFO:teuthology.orchestra.run.smithi096:> test '!' -e /home/ubuntu/cephtest 2019-12-05T03:40:30.197 INFO:teuthology.orchestra.run.smithi158:> test '!' -e /home/ubuntu/cephtest 2019-12-05T03:40:30.204 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2019-12-05T03:40:30.256 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2019-12-05T03:40:30.257 INFO:teuthology.orchestra.run.smithi096:> test -z $(ls -A /var/lib/ceph) 2019-12-05T03:40:30.261 INFO:teuthology.orchestra.run.smithi158:> test -z $(ls -A /var/lib/ceph) 2019-12-05T03:40:30.307 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2019-12-05T03:40:30.347 INFO:teuthology.run_tasks:Running task kernel... 2019-12-05T03:40:30.371 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.c': {'sha1': 'distro', 'kdb': True}, 'client.0': {'sha1': 'distro', 'kdb': True}, 'mds.a': {'sha1': 'distro', 'kdb': True}, 'mds.b': {'sha1': 'distro', 'kdb': True}, 'osd.1': {'sha1': 'distro', 'kdb': True}, 'osd.0': {'sha1': 'distro', 'kdb': True}, 'osd.3': {'sha1': 'distro', 'kdb': True}, 'osd.2': {'sha1': 'distro', 'kdb': True}, 'osd.5': {'sha1': 'distro', 'kdb': True}, 'osd.4': {'sha1': 'distro', 'kdb': True}, 'osd.7': {'sha1': 'distro', 'kdb': True}, 'osd.6': {'sha1': 'distro', 'kdb': True}, 'client.3': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}, 'mgr.y': {'sha1': 'distro', 'kdb': True}, 'mgr.x': {'sha1': 'distro', 'kdb': True}, 'client.2': {'sha1': 'distro', 'kdb': True}, 'client.1': {'sha1': 'distro', 'kdb': True}} 2019-12-05T03:40:30.372 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}}, timeout 300 2019-12-05T03:40:30.372 INFO:teuthology.orchestra.run.smithi158:> uname -r 2019-12-05T03:40:30.379 INFO:teuthology.orchestra.run.smithi158.stdout:4.15.0-66-generic 2019-12-05T03:40:30.379 INFO:teuthology.task.kernel:Running kernel on smithi158: 4.15.0-66-generic 2019-12-05T03:40:30.380 INFO:teuthology.orchestra.run.smithi158:> sudo apt-get clean 2019-12-05T03:40:30.487 INFO:teuthology.orchestra.run.smithi158:> sudo apt-get update 2019-12-05T03:40:30.675 INFO:teuthology.orchestra.run.smithi158.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2019-12-05T03:40:30.802 INFO:teuthology.orchestra.run.smithi158.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2019-12-05T03:40:30.884 INFO:teuthology.orchestra.run.smithi158.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2019-12-05T03:40:30.936 INFO:teuthology.orchestra.run.smithi158.stdout:Get:4 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [590 kB] 2019-12-05T03:40:31.029 INFO:teuthology.orchestra.run.smithi158.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [413 kB] 2019-12-05T03:40:31.037 INFO:teuthology.orchestra.run.smithi158.stdout:Get:6 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [194 kB] 2019-12-05T03:40:31.043 INFO:teuthology.orchestra.run.smithi158.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [14.6 kB] 2019-12-05T03:40:31.043 INFO:teuthology.orchestra.run.smithi158.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [4,600 B] 2019-12-05T03:40:31.045 INFO:teuthology.orchestra.run.smithi158.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [600 kB] 2019-12-05T03:40:31.061 INFO:teuthology.orchestra.run.smithi158.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [626 kB] 2019-12-05T03:40:31.067 INFO:teuthology.orchestra.run.smithi158.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [209 kB] 2019-12-05T03:40:31.071 INFO:teuthology.orchestra.run.smithi158.stdout:Get:12 http://security.ubuntu.com/ubuntu bionic-security/multiverse i386 Packages [4,292 B] 2019-12-05T03:40:31.071 INFO:teuthology.orchestra.run.smithi158.stdout:Get:13 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [6,116 B] 2019-12-05T03:40:31.072 INFO:teuthology.orchestra.run.smithi158.stdout:Get:14 http://security.ubuntu.com/ubuntu bionic-security/multiverse Translation-en [2,600 B] 2019-12-05T03:40:31.201 INFO:teuthology.orchestra.run.smithi158.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2019-12-05T03:40:31.329 INFO:teuthology.orchestra.run.smithi158.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [624 kB] 2019-12-05T03:40:31.559 INFO:teuthology.orchestra.run.smithi158.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [814 kB] 2019-12-05T03:40:31.653 INFO:teuthology.orchestra.run.smithi158.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [287 kB] 2019-12-05T03:40:31.681 INFO:teuthology.orchestra.run.smithi158.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [23.4 kB] 2019-12-05T03:40:31.682 INFO:teuthology.orchestra.run.smithi158.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/restricted i386 Packages [9,260 B] 2019-12-05T03:40:31.683 INFO:teuthology.orchestra.run.smithi158.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [6,436 B] 2019-12-05T03:40:31.683 INFO:teuthology.orchestra.run.smithi158.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,032 kB] 2019-12-05T03:40:31.730 INFO:teuthology.orchestra.run.smithi158.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [996 kB] 2019-12-05T03:40:31.771 INFO:teuthology.orchestra.run.smithi158.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [319 kB] 2019-12-05T03:40:31.781 INFO:teuthology.orchestra.run.smithi158.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [6,924 B] 2019-12-05T03:40:31.781 INFO:teuthology.orchestra.run.smithi158.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [8,736 B] 2019-12-05T03:40:31.781 INFO:teuthology.orchestra.run.smithi158.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [4,080 B] 2019-12-05T03:40:31.816 INFO:teuthology.orchestra.run.smithi158.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic-backports/universe i386 Packages [4,028 B] 2019-12-05T03:40:31.817 INFO:teuthology.orchestra.run.smithi158.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic-backports/universe amd64 Packages [4,028 B] 2019-12-05T03:40:32.264 INFO:teuthology.orchestra.run.smithi158.stdout:Fetched 7,053 kB in 2s (4,674 kB/s) 2019-12-05T03:40:33.539 INFO:teuthology.orchestra.run.smithi158.stdout:Reading package lists... 2019-12-05T03:40:33.585 INFO:teuthology.orchestra.run.smithi158:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2019-12-05T03:40:33.660 INFO:teuthology.orchestra.run.smithi158.stdout:Reading package lists... 2019-12-05T03:40:33.911 INFO:teuthology.orchestra.run.smithi158.stdout:Building dependency tree... 2019-12-05T03:40:33.912 INFO:teuthology.orchestra.run.smithi158.stdout:Reading state information... 2019-12-05T03:40:33.986 INFO:teuthology.orchestra.run.smithi158.stderr:E: Unable to locate package linux-image-current-generic 2019-12-05T03:40:33.988 DEBUG:teuthology.orchestra.run:got remote process result: 100 2019-12-05T03:40:33.989 INFO:teuthology.orchestra.run.smithi158:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2019-12-05T03:40:34.067 INFO:teuthology.orchestra.run.smithi158.stdout:Reading package lists... 2019-12-05T03:40:34.316 INFO:teuthology.orchestra.run.smithi158.stdout:Building dependency tree... 2019-12-05T03:40:34.316 INFO:teuthology.orchestra.run.smithi158.stdout:Reading state information... 2019-12-05T03:40:34.475 INFO:teuthology.orchestra.run.smithi158.stdout:The following additional packages will be installed: 2019-12-05T03:40:34.475 INFO:teuthology.orchestra.run.smithi158.stdout: linux-generic linux-headers-4.15.0-72 linux-headers-4.15.0-72-generic 2019-12-05T03:40:34.475 INFO:teuthology.orchestra.run.smithi158.stdout: linux-headers-generic linux-image-4.15.0-72-generic 2019-12-05T03:40:34.475 INFO:teuthology.orchestra.run.smithi158.stdout: linux-modules-4.15.0-72-generic linux-modules-extra-4.15.0-72-generic 2019-12-05T03:40:34.477 INFO:teuthology.orchestra.run.smithi158.stdout:Suggested packages: 2019-12-05T03:40:34.477 INFO:teuthology.orchestra.run.smithi158.stdout: fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools 2019-12-05T03:40:34.477 INFO:teuthology.orchestra.run.smithi158.stdout:Recommended packages: 2019-12-05T03:40:34.477 INFO:teuthology.orchestra.run.smithi158.stdout: thermald 2019-12-05T03:40:34.508 INFO:teuthology.orchestra.run.smithi158.stdout:The following NEW packages will be installed: 2019-12-05T03:40:34.509 INFO:teuthology.orchestra.run.smithi158.stdout: linux-headers-4.15.0-72 linux-headers-4.15.0-72-generic 2019-12-05T03:40:34.509 INFO:teuthology.orchestra.run.smithi158.stdout: linux-image-4.15.0-72-generic linux-modules-4.15.0-72-generic 2019-12-05T03:40:34.509 INFO:teuthology.orchestra.run.smithi158.stdout: linux-modules-extra-4.15.0-72-generic 2019-12-05T03:40:34.511 INFO:teuthology.orchestra.run.smithi158.stdout:The following packages will be upgraded: 2019-12-05T03:40:34.512 INFO:teuthology.orchestra.run.smithi158.stdout: linux-generic linux-headers-generic linux-image-generic 2019-12-05T03:40:34.693 INFO:teuthology.orchestra.run.smithi158.stdout:3 upgraded, 5 newly installed, 0 to remove and 56 not upgraded. 2019-12-05T03:40:34.694 INFO:teuthology.orchestra.run.smithi158.stdout:Need to get 65.8 MB of archives. 2019-12-05T03:40:34.694 INFO:teuthology.orchestra.run.smithi158.stdout:After this operation, 332 MB of additional disk space will be used. 2019-12-05T03:40:34.694 INFO:teuthology.orchestra.run.smithi158.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-72-generic amd64 4.15.0-72.81 [13.0 MB] 2019-12-05T03:40:35.706 INFO:teuthology.orchestra.run.smithi158.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-72-generic amd64 4.15.0-72.81 [7,991 kB] 2019-12-05T03:40:35.888 INFO:teuthology.orchestra.run.smithi158.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-72-generic amd64 4.15.0-72.81 [32.7 MB] 2019-12-05T03:40:36.841 INFO:teuthology.orchestra.run.smithi158.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.72.74 [1,868 B] 2019-12-05T03:40:36.841 INFO:teuthology.orchestra.run.smithi158.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.72.74 [2,392 B] 2019-12-05T03:40:36.841 INFO:teuthology.orchestra.run.smithi158.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-72 all 4.15.0-72.81 [10.9 MB] 2019-12-05T03:40:37.145 INFO:teuthology.orchestra.run.smithi158.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-72-generic amd64 4.15.0-72.81 [1,107 kB] 2019-12-05T03:40:37.165 INFO:teuthology.orchestra.run.smithi158.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.72.74 [2,348 B] 2019-12-05T03:40:37.645 INFO:teuthology.orchestra.run.smithi158.stdout:Fetched 65.8 MB in 3s (24.9 MB/s) 2019-12-05T03:40:37.812 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package linux-modules-4.15.0-72-generic. 2019-12-05T03:40:37.848 INFO:teuthology.orchestra.run.smithi158.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 101661 files and directories currently installed.) 2019-12-05T03:40:37.850 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../0-linux-modules-4.15.0-72-generic_4.15.0-72.81_amd64.deb ... 2019-12-05T03:40:37.920 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking linux-modules-4.15.0-72-generic (4.15.0-72.81) ... 2019-12-05T03:40:39.600 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package linux-image-4.15.0-72-generic. 2019-12-05T03:40:39.616 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../1-linux-image-4.15.0-72-generic_4.15.0-72.81_amd64.deb ... 2019-12-05T03:40:39.709 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking linux-image-4.15.0-72-generic (4.15.0-72.81) ... 2019-12-05T03:40:40.220 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-72-generic. 2019-12-05T03:40:40.233 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-72-generic_4.15.0-72.81_amd64.deb ... 2019-12-05T03:40:40.269 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking linux-modules-extra-4.15.0-72-generic (4.15.0-72.81) ... 2019-12-05T03:40:43.999 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../3-linux-generic_4.15.0.72.74_amd64.deb ... 2019-12-05T03:40:44.127 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking linux-generic (4.15.0.72.74) over (4.15.0.66.68) ... 2019-12-05T03:40:44.515 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.72.74_amd64.deb ... 2019-12-05T03:40:44.643 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking linux-image-generic (4.15.0.72.74) over (4.15.0.66.68) ... 2019-12-05T03:40:44.971 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package linux-headers-4.15.0-72. 2019-12-05T03:40:44.983 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../5-linux-headers-4.15.0-72_4.15.0-72.81_all.deb ... 2019-12-05T03:40:45.021 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking linux-headers-4.15.0-72 (4.15.0-72.81) ... 2019-12-05T03:40:49.598 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package linux-headers-4.15.0-72-generic. 2019-12-05T03:40:49.620 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../6-linux-headers-4.15.0-72-generic_4.15.0-72.81_amd64.deb ... 2019-12-05T03:40:49.656 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking linux-headers-4.15.0-72-generic (4.15.0-72.81) ... 2019-12-05T03:40:52.738 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.72.74_amd64.deb ... 2019-12-05T03:40:52.863 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking linux-headers-generic (4.15.0.72.74) over (4.15.0.66.68) ... 2019-12-05T03:40:53.226 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up linux-modules-4.15.0-72-generic (4.15.0-72.81) ... 2019-12-05T03:40:53.822 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up linux-headers-4.15.0-72 (4.15.0-72.81) ... 2019-12-05T03:40:53.933 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up linux-image-4.15.0-72-generic (4.15.0-72.81) ... 2019-12-05T03:40:54.381 INFO:teuthology.orchestra.run.smithi158.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-72-generic 2019-12-05T03:40:54.381 INFO:teuthology.orchestra.run.smithi158.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-72-generic 2019-12-05T03:40:54.518 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up linux-headers-4.15.0-72-generic (4.15.0-72.81) ... 2019-12-05T03:40:54.630 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up linux-headers-generic (4.15.0.72.74) ... 2019-12-05T03:40:54.750 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up linux-modules-extra-4.15.0-72-generic (4.15.0-72.81) ... 2019-12-05T03:40:55.249 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up linux-image-generic (4.15.0.72.74) ... 2019-12-05T03:40:55.371 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up linux-generic (4.15.0.72.74) ... 2019-12-05T03:40:55.493 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for linux-image-4.15.0-72-generic (4.15.0-72.81) ... 2019-12-05T03:40:55.691 INFO:teuthology.orchestra.run.smithi158.stdout:/etc/kernel/postinst.d/initramfs-tools: 2019-12-05T03:40:55.692 INFO:teuthology.orchestra.run.smithi158.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-72-generic 2019-12-05T03:41:10.505 INFO:teuthology.orchestra.run.smithi158.stdout:/etc/kernel/postinst.d/zz-update-grub: 2019-12-05T03:41:10.505 INFO:teuthology.orchestra.run.smithi158.stdout:Sourcing file `/etc/default/grub' 2019-12-05T03:41:10.540 INFO:teuthology.orchestra.run.smithi158.stdout:Generating grub configuration file ... 2019-12-05T03:41:10.874 INFO:teuthology.orchestra.run.smithi158.stdout:Found linux image: /boot/vmlinuz-4.15.0-72-generic 2019-12-05T03:41:10.897 INFO:teuthology.orchestra.run.smithi158.stdout:Found initrd image: /boot/initrd.img-4.15.0-72-generic 2019-12-05T03:41:11.225 INFO:teuthology.orchestra.run.smithi158.stdout:Found linux image: /boot/vmlinuz-4.15.0-66-generic 2019-12-05T03:41:11.266 INFO:teuthology.orchestra.run.smithi158.stdout:Found initrd image: /boot/initrd.img-4.15.0-66-generic 2019-12-05T03:41:12.720 INFO:teuthology.orchestra.run.smithi158.stdout:done 2019-12-05T03:41:13.170 INFO:teuthology.orchestra.run.smithi158:> dpkg -s linux-image-generic 2019-12-05T03:41:13.194 INFO:teuthology.orchestra.run.smithi158.stdout:Package: linux-image-generic 2019-12-05T03:41:13.194 INFO:teuthology.orchestra.run.smithi158.stdout:Status: install ok installed 2019-12-05T03:41:13.194 INFO:teuthology.orchestra.run.smithi158.stdout:Priority: optional 2019-12-05T03:41:13.195 INFO:teuthology.orchestra.run.smithi158.stdout:Section: kernel 2019-12-05T03:41:13.195 INFO:teuthology.orchestra.run.smithi158.stdout:Installed-Size: 15 2019-12-05T03:41:13.195 INFO:teuthology.orchestra.run.smithi158.stdout:Maintainer: Ubuntu Kernel Team 2019-12-05T03:41:13.195 INFO:teuthology.orchestra.run.smithi158.stdout:Architecture: amd64 2019-12-05T03:41:13.195 INFO:teuthology.orchestra.run.smithi158.stdout:Source: linux-meta 2019-12-05T03:41:13.195 INFO:teuthology.orchestra.run.smithi158.stdout:Version: 4.15.0.72.74 2019-12-05T03:41:13.196 INFO:teuthology.orchestra.run.smithi158.stdout:Depends: linux-image-4.15.0-72-generic, linux-modules-extra-4.15.0-72-generic, linux-firmware, intel-microcode, amd64-microcode 2019-12-05T03:41:13.196 INFO:teuthology.orchestra.run.smithi158.stdout:Recommends: thermald 2019-12-05T03:41:13.196 INFO:teuthology.orchestra.run.smithi158.stdout:Description: Generic Linux kernel image 2019-12-05T03:41:13.196 INFO:teuthology.orchestra.run.smithi158.stdout: This package will always depend on the latest generic kernel image 2019-12-05T03:41:13.196 INFO:teuthology.orchestra.run.smithi158.stdout: available. 2019-12-05T03:41:13.197 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.15.0-66-generic Expected: 4.15.0-72-generic 2019-12-05T03:41:13.197 INFO:teuthology.orchestra.run.smithi096:> uname -r 2019-12-05T03:41:13.204 INFO:teuthology.orchestra.run.smithi096.stdout:4.15.0-66-generic 2019-12-05T03:41:13.204 INFO:teuthology.task.kernel:Running kernel on smithi096: 4.15.0-66-generic 2019-12-05T03:41:13.204 INFO:teuthology.orchestra.run.smithi096:> sudo apt-get clean 2019-12-05T03:41:13.332 INFO:teuthology.orchestra.run.smithi096:> sudo apt-get update 2019-12-05T03:41:13.457 INFO:teuthology.orchestra.run.smithi096.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2019-12-05T03:41:13.583 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2019-12-05T03:41:13.663 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2019-12-05T03:41:13.732 INFO:teuthology.orchestra.run.smithi096.stdout:Get:4 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [590 kB] 2019-12-05T03:41:13.819 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [413 kB] 2019-12-05T03:41:13.828 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [194 kB] 2019-12-05T03:41:13.832 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [14.6 kB] 2019-12-05T03:41:13.833 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [4,600 B] 2019-12-05T03:41:13.833 INFO:teuthology.orchestra.run.smithi096.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [600 kB] 2019-12-05T03:41:13.846 INFO:teuthology.orchestra.run.smithi096.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [626 kB] 2019-12-05T03:41:13.857 INFO:teuthology.orchestra.run.smithi096.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [209 kB] 2019-12-05T03:41:13.860 INFO:teuthology.orchestra.run.smithi096.stdout:Get:12 http://security.ubuntu.com/ubuntu bionic-security/multiverse i386 Packages [4,292 B] 2019-12-05T03:41:13.860 INFO:teuthology.orchestra.run.smithi096.stdout:Get:13 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [6,116 B] 2019-12-05T03:41:13.860 INFO:teuthology.orchestra.run.smithi096.stdout:Get:14 http://security.ubuntu.com/ubuntu bionic-security/multiverse Translation-en [2,600 B] 2019-12-05T03:41:13.977 INFO:teuthology.orchestra.run.smithi096.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2019-12-05T03:41:14.115 INFO:teuthology.orchestra.run.smithi096.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [814 kB] 2019-12-05T03:41:14.385 INFO:teuthology.orchestra.run.smithi096.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [624 kB] 2019-12-05T03:41:14.454 INFO:teuthology.orchestra.run.smithi096.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [287 kB] 2019-12-05T03:41:14.476 INFO:teuthology.orchestra.run.smithi096.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [23.4 kB] 2019-12-05T03:41:14.477 INFO:teuthology.orchestra.run.smithi096.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/restricted i386 Packages [9,260 B] 2019-12-05T03:41:14.478 INFO:teuthology.orchestra.run.smithi096.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [6,436 B] 2019-12-05T03:41:14.479 INFO:teuthology.orchestra.run.smithi096.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [996 kB] 2019-12-05T03:41:14.526 INFO:teuthology.orchestra.run.smithi096.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,032 kB] 2019-12-05T03:41:14.568 INFO:teuthology.orchestra.run.smithi096.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [319 kB] 2019-12-05T03:41:14.577 INFO:teuthology.orchestra.run.smithi096.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [6,924 B] 2019-12-05T03:41:14.578 INFO:teuthology.orchestra.run.smithi096.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [8,736 B] 2019-12-05T03:41:14.578 INFO:teuthology.orchestra.run.smithi096.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [4,080 B] 2019-12-05T03:41:14.630 INFO:teuthology.orchestra.run.smithi096.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic-backports/universe amd64 Packages [4,028 B] 2019-12-05T03:41:14.631 INFO:teuthology.orchestra.run.smithi096.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic-backports/universe i386 Packages [4,028 B] 2019-12-05T03:41:15.091 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 7,053 kB in 2s (4,571 kB/s) 2019-12-05T03:41:16.434 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2019-12-05T03:41:16.478 INFO:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2019-12-05T03:41:16.560 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2019-12-05T03:41:16.806 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2019-12-05T03:41:16.807 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2019-12-05T03:41:16.880 INFO:teuthology.orchestra.run.smithi096.stderr:E: Unable to locate package linux-image-current-generic 2019-12-05T03:41:16.882 DEBUG:teuthology.orchestra.run:got remote process result: 100 2019-12-05T03:41:16.882 INFO:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2019-12-05T03:41:16.961 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2019-12-05T03:41:17.189 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2019-12-05T03:41:17.189 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2019-12-05T03:41:17.348 INFO:teuthology.orchestra.run.smithi096.stdout:The following additional packages will be installed: 2019-12-05T03:41:17.348 INFO:teuthology.orchestra.run.smithi096.stdout: linux-generic linux-headers-4.15.0-72 linux-headers-4.15.0-72-generic 2019-12-05T03:41:17.348 INFO:teuthology.orchestra.run.smithi096.stdout: linux-headers-generic linux-image-4.15.0-72-generic 2019-12-05T03:41:17.349 INFO:teuthology.orchestra.run.smithi096.stdout: linux-modules-4.15.0-72-generic linux-modules-extra-4.15.0-72-generic 2019-12-05T03:41:17.350 INFO:teuthology.orchestra.run.smithi096.stdout:Suggested packages: 2019-12-05T03:41:17.350 INFO:teuthology.orchestra.run.smithi096.stdout: fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools 2019-12-05T03:41:17.350 INFO:teuthology.orchestra.run.smithi096.stdout:Recommended packages: 2019-12-05T03:41:17.350 INFO:teuthology.orchestra.run.smithi096.stdout: thermald 2019-12-05T03:41:17.380 INFO:teuthology.orchestra.run.smithi096.stdout:The following NEW packages will be installed: 2019-12-05T03:41:17.381 INFO:teuthology.orchestra.run.smithi096.stdout: linux-headers-4.15.0-72 linux-headers-4.15.0-72-generic 2019-12-05T03:41:17.381 INFO:teuthology.orchestra.run.smithi096.stdout: linux-image-4.15.0-72-generic linux-modules-4.15.0-72-generic 2019-12-05T03:41:17.381 INFO:teuthology.orchestra.run.smithi096.stdout: linux-modules-extra-4.15.0-72-generic 2019-12-05T03:41:17.382 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages will be upgraded: 2019-12-05T03:41:17.383 INFO:teuthology.orchestra.run.smithi096.stdout: linux-generic linux-headers-generic linux-image-generic 2019-12-05T03:41:17.563 INFO:teuthology.orchestra.run.smithi096.stdout:3 upgraded, 5 newly installed, 0 to remove and 56 not upgraded. 2019-12-05T03:41:17.563 INFO:teuthology.orchestra.run.smithi096.stdout:Need to get 65.8 MB of archives. 2019-12-05T03:41:17.563 INFO:teuthology.orchestra.run.smithi096.stdout:After this operation, 332 MB of additional disk space will be used. 2019-12-05T03:41:17.563 INFO:teuthology.orchestra.run.smithi096.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-72-generic amd64 4.15.0-72.81 [13.0 MB] 2019-12-05T03:41:18.590 INFO:teuthology.orchestra.run.smithi096.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-72-generic amd64 4.15.0-72.81 [7,991 kB] 2019-12-05T03:41:18.779 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-72-generic amd64 4.15.0-72.81 [32.7 MB] 2019-12-05T03:41:19.742 INFO:teuthology.orchestra.run.smithi096.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.72.74 [1,868 B] 2019-12-05T03:41:19.743 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.72.74 [2,392 B] 2019-12-05T03:41:19.743 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-72 all 4.15.0-72.81 [10.9 MB] 2019-12-05T03:41:20.045 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-72-generic amd64 4.15.0-72.81 [1,107 kB] 2019-12-05T03:41:20.072 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.72.74 [2,348 B] 2019-12-05T03:41:20.546 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 65.8 MB in 3s (24.6 MB/s) 2019-12-05T03:41:20.718 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-modules-4.15.0-72-generic. 2019-12-05T03:41:20.756 INFO:teuthology.orchestra.run.smithi096.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 101661 files and directories currently installed.) 2019-12-05T03:41:20.759 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../0-linux-modules-4.15.0-72-generic_4.15.0-72.81_amd64.deb ... 2019-12-05T03:41:20.812 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-modules-4.15.0-72-generic (4.15.0-72.81) ... 2019-12-05T03:41:22.397 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-image-4.15.0-72-generic. 2019-12-05T03:41:22.408 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../1-linux-image-4.15.0-72-generic_4.15.0-72.81_amd64.deb ... 2019-12-05T03:41:22.513 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-image-4.15.0-72-generic (4.15.0-72.81) ... 2019-12-05T03:41:23.017 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-72-generic. 2019-12-05T03:41:23.030 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-72-generic_4.15.0-72.81_amd64.deb ... 2019-12-05T03:41:23.067 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-modules-extra-4.15.0-72-generic (4.15.0-72.81) ... 2019-12-05T03:41:26.743 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../3-linux-generic_4.15.0.72.74_amd64.deb ... 2019-12-05T03:41:26.865 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-generic (4.15.0.72.74) over (4.15.0.66.68) ... 2019-12-05T03:41:27.184 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.72.74_amd64.deb ... 2019-12-05T03:41:27.289 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-image-generic (4.15.0.72.74) over (4.15.0.66.68) ... 2019-12-05T03:41:27.625 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-headers-4.15.0-72. 2019-12-05T03:41:27.637 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../5-linux-headers-4.15.0-72_4.15.0-72.81_all.deb ... 2019-12-05T03:41:27.691 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-headers-4.15.0-72 (4.15.0-72.81) ... 2019-12-05T03:41:32.481 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-headers-4.15.0-72-generic. 2019-12-05T03:41:32.503 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../6-linux-headers-4.15.0-72-generic_4.15.0-72.81_amd64.deb ... 2019-12-05T03:41:32.548 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-headers-4.15.0-72-generic (4.15.0-72.81) ... 2019-12-05T03:41:35.549 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.72.74_amd64.deb ... 2019-12-05T03:41:35.671 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-headers-generic (4.15.0.72.74) over (4.15.0.66.68) ... 2019-12-05T03:41:35.997 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-modules-4.15.0-72-generic (4.15.0-72.81) ... 2019-12-05T03:41:36.610 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-headers-4.15.0-72 (4.15.0-72.81) ... 2019-12-05T03:41:36.731 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-image-4.15.0-72-generic (4.15.0-72.81) ... 2019-12-05T03:41:37.176 INFO:teuthology.orchestra.run.smithi096.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-72-generic 2019-12-05T03:41:37.176 INFO:teuthology.orchestra.run.smithi096.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-72-generic 2019-12-05T03:41:37.316 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-headers-4.15.0-72-generic (4.15.0-72.81) ... 2019-12-05T03:41:37.452 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-headers-generic (4.15.0.72.74) ... 2019-12-05T03:41:37.590 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-modules-extra-4.15.0-72-generic (4.15.0-72.81) ... 2019-12-05T03:41:38.072 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-image-generic (4.15.0.72.74) ... 2019-12-05T03:41:38.209 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-generic (4.15.0.72.74) ... 2019-12-05T03:41:38.337 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for linux-image-4.15.0-72-generic (4.15.0-72.81) ... 2019-12-05T03:41:38.521 INFO:teuthology.orchestra.run.smithi096.stdout:/etc/kernel/postinst.d/initramfs-tools: 2019-12-05T03:41:38.521 INFO:teuthology.orchestra.run.smithi096.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-72-generic 2019-12-05T03:41:53.554 INFO:teuthology.orchestra.run.smithi096.stdout:/etc/kernel/postinst.d/zz-update-grub: 2019-12-05T03:41:53.554 INFO:teuthology.orchestra.run.smithi096.stdout:Sourcing file `/etc/default/grub' 2019-12-05T03:41:53.585 INFO:teuthology.orchestra.run.smithi096.stdout:Generating grub configuration file ... 2019-12-05T03:41:54.020 INFO:teuthology.orchestra.run.smithi096.stdout:Found linux image: /boot/vmlinuz-4.15.0-72-generic 2019-12-05T03:41:54.048 INFO:teuthology.orchestra.run.smithi096.stdout:Found initrd image: /boot/initrd.img-4.15.0-72-generic 2019-12-05T03:41:54.442 INFO:teuthology.orchestra.run.smithi096.stdout:Found linux image: /boot/vmlinuz-4.15.0-66-generic 2019-12-05T03:41:54.473 INFO:teuthology.orchestra.run.smithi096.stdout:Found initrd image: /boot/initrd.img-4.15.0-66-generic 2019-12-05T03:41:55.913 INFO:teuthology.orchestra.run.smithi096.stdout:done 2019-12-05T03:41:56.317 INFO:teuthology.orchestra.run.smithi096:> dpkg -s linux-image-generic 2019-12-05T03:41:56.341 INFO:teuthology.orchestra.run.smithi096.stdout:Package: linux-image-generic 2019-12-05T03:41:56.341 INFO:teuthology.orchestra.run.smithi096.stdout:Status: install ok installed 2019-12-05T03:41:56.342 INFO:teuthology.orchestra.run.smithi096.stdout:Priority: optional 2019-12-05T03:41:56.342 INFO:teuthology.orchestra.run.smithi096.stdout:Section: kernel 2019-12-05T03:41:56.342 INFO:teuthology.orchestra.run.smithi096.stdout:Installed-Size: 15 2019-12-05T03:41:56.342 INFO:teuthology.orchestra.run.smithi096.stdout:Maintainer: Ubuntu Kernel Team 2019-12-05T03:41:56.342 INFO:teuthology.orchestra.run.smithi096.stdout:Architecture: amd64 2019-12-05T03:41:56.343 INFO:teuthology.orchestra.run.smithi096.stdout:Source: linux-meta 2019-12-05T03:41:56.343 INFO:teuthology.orchestra.run.smithi096.stdout:Version: 4.15.0.72.74 2019-12-05T03:41:56.343 INFO:teuthology.orchestra.run.smithi096.stdout:Depends: linux-image-4.15.0-72-generic, linux-modules-extra-4.15.0-72-generic, linux-firmware, intel-microcode, amd64-microcode 2019-12-05T03:41:56.343 INFO:teuthology.orchestra.run.smithi096.stdout:Recommends: thermald 2019-12-05T03:41:56.344 INFO:teuthology.orchestra.run.smithi096.stdout:Description: Generic Linux kernel image 2019-12-05T03:41:56.344 INFO:teuthology.orchestra.run.smithi096.stdout: This package will always depend on the latest generic kernel image 2019-12-05T03:41:56.346 INFO:teuthology.orchestra.run.smithi096.stdout: available. 2019-12-05T03:41:56.346 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.15.0-66-generic Expected: 4.15.0-72-generic 2019-12-05T03:41:56.346 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2019-12-05T03:41:56.347 DEBUG:teuthology.task.kernel:src is distro, skipping download 2019-12-05T03:41:56.347 DEBUG:teuthology.task.kernel:src is distro, skipping download 2019-12-05T03:41:56.347 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2019-12-05T03:41:56.347 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi158.front.sepia.ceph.com, path=None, version=distro) 2019-12-05T03:41:56.348 INFO:teuthology.orchestra.run.smithi158:> sudo apt-get clean 2019-12-05T03:41:56.456 INFO:teuthology.orchestra.run.smithi158:> sudo apt-get update 2019-12-05T03:41:56.722 INFO:teuthology.orchestra.run.smithi158.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2019-12-05T03:41:56.729 INFO:teuthology.orchestra.run.smithi158.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2019-12-05T03:41:56.809 INFO:teuthology.orchestra.run.smithi158.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2019-12-05T03:41:56.890 INFO:teuthology.orchestra.run.smithi158.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2019-12-05T03:41:58.495 INFO:teuthology.orchestra.run.smithi158.stdout:Reading package lists... 2019-12-05T03:41:58.536 INFO:teuthology.orchestra.run.smithi158:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2019-12-05T03:41:58.618 INFO:teuthology.orchestra.run.smithi158.stdout:Reading package lists... 2019-12-05T03:41:58.852 INFO:teuthology.orchestra.run.smithi158.stdout:Building dependency tree... 2019-12-05T03:41:58.853 INFO:teuthology.orchestra.run.smithi158.stdout:Reading state information... 2019-12-05T03:41:58.926 INFO:teuthology.orchestra.run.smithi158.stderr:E: Unable to locate package linux-image-current-generic 2019-12-05T03:41:58.927 DEBUG:teuthology.orchestra.run:got remote process result: 100 2019-12-05T03:41:58.928 INFO:teuthology.orchestra.run.smithi158:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2019-12-05T03:41:59.002 INFO:teuthology.orchestra.run.smithi158.stdout:Reading package lists... 2019-12-05T03:41:59.226 INFO:teuthology.orchestra.run.smithi158.stdout:Building dependency tree... 2019-12-05T03:41:59.226 INFO:teuthology.orchestra.run.smithi158.stdout:Reading state information... 2019-12-05T03:41:59.406 INFO:teuthology.orchestra.run.smithi158.stdout:linux-image-generic is already the newest version (4.15.0.72.74). 2019-12-05T03:41:59.406 INFO:teuthology.orchestra.run.smithi158.stdout:0 upgraded, 0 newly installed, 0 to remove and 56 not upgraded. 2019-12-05T03:41:59.407 INFO:teuthology.orchestra.run.smithi158:> dpkg -s linux-image-generic 2019-12-05T03:41:59.430 INFO:teuthology.orchestra.run.smithi158.stdout:Package: linux-image-generic 2019-12-05T03:41:59.430 INFO:teuthology.orchestra.run.smithi158.stdout:Status: install ok installed 2019-12-05T03:41:59.430 INFO:teuthology.orchestra.run.smithi158.stdout:Priority: optional 2019-12-05T03:41:59.430 INFO:teuthology.orchestra.run.smithi158.stdout:Section: kernel 2019-12-05T03:41:59.430 INFO:teuthology.orchestra.run.smithi158.stdout:Installed-Size: 15 2019-12-05T03:41:59.430 INFO:teuthology.orchestra.run.smithi158.stdout:Maintainer: Ubuntu Kernel Team 2019-12-05T03:41:59.431 INFO:teuthology.orchestra.run.smithi158.stdout:Architecture: amd64 2019-12-05T03:41:59.431 INFO:teuthology.orchestra.run.smithi158.stdout:Source: linux-meta 2019-12-05T03:41:59.431 INFO:teuthology.orchestra.run.smithi158.stdout:Version: 4.15.0.72.74 2019-12-05T03:41:59.431 INFO:teuthology.orchestra.run.smithi158.stdout:Depends: linux-image-4.15.0-72-generic, linux-modules-extra-4.15.0-72-generic, linux-firmware, intel-microcode, amd64-microcode 2019-12-05T03:41:59.431 INFO:teuthology.orchestra.run.smithi158.stdout:Recommends: thermald 2019-12-05T03:41:59.431 INFO:teuthology.orchestra.run.smithi158.stdout:Description: Generic Linux kernel image 2019-12-05T03:41:59.431 INFO:teuthology.orchestra.run.smithi158.stdout: This package will always depend on the latest generic kernel image 2019-12-05T03:41:59.431 INFO:teuthology.orchestra.run.smithi158.stdout: available. 2019-12-05T03:41:59.432 INFO:teuthology.orchestra.run.smithi158:> mktemp 2019-12-05T03:41:59.506 INFO:teuthology.orchestra.run.smithi158.stdout:/tmp/tmp.qYmeAEMtc7 2019-12-05T03:41:59.507 INFO:teuthology.orchestra.run.smithi158:> sudo cp /boot/grub/grub.cfg /tmp/tmp.qYmeAEMtc7 2019-12-05T03:41:59.607 INFO:teuthology.orchestra.run.smithi158:> sudo chmod 0666 /tmp/tmp.qYmeAEMtc7 2019-12-05T03:41:59.763 DEBUG:teuthology.orchestra.remote:smithi158:/tmp/tmp.qYmeAEMtc7 is 8KB 2019-12-05T03:41:59.776 INFO:teuthology.orchestra.run.smithi158:> rm -fr /tmp/tmp.qYmeAEMtc7 2019-12-05T03:41:59.788 INFO:teuthology.orchestra.run.smithi158:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2019-12-05T03:41:59.871 INFO:teuthology.orchestra.run.smithi158:> sudo sh -c 'cat > /etc/grub.d/01_ceph_kernel' && sudo chmod 755 /etc/grub.d/01_ceph_kernel 2019-12-05T03:41:59.993 INFO:teuthology.task.kernel:Distro Kernel Version: 4.15.0-72-generic 2019-12-05T03:41:59.993 INFO:teuthology.orchestra.run.smithi158:> sudo update-grub 2019-12-05T03:42:01.298 INFO:teuthology.orchestra.run.smithi158.stderr:Sourcing file `/etc/default/grub' 2019-12-05T03:42:01.317 INFO:teuthology.orchestra.run.smithi158.stderr:Generating grub configuration file ... 2019-12-05T03:42:01.562 INFO:teuthology.orchestra.run.smithi158.stderr:Found linux image: /boot/vmlinuz-4.15.0-72-generic 2019-12-05T03:42:01.574 INFO:teuthology.orchestra.run.smithi158.stderr:Found initrd image: /boot/initrd.img-4.15.0-72-generic 2019-12-05T03:42:01.888 INFO:teuthology.orchestra.run.smithi158.stderr:Found linux image: /boot/vmlinuz-4.15.0-66-generic 2019-12-05T03:42:01.900 INFO:teuthology.orchestra.run.smithi158.stderr:Found initrd image: /boot/initrd.img-4.15.0-66-generic 2019-12-05T03:42:03.048 INFO:teuthology.orchestra.run.smithi158.stderr:done 2019-12-05T03:42:03.048 INFO:teuthology.orchestra.run.smithi158:> sudo shutdown -r now 2019-12-05T03:42:03.051 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2019-12-05T03:42:03.051 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi096.front.sepia.ceph.com, path=None, version=distro) 2019-12-05T03:42:03.052 INFO:teuthology.orchestra.run.smithi096:> sudo apt-get clean 2019-12-05T03:42:03.116 INFO:teuthology.orchestra.run.smithi096:> sudo apt-get update 2019-12-05T03:42:03.383 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:1 http://archive.ubuntu.com/ubuntu bionic InRelease 2019-12-05T03:42:03.384 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:2 http://security.ubuntu.com/ubuntu bionic-security InRelease 2019-12-05T03:42:03.452 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2019-12-05T03:42:03.532 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2019-12-05T03:42:05.160 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2019-12-05T03:42:05.207 INFO:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2019-12-05T03:42:05.289 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2019-12-05T03:42:05.512 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2019-12-05T03:42:05.512 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2019-12-05T03:42:05.587 INFO:teuthology.orchestra.run.smithi096.stderr:E: Unable to locate package linux-image-current-generic 2019-12-05T03:42:05.589 DEBUG:teuthology.orchestra.run:got remote process result: 100 2019-12-05T03:42:05.597 INFO:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2019-12-05T03:42:05.676 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2019-12-05T03:42:05.899 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2019-12-05T03:42:05.900 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2019-12-05T03:42:06.083 INFO:teuthology.orchestra.run.smithi096.stdout:linux-image-generic is already the newest version (4.15.0.72.74). 2019-12-05T03:42:06.084 INFO:teuthology.orchestra.run.smithi096.stdout:0 upgraded, 0 newly installed, 0 to remove and 56 not upgraded. 2019-12-05T03:42:06.085 INFO:teuthology.orchestra.run.smithi096:> dpkg -s linux-image-generic 2019-12-05T03:42:06.108 INFO:teuthology.orchestra.run.smithi096.stdout:Package: linux-image-generic 2019-12-05T03:42:06.108 INFO:teuthology.orchestra.run.smithi096.stdout:Status: install ok installed 2019-12-05T03:42:06.108 INFO:teuthology.orchestra.run.smithi096.stdout:Priority: optional 2019-12-05T03:42:06.108 INFO:teuthology.orchestra.run.smithi096.stdout:Section: kernel 2019-12-05T03:42:06.109 INFO:teuthology.orchestra.run.smithi096.stdout:Installed-Size: 15 2019-12-05T03:42:06.109 INFO:teuthology.orchestra.run.smithi096.stdout:Maintainer: Ubuntu Kernel Team 2019-12-05T03:42:06.109 INFO:teuthology.orchestra.run.smithi096.stdout:Architecture: amd64 2019-12-05T03:42:06.109 INFO:teuthology.orchestra.run.smithi096.stdout:Source: linux-meta 2019-12-05T03:42:06.109 INFO:teuthology.orchestra.run.smithi096.stdout:Version: 4.15.0.72.74 2019-12-05T03:42:06.109 INFO:teuthology.orchestra.run.smithi096.stdout:Depends: linux-image-4.15.0-72-generic, linux-modules-extra-4.15.0-72-generic, linux-firmware, intel-microcode, amd64-microcode 2019-12-05T03:42:06.109 INFO:teuthology.orchestra.run.smithi096.stdout:Recommends: thermald 2019-12-05T03:42:06.110 INFO:teuthology.orchestra.run.smithi096.stdout:Description: Generic Linux kernel image 2019-12-05T03:42:06.110 INFO:teuthology.orchestra.run.smithi096.stdout: This package will always depend on the latest generic kernel image 2019-12-05T03:42:06.110 INFO:teuthology.orchestra.run.smithi096.stdout: available. 2019-12-05T03:42:06.111 INFO:teuthology.orchestra.run.smithi096:> mktemp 2019-12-05T03:42:06.185 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.LK7JQ45hoy 2019-12-05T03:42:06.185 INFO:teuthology.orchestra.run.smithi096:> sudo cp /boot/grub/grub.cfg /tmp/tmp.LK7JQ45hoy 2019-12-05T03:42:06.261 INFO:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.LK7JQ45hoy 2019-12-05T03:42:06.419 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.LK7JQ45hoy is 8KB 2019-12-05T03:42:06.476 INFO:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.LK7JQ45hoy 2019-12-05T03:42:06.483 INFO:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2019-12-05T03:42:06.562 INFO:teuthology.orchestra.run.smithi096:> sudo sh -c 'cat > /etc/grub.d/01_ceph_kernel' && sudo chmod 755 /etc/grub.d/01_ceph_kernel 2019-12-05T03:42:06.682 INFO:teuthology.task.kernel:Distro Kernel Version: 4.15.0-72-generic 2019-12-05T03:42:06.683 INFO:teuthology.orchestra.run.smithi096:> sudo update-grub 2019-12-05T03:42:08.040 INFO:teuthology.orchestra.run.smithi096.stderr:Sourcing file `/etc/default/grub' 2019-12-05T03:42:08.056 INFO:teuthology.orchestra.run.smithi096.stderr:Generating grub configuration file ... 2019-12-05T03:42:08.290 INFO:teuthology.orchestra.run.smithi096.stderr:Found linux image: /boot/vmlinuz-4.15.0-72-generic 2019-12-05T03:42:08.303 INFO:teuthology.orchestra.run.smithi096.stderr:Found initrd image: /boot/initrd.img-4.15.0-72-generic 2019-12-05T03:42:08.611 INFO:teuthology.orchestra.run.smithi096.stderr:Found linux image: /boot/vmlinuz-4.15.0-66-generic 2019-12-05T03:42:08.625 INFO:teuthology.orchestra.run.smithi096.stderr:Found initrd image: /boot/initrd.img-4.15.0-66-generic 2019-12-05T03:42:09.705 INFO:teuthology.orchestra.run.smithi096.stderr:done 2019-12-05T03:42:09.706 INFO:teuthology.orchestra.run.smithi096:> sudo shutdown -r now 2019-12-05T03:42:09.709 INFO:teuthology.misc:Re-opening connections... 2019-12-05T03:42:09.710 INFO:teuthology.misc:trying to connect to ubuntu@smithi158.front.sepia.ceph.com 2019-12-05T03:42:09.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-05T03:42:09.710 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi158.front.sepia.ceph.com', 'timeout': 60} 2019-12-05T03:43:09.711 DEBUG:teuthology.orchestra.remote:timed out 2019-12-05T03:43:09.712 INFO:teuthology.misc:trying to connect to ubuntu@smithi096.front.sepia.ceph.com 2019-12-05T03:43:09.712 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-05T03:43:09.712 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi096.front.sepia.ceph.com', 'timeout': 60} 2019-12-05T03:43:28.184 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2019-12-05T03:43:28.185 DEBUG:teuthology.misc:waited 78.4750490189 2019-12-05T03:43:29.185 INFO:teuthology.misc:trying to connect to ubuntu@smithi158.front.sepia.ceph.com 2019-12-05T03:43:29.186 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-05T03:43:29.186 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi158.front.sepia.ceph.com', 'timeout': 60} 2019-12-05T03:43:32.248 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.158 2019-12-05T03:43:32.249 INFO:teuthology.misc:trying to connect to ubuntu@smithi096.front.sepia.ceph.com 2019-12-05T03:43:32.249 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-05T03:43:32.250 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi096.front.sepia.ceph.com', 'timeout': 60} 2019-12-05T03:43:50.716 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2019-12-05T03:43:50.717 DEBUG:teuthology.misc:waited 101.007048845 2019-12-05T03:43:51.717 INFO:teuthology.misc:trying to connect to ubuntu@smithi158.front.sepia.ceph.com 2019-12-05T03:43:51.717 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-05T03:43:51.718 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi158.front.sepia.ceph.com', 'timeout': 60} 2019-12-05T03:43:51.796 INFO:teuthology.orchestra.run.smithi158:> true 2019-12-05T03:43:52.210 DEBUG:teuthology.misc:waited 102.500211 2019-12-05T03:43:53.211 INFO:teuthology.misc:trying to connect to ubuntu@smithi096.front.sepia.ceph.com 2019-12-05T03:43:53.211 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-05T03:43:53.212 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi096.front.sepia.ceph.com', 'timeout': 60} 2019-12-05T03:43:56.284 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2019-12-05T03:43:56.285 DEBUG:teuthology.misc:waited 106.575069904 2019-12-05T03:43:57.285 INFO:teuthology.misc:trying to connect to ubuntu@smithi096.front.sepia.ceph.com 2019-12-05T03:43:57.285 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-05T03:43:57.286 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi096.front.sepia.ceph.com', 'timeout': 60} 2019-12-05T03:43:59.356 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2019-12-05T03:43:59.357 DEBUG:teuthology.misc:waited 109.647086859 2019-12-05T03:44:00.358 INFO:teuthology.misc:trying to connect to ubuntu@smithi096.front.sepia.ceph.com 2019-12-05T03:44:00.358 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-05T03:44:00.359 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi096.front.sepia.ceph.com', 'timeout': 60} 2019-12-05T03:44:02.424 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2019-12-05T03:44:02.425 DEBUG:teuthology.misc:waited 112.715061903 2019-12-05T03:44:03.426 INFO:teuthology.misc:trying to connect to ubuntu@smithi096.front.sepia.ceph.com 2019-12-05T03:44:03.426 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-05T03:44:03.426 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi096.front.sepia.ceph.com', 'timeout': 60} 2019-12-05T03:44:04.471 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2019-12-05T03:44:04.471 DEBUG:teuthology.misc:waited 114.761793852 2019-12-05T03:44:05.472 INFO:teuthology.misc:trying to connect to ubuntu@smithi096.front.sepia.ceph.com 2019-12-05T03:44:05.472 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-05T03:44:05.473 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi096.front.sepia.ceph.com', 'timeout': 60} 2019-12-05T03:44:05.684 INFO:teuthology.orchestra.run.smithi096:> true 2019-12-05T03:44:06.800 DEBUG:teuthology.misc:waited 117.090025902 2019-12-05T03:44:07.800 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2019-12-05T03:44:07.801 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.15.0-72-generic"... 2019-12-05T03:44:07.801 INFO:teuthology.orchestra.run.smithi158:> uname -r 2019-12-05T03:44:07.809 INFO:teuthology.orchestra.run.smithi158.stdout:4.15.0-72-generic 2019-12-05T03:44:07.809 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-72-generic 2019-12-05T03:44:07.809 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2019-12-05T03:44:07.809 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2019-12-05T03:44:07.809 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.15.0-72-generic"... 2019-12-05T03:44:07.810 INFO:teuthology.orchestra.run.smithi096:> uname -r 2019-12-05T03:44:07.817 INFO:teuthology.orchestra.run.smithi096.stdout:4.15.0-72-generic 2019-12-05T03:44:07.817 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-72-generic 2019-12-05T03:44:07.817 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2019-12-05T03:44:08.818 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2019-12-05T03:44:08.819 INFO:teuthology.orchestra.run.smithi158:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2019-12-05T03:44:08.864 INFO:teuthology.orchestra.run.smithi158.stdout:ttyS1 2019-12-05T03:44:08.886 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2019-12-05T03:44:08.887 INFO:teuthology.orchestra.run.smithi096:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2019-12-05T03:44:08.975 INFO:teuthology.orchestra.run.smithi096.stdout:ttyS1 2019-12-05T03:44:09.005 INFO:teuthology.run_tasks:Running task internal.base... 2019-12-05T03:44:09.013 INFO:teuthology.task.internal:Creating test directory... 2019-12-05T03:44:09.013 INFO:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2019-12-05T03:44:09.017 INFO:teuthology.orchestra.run.smithi158:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2019-12-05T03:44:09.024 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2019-12-05T03:44:09.034 INFO:teuthology.run_tasks:Running task internal.archive... 2019-12-05T03:44:09.051 INFO:teuthology.task.internal:Creating archive directory... 2019-12-05T03:44:09.051 INFO:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2019-12-05T03:44:09.074 INFO:teuthology.orchestra.run.smithi158:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2019-12-05T03:44:09.088 INFO:teuthology.run_tasks:Running task internal.coredump... 2019-12-05T03:44:09.098 INFO:teuthology.task.internal:Enabling coredump saving... 2019-12-05T03:44:09.098 INFO:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-12-05T03:44:09.165 INFO:teuthology.orchestra.run.smithi158:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-12-05T03:44:09.187 INFO:teuthology.orchestra.run.smithi158.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-12-05T03:44:09.190 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-12-05T03:44:09.191 INFO:teuthology.run_tasks:Running task internal.sudo... 2019-12-05T03:44:09.222 INFO:teuthology.task.internal:Configuring sudo... 2019-12-05T03:44:09.222 INFO:teuthology.orchestra.run.smithi096:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2019-12-05T03:44:09.241 INFO:teuthology.orchestra.run.smithi158:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2019-12-05T03:44:09.258 INFO:teuthology.run_tasks:Running task internal.syslog... 2019-12-05T03:44:09.278 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2019-12-05T03:44:09.278 INFO:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2019-12-05T03:44:09.312 INFO:teuthology.orchestra.run.smithi158:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2019-12-05T03:44:09.320 INFO:teuthology.orchestra.run.smithi158:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2019-12-05T03:44:09.392 INFO:teuthology.orchestra.run.smithi158:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2019-12-05T03:44:09.464 INFO:teuthology.orchestra.run.smithi158:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2019-12-05T03:44:09.575 INFO:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2019-12-05T03:44:09.583 INFO:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2019-12-05T03:44:09.653 INFO:teuthology.orchestra.run.smithi096:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2019-12-05T03:44:09.770 INFO:teuthology.orchestra.run.smithi096:> sudo service rsyslog restart 2019-12-05T03:44:09.837 INFO:teuthology.orchestra.run.smithi158:> sudo service rsyslog restart 2019-12-05T03:44:09.892 INFO:teuthology.run_tasks:Running task internal.timer... 2019-12-05T03:44:10.011 INFO:teuthology.task.internal:Starting timer... 2019-12-05T03:44:10.011 INFO:teuthology.run_tasks:Running task pcp... 2019-12-05T03:44:10.057 INFO:teuthology.run_tasks:Running task selinux... 2019-12-05T03:44:10.074 DEBUG:teuthology.task.selinux:Excluding smithi158: OS 'ubuntu' does not support SELinux 2019-12-05T03:44:10.074 DEBUG:teuthology.task.selinux:Excluding smithi096: OS 'ubuntu' does not support SELinux 2019-12-05T03:44:10.074 DEBUG:teuthology.task.selinux:Getting current SELinux state 2019-12-05T03:44:10.074 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2019-12-05T03:44:10.074 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2019-12-05T03:44:10.075 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2019-12-05T03:44:10.086 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2019-12-05T03:44:10.111 INFO:teuthology.repo_utils:Fetching master from origin 2019-12-05T03:44:10.272 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2019-12-05T03:44:10.307 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2019-12-05T03:44:10.310 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi158.front.sepia.ceph.com,smithi096.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2019-12-05T03:44:10.731 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2019-12-05T03:44:14.586 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2019-12-05T03:44:14.610 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:14 +0000 (0:00:00.069) 0:00:00.069 ***** 2019-12-05T03:44:14.622 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:14 +0000 (0:00:00.012) 0:00:00.082 ***** 2019-12-05T03:44:17.331 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi158.front.sepia.ceph.com] 2019-12-05T03:44:17.428 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:17 +0000 (0:00:02.802) 0:00:02.884 ***** 2019-12-05T03:44:17.560 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] 2019-12-05T03:44:17.650 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:17 +0000 (0:00:00.225) 0:00:03.110 ***** 2019-12-05T03:44:17.720 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2019-12-05T03:44:17.721 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2019-12-05T03:44:17.774 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:17 +0000 (0:00:00.123) 0:00:03.234 ***** 2019-12-05T03:44:17.790 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2019-12-05T03:44:17.834 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:17 +0000 (0:00:00.060) 0:00:03.294 ***** 2019-12-05T03:44:18.280 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** changed: [smithi096.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2019-12-05T03:44:18.332 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:18 +0000 (0:00:00.498) 0:00:03.792 ***** 2019-12-05T03:44:18.339 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2019-12-05T03:44:18.382 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:18 +0000 (0:00:00.049) 0:00:03.842 ***** 2019-12-05T03:44:18.679 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2019-12-05T03:44:18.680 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.072355", "end": "2019-12-05 03:44:18.692007", "rc": 0, "start": "2019-12-05 03:44:18.619652", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2019-12-05T03:44:18.727 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:18 +0000 (0:00:00.344) 0:00:04.186 ***** 2019-12-05T03:44:18.729 INFO:teuthology.task.ansible.out: 2019-12-05T03:44:18.735 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.101528", "end": "2019-12-05 03:44:18.796855", "rc": 0, "start": "2019-12-05 03:44:18.695327", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2019-12-05T03:44:18.785 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:18 +0000 (0:00:00.058) 0:00:04.245 ***** 2019-12-05T03:44:19.000 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2019-12-05T03:44:19.001 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-05T03:44:19.002 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-05T03:44:19.044 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:19 +0000 (0:00:00.259) 0:00:04.504 ***** 2019-12-05T03:44:19.082 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:19 +0000 (0:00:00.037) 0:00:04.541 ***** 2019-12-05T03:44:19.780 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2019-12-05T03:44:19.781 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575517459.1-209160539411393/source", "state": "file", "uid": 0} 2019-12-05T03:44:19.821 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:19 +0000 (0:00:00.739) 0:00:05.281 ***** 2019-12-05T03:44:19.828 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575517459.06-187127846252588/source", "state": "file", "uid": 0} 2019-12-05T03:44:19.870 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:19 +0000 (0:00:00.048) 0:00:05.330 ***** 2019-12-05T03:44:20.170 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2019-12-05T03:44:20.172 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-05T03:44:20.193 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-05T03:44:20.319 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-05T03:44:20.320 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-05T03:44:20.449 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-05T03:44:20.461 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-05T03:44:20.596 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-05T03:44:20.597 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-05T03:44:20.742 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-05T03:44:20.743 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-05T03:44:20.868 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-05T03:44:20.881 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-05T03:44:21.006 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-05T03:44:21.072 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-05T03:44:21.209 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2019-12-05T03:44:21.216 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2019-12-05T03:44:21.411 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:21 +0000 (0:00:01.540) 0:00:06.871 ***** 2019-12-05T03:44:21.450 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:21 +0000 (0:00:00.038) 0:00:06.909 ***** 2019-12-05T03:44:22.100 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi096.front.sepia.ceph.com] 2019-12-05T03:44:22.156 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] 2019-12-05T03:44:22.228 INFO:teuthology.task.ansible.out: [WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2019-12-05T03:44:22.232 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:22 +0000 (0:00:00.778) 0:00:07.688 ***** 2019-12-05T03:44:22.337 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:22 +0000 (0:00:00.108) 0:00:07.797 ***** 2019-12-05T03:44:22.620 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2019-12-05T03:44:22.620 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.223938", "end": "2019-12-05 03:44:22.590993", "rc": 0, "start": "2019-12-05 03:44:22.367055", "stderr": "", "stderr_lines": [], "stdout": "7b315d00bbff69e651613e1408370c0721c0c099", "stdout_lines": ["7b315d00bbff69e651613e1408370c0721c0c099"]} 2019-12-05T03:44:22.663 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:22 +0000 (0:00:00.325) 0:00:08.122 ***** 2019-12-05T03:44:22.726 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.243769", "end": "2019-12-05 03:44:22.695414", "rc": 0, "start": "2019-12-05 03:44:22.451645", "stderr": "", "stderr_lines": [], "stdout": "7b315d00bbff69e651613e1408370c0721c0c099", "stdout_lines": ["7b315d00bbff69e651613e1408370c0721c0c099"]} 2019-12-05T03:44:22.780 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:22 +0000 (0:00:00.117) 0:00:08.240 ***** 2019-12-05T03:44:22.817 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2019-12-05T03:44:22.819 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.013936", "end": "2019-12-05 03:44:22.895594", "failed_when_result": false, "rc": 0, "start": "2019-12-05 03:44:22.881658", "stderr": "", "stderr_lines": [], "stdout": "7b088106a1031364e6869fc2888a0e2542579008", "stdout_lines": ["7b088106a1031364e6869fc2888a0e2542579008"]} 2019-12-05T03:44:22.860 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:22 +0000 (0:00:00.080) 0:00:08.320 ***** 2019-12-05T03:44:22.887 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2019-12-05T03:44:22.888 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:22.930 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:22 +0000 (0:00:00.070) 0:00:08.390 ***** 2019-12-05T03:44:22.937 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2019-12-05T03:44:22.938 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.012361", "end": "2019-12-05 03:44:22.940809", "failed_when_result": false, "rc": 0, "start": "2019-12-05 03:44:22.928448", "stderr": "", "stderr_lines": [], "stdout": "7b088106a1031364e6869fc2888a0e2542579008", "stdout_lines": ["7b088106a1031364e6869fc2888a0e2542579008"]} 2019-12-05T03:44:22.998 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:22 +0000 (0:00:00.066) 0:00:08.457 ***** 2019-12-05T03:44:23.005 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2019-12-05T03:44:23.005 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:23.050 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:23 +0000 (0:00:00.052) 0:00:08.509 ***** 2019-12-05T03:44:23.055 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2019-12-05T03:44:23.056 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:23.098 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:23 +0000 (0:00:00.048) 0:00:08.557 ***** 2019-12-05T03:44:23.103 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2019-12-05T03:44:23.103 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:23.147 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:23 +0000 (0:00:00.049) 0:00:08.607 ***** 2019-12-05T03:44:23.153 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2019-12-05T03:44:23.155 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:23.198 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:23 +0000 (0:00:00.050) 0:00:08.657 ***** 2019-12-05T03:44:23.203 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2019-12-05T03:44:23.204 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:23.246 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:23 +0000 (0:00:00.048) 0:00:08.706 ***** 2019-12-05T03:44:23.252 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2019-12-05T03:44:23.253 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:23.294 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:23 +0000 (0:00:00.047) 0:00:08.754 ***** 2019-12-05T03:44:23.299 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2019-12-05T03:44:23.300 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:23.340 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:23 +0000 (0:00:00.046) 0:00:08.800 ***** 2019-12-05T03:44:23.346 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2019-12-05T03:44:23.346 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:23.387 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:23 +0000 (0:00:00.046) 0:00:08.847 ***** 2019-12-05T03:44:23.414 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2019-12-05T03:44:23.416 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:23.454 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:23 +0000 (0:00:00.066) 0:00:08.913 ***** 2019-12-05T03:44:23.469 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2019-12-05T03:44:23.470 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-05T03:44:23.512 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:23 +0000 (0:00:00.057) 0:00:08.971 ***** 2019-12-05T03:44:23.592 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-05T03:44:23.633 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:23 +0000 (0:00:00.120) 0:00:09.092 ***** 2019-12-05T03:44:23.701 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-12-05T03:44:23.701 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2019-12-05T03:44:23.807 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2019-12-05T03:44:23.829 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2019-12-05T03:44:23.945 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2019-12-05T03:44:23.957 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2019-12-05T03:44:24.094 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2019-12-05T03:44:24.106 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/adeza", "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "move_home": false, "name": "adeza", "shell": "/bin/bash", "state": "present", "uid": 1104} 2019-12-05T03:44:24.242 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2019-12-05T03:44:24.254 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/adeza", "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "move_home": false, "name": "adeza", "shell": "/bin/bash", "state": "present", "uid": 1104} 2019-12-05T03:44:24.397 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2019-12-05T03:44:24.400 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2019-12-05T03:44:24.539 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2019-12-05T03:44:24.573 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2019-12-05T03:44:24.668 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2019-12-05T03:44:24.722 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2019-12-05T03:44:24.818 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2019-12-05T03:44:24.882 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2019-12-05T03:44:24.957 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2019-12-05T03:44:25.055 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2019-12-05T03:44:25.123 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2019-12-05T03:44:25.231 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2019-12-05T03:44:25.304 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2019-12-05T03:44:25.378 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2019-12-05T03:44:25.468 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1114} 2019-12-05T03:44:25.521 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2019-12-05T03:44:25.639 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1115} 2019-12-05T03:44:25.697 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1114} 2019-12-05T03:44:25.773 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1116} 2019-12-05T03:44:25.854 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1115} 2019-12-05T03:44:25.904 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1117} 2019-12-05T03:44:26.008 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1116} 2019-12-05T03:44:26.064 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1118} 2019-12-05T03:44:26.140 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1117} 2019-12-05T03:44:26.235 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1119} 2019-12-05T03:44:26.299 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1118} 2019-12-05T03:44:26.384 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1120} 2019-12-05T03:44:26.458 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1119} 2019-12-05T03:44:26.524 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1121} 2019-12-05T03:44:26.599 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1120} 2019-12-05T03:44:26.673 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1122} 2019-12-05T03:44:26.752 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1121} 2019-12-05T03:44:26.818 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1123} 2019-12-05T03:44:26.893 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1122} 2019-12-05T03:44:26.956 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1124} 2019-12-05T03:44:27.041 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1123} 2019-12-05T03:44:27.086 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1125} 2019-12-05T03:44:27.192 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1124} 2019-12-05T03:44:27.235 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1126} 2019-12-05T03:44:27.324 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1125} 2019-12-05T03:44:27.392 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1127} 2019-12-05T03:44:27.463 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1126} 2019-12-05T03:44:27.517 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1128} 2019-12-05T03:44:27.595 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1127} 2019-12-05T03:44:27.677 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1129} 2019-12-05T03:44:27.730 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1128} 2019-12-05T03:44:27.814 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1130} 2019-12-05T03:44:27.877 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1129} 2019-12-05T03:44:27.952 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1131} 2019-12-05T03:44:28.036 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1130} 2019-12-05T03:44:28.100 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1132} 2019-12-05T03:44:28.163 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1131} 2019-12-05T03:44:28.228 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1133} 2019-12-05T03:44:28.316 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1132} 2019-12-05T03:44:28.370 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1134} 2019-12-05T03:44:28.466 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1133} 2019-12-05T03:44:28.519 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1136} 2019-12-05T03:44:28.611 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1134} 2019-12-05T03:44:28.664 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1137} 2019-12-05T03:44:28.768 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1136} 2019-12-05T03:44:28.790 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1138} 2019-12-05T03:44:28.895 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1137} 2019-12-05T03:44:28.938 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1139} 2019-12-05T03:44:29.053 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1138} 2019-12-05T03:44:29.075 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-12-05T03:44:29.195 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1139} 2019-12-05T03:44:29.216 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1141} 2019-12-05T03:44:29.332 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-12-05T03:44:29.344 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-12-05T03:44:29.480 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1141} 2019-12-05T03:44:29.502 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1143} 2019-12-05T03:44:29.630 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-12-05T03:44:29.642 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1144} 2019-12-05T03:44:29.764 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1143} 2019-12-05T03:44:29.787 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1146} 2019-12-05T03:44:29.912 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1144} 2019-12-05T03:44:29.928 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1147} 2019-12-05T03:44:30.045 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1146} 2019-12-05T03:44:30.072 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1148} 2019-12-05T03:44:30.187 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1147} 2019-12-05T03:44:30.203 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1150} 2019-12-05T03:44:30.348 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1148} 2019-12-05T03:44:30.349 INFO:teuthology.task.ansible.out: 2019-12-05T03:44:30.356 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1153} 2019-12-05T03:44:30.358 INFO:teuthology.task.ansible.out: 2019-12-05T03:44:30.485 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-12-05T03:44:30.496 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1150} 2019-12-05T03:44:30.633 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1156} 2019-12-05T03:44:30.645 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1153} 2019-12-05T03:44:30.781 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1157} 2019-12-05T03:44:30.794 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-12-05T03:44:30.933 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1158} 2019-12-05T03:44:30.945 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1156} 2019-12-05T03:44:30.946 INFO:teuthology.task.ansible.out: 2019-12-05T03:44:31.059 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1159} 2019-12-05T03:44:31.060 INFO:teuthology.task.ansible.out: 2019-12-05T03:44:31.072 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1157} 2019-12-05T03:44:31.074 INFO:teuthology.task.ansible.out: 2019-12-05T03:44:31.211 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1161} 2019-12-05T03:44:31.213 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1158} 2019-12-05T03:44:31.350 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1162} 2019-12-05T03:44:31.362 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1159} 2019-12-05T03:44:31.487 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1163} 2019-12-05T03:44:31.510 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1161} 2019-12-05T03:44:31.636 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1164} 2019-12-05T03:44:31.652 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1162} 2019-12-05T03:44:31.784 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1165} 2019-12-05T03:44:31.795 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1163} 2019-12-05T03:44:31.945 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1167} 2019-12-05T03:44:31.946 INFO:teuthology.task.ansible.out: 2019-12-05T03:44:31.947 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1164} 2019-12-05T03:44:32.072 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1168} 2019-12-05T03:44:32.074 INFO:teuthology.task.ansible.out: 2019-12-05T03:44:32.106 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1165} 2019-12-05T03:44:32.107 INFO:teuthology.task.ansible.out: 2019-12-05T03:44:32.232 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1169} 2019-12-05T03:44:32.243 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1167} 2019-12-05T03:44:32.379 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1170} 2019-12-05T03:44:32.391 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1168} 2019-12-05T03:44:32.518 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1171} 2019-12-05T03:44:32.540 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1169} 2019-12-05T03:44:32.655 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1172} 2019-12-05T03:44:32.688 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1170} 2019-12-05T03:44:32.776 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1174} 2019-12-05T03:44:32.820 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1171} 2019-12-05T03:44:32.914 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-12-05T03:44:32.969 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1172} 2019-12-05T03:44:33.044 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1177} 2019-12-05T03:44:33.108 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1174} 2019-12-05T03:44:33.193 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1178} 2019-12-05T03:44:33.258 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-12-05T03:44:33.354 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1179} 2019-12-05T03:44:33.409 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1177} 2019-12-05T03:44:33.475 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1180} 2019-12-05T03:44:33.542 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1178} 2019-12-05T03:44:33.629 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1181} 2019-12-05T03:44:33.690 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1179} 2019-12-05T03:44:33.766 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1182} 2019-12-05T03:44:33.840 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1180} 2019-12-05T03:44:33.895 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1184} 2019-12-05T03:44:34.000 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1181} 2019-12-05T03:44:34.012 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1185} 2019-12-05T03:44:34.156 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1182} 2019-12-05T03:44:34.168 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1186} 2019-12-05T03:44:34.314 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1184} 2019-12-05T03:44:34.325 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1187} 2019-12-05T03:44:34.462 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1185} 2019-12-05T03:44:34.474 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1188} 2019-12-05T03:44:34.622 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1189} ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1186} 2019-12-05T03:44:34.770 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1190} 2019-12-05T03:44:34.773 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1187} 2019-12-05T03:44:34.913 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1191} 2019-12-05T03:44:34.924 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1188} 2019-12-05T03:44:35.060 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1192} 2019-12-05T03:44:35.072 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1189} 2019-12-05T03:44:35.211 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1190} 2019-12-05T03:44:35.223 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1193} 2019-12-05T03:44:35.362 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1191} 2019-12-05T03:44:35.364 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1194} 2019-12-05T03:44:35.501 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1195} 2019-12-05T03:44:35.502 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1192} 2019-12-05T03:44:35.649 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1196} 2019-12-05T03:44:35.661 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1193} 2019-12-05T03:44:35.798 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1197} 2019-12-05T03:44:35.809 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1194} 2019-12-05T03:44:35.937 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1198} 2019-12-05T03:44:35.970 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1195} 2019-12-05T03:44:36.085 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1199} 2019-12-05T03:44:36.106 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1196} 2019-12-05T03:44:36.223 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1200} 2019-12-05T03:44:36.246 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1197} 2019-12-05T03:44:36.383 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1201} 2019-12-05T03:44:36.416 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1198} 2019-12-05T03:44:36.543 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1202} 2019-12-05T03:44:36.571 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1199} 2019-12-05T03:44:36.680 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1203} 2019-12-05T03:44:36.735 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1200} 2019-12-05T03:44:36.832 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1204} 2019-12-05T03:44:36.875 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1201} 2019-12-05T03:44:36.981 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1205} 2019-12-05T03:44:37.014 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1202} 2019-12-05T03:44:37.138 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1206} ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1203} 2019-12-05T03:44:37.279 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1207} 2019-12-05T03:44:37.281 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1204} 2019-12-05T03:44:37.410 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1208} 2019-12-05T03:44:37.452 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1205} 2019-12-05T03:44:37.547 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1209} 2019-12-05T03:44:37.600 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1206} 2019-12-05T03:44:37.674 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1210} 2019-12-05T03:44:37.739 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1207} 2019-12-05T03:44:37.825 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1211} 2019-12-05T03:44:37.890 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1208} 2019-12-05T03:44:37.894 INFO:teuthology.task.ansible.out: 2019-12-05T03:44:37.962 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1212} 2019-12-05T03:44:38.044 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1209} 2019-12-05T03:44:38.122 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1213} 2019-12-05T03:44:38.208 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1210} 2019-12-05T03:44:38.274 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1214} 2019-12-05T03:44:38.359 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1211} 2019-12-05T03:44:38.434 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-12-05T03:44:38.541 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1212} 2019-12-05T03:44:38.595 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1215} 2019-12-05T03:44:38.689 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1213} 2019-12-05T03:44:38.815 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1214} 2019-12-05T03:44:38.983 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-12-05T03:44:39.141 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1215} 2019-12-05T03:44:39.370 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "name": "rraja", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2019-12-05T03:44:39.498 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:39 +0000 (0:00:15.865) 0:00:24.958 ***** 2019-12-05T03:44:39.526 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2019-12-05T03:44:39.568 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:39 +0000 (0:00:00.069) 0:00:25.027 ***** 2019-12-05T03:44:39.644 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2019-12-05T03:44:39.648 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "tr 2019-12-05T03:44:39.650 INFO:teuthology.task.ansible.out:ociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7 2019-12-05T03:44:39.651 INFO:teuthology.task.ansible.out:L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32 2019-12-05T03:44:39.653 INFO:teuthology.task.ansible.out:f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b 2019-12-05T03:44:39.654 INFO:teuthology.task.ansible.out:09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e 2019-12-05T03:44:39.655 INFO:teuthology.task.ansible.out:66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa 2019-12-05T03:44:39.657 INFO:teuthology.task.ansible.out:8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 2019-12-05T03:44:39.660 INFO:teuthology.task.ansible.out:6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f8 2019-12-05T03:44:39.661 INFO:teuthology.task.ansible.out:48846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8a 2019-12-05T03:44:39.663 INFO:teuthology.task.ansible.out:a01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalho 2019-12-05T03:44:39.664 INFO:teuthology.task.ansible.out:jr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}]}, "changed": false} 2019-12-05T03:44:39.713 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:39 +0000 (0:00:00.145) 0:00:25.172 ***** 2019-12-05T03:44:39.724 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ changed: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "name": "rraja", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2019-12-05T03:44:39.838 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:39 +0000 (0:00:00.125) 0:00:25.298 ***** 2019-12-05T03:44:39.869 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2019-12-05T03:44:39.909 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:39 +0000 (0:00:00.070) 0:00:25.369 ***** 2019-12-05T03:44:39.962 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2019-12-05T03:44:39.967 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "tr 2019-12-05T03:44:39.968 INFO:teuthology.task.ansible.out:ociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7 2019-12-05T03:44:39.970 INFO:teuthology.task.ansible.out:L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32 2019-12-05T03:44:39.971 INFO:teuthology.task.ansible.out:f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b 2019-12-05T03:44:39.973 INFO:teuthology.task.ansible.out:09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e 2019-12-05T03:44:39.974 INFO:teuthology.task.ansible.out:66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa 2019-12-05T03:44:39.975 INFO:teuthology.task.ansible.out:8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 2019-12-05T03:44:39.977 INFO:teuthology.task.ansible.out:6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f8 2019-12-05T03:44:39.978 INFO:teuthology.task.ansible.out:48846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8a 2019-12-05T03:44:39.980 INFO:teuthology.task.ansible.out:a01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalho 2019-12-05T03:44:39.981 INFO:teuthology.task.ansible.out:jr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}]}, "changed": false} 2019-12-05T03:44:40.022 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:40 +0000 (0:00:00.113) 0:00:25.482 ***** 2019-12-05T03:44:40.024 INFO:teuthology.task.ansible.out: 2019-12-05T03:44:40.700 INFO:teuthology.task.ansible.out:FAILED - RETRYING: Clone the keys repo (5 retries left). 2019-12-05T03:44:40.722 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2019-12-05T03:44:40.724 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com -> localhost] => {"after": "7b315d00bbff69e651613e1408370c0721c0c099", "attempts": 1, "before": "7b315d00bbff69e651613e1408370c0721c0c099", "changed": false, "remote_url_changed": false} 2019-12-05T03:44:40.766 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:40 +0000 (0:00:00.743) 0:00:26.226 ***** 2019-12-05T03:44:40.986 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:44:40.987 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2019-12-05T03:44:41.113 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2019-12-05T03:44:41.267 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2019-12-05T03:44:41.417 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCWy2i6Iv6IWLh53Z44O4fQ0ctxR8odCAWIZAaSQXAxxC++RS+95Zr+BZ5wJwsBOyP1G4AAhl+9uwnn3NmDDG7fKGexPoQrTZZ27KdJ3bHpZRq5LJf9byWFwz4rDsqIqkGjI9sUkfa6nV7ci2BdEkIgLupTT2uXUzTb/njOjI7Fc+cQ7ac4QfJ+yeIcqxeje/YYDF3068V4z1yynk9q2KRXYdERKQghaWDNJlbdBhn/fmsam6okOtUnsXjE88qGPd+LVHWfK0EfYvYXiAoOaJDK8d4EXnJ4RKJceQPBk8ravuQtKVwnRIr8WtmILHuoztthfwqb2WvZ5iMDt6v7oQZ alfredo@papaya.local", "key_options": null, "keyfile": "/home/adeza/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adeza", "validate_certs": true} 2019-12-05T03:44:41.555 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2019-12-05T03:44:41.556 INFO:teuthology.task.ansible.out:lidate_certs": true} 2019-12-05T03:44:41.694 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2019-12-05T03:44:41.822 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2019-12-05T03:44:41.823 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2019-12-05T03:44:41.956 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2019-12-05T03:44:42.093 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2019-12-05T03:44:42.105 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:42.257 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2019-12-05T03:44:42.258 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2019-12-05T03:44:42.268 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:42.280 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:42.290 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:42.437 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2019-12-05T03:44:42.573 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2019-12-05T03:44:42.574 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2019-12-05T03:44:42.729 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2019-12-05T03:44:42.856 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2019-12-05T03:44:43.000 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2019-12-05T03:44:43.125 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2019-12-05T03:44:43.292 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2019-12-05T03:44:43.459 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2019-12-05T03:44:43.595 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2019-12-05T03:44:43.596 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2019-12-05T03:44:43.741 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2019-12-05T03:44:43.743 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2019-12-05T03:44:43.879 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2019-12-05T03:44:44.038 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2019-12-05T03:44:44.189 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2019-12-05T03:44:44.190 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2019-12-05T03:44:44.325 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2019-12-05T03:44:44.475 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2019-12-05T03:44:44.613 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2019-12-05T03:44:44.739 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2019-12-05T03:44:44.893 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2019-12-05T03:44:45.048 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2019-12-05T03:44:45.049 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2019-12-05T03:44:45.190 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2019-12-05T03:44:45.359 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2019-12-05T03:44:45.495 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2019-12-05T03:44:45.620 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2019-12-05T03:44:45.772 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2019-12-05T03:44:45.914 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2019-12-05T03:44:46.071 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-12-05T03:44:46.208 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2019-12-05T03:44:46.363 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2019-12-05T03:44:46.489 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2019-12-05T03:44:46.491 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2019-12-05T03:44:46.635 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2019-12-05T03:44:46.637 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2019-12-05T03:44:46.793 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2019-12-05T03:44:46.942 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2019-12-05T03:44:47.140 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2019-12-05T03:44:47.267 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2019-12-05T03:44:47.269 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-12-05T03:44:47.404 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2019-12-05T03:44:47.406 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2019-12-05T03:44:47.407 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2019-12-05T03:44:47.531 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2019-12-05T03:44:47.678 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2019-12-05T03:44:47.872 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2019-12-05T03:44:48.036 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2019-12-05T03:44:48.180 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2019-12-05T03:44:48.337 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2019-12-05T03:44:48.487 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2019-12-05T03:44:48.646 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2019-12-05T03:44:48.802 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2019-12-05T03:44:48.804 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2019-12-05T03:44:48.942 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2019-12-05T03:44:49.085 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2019-12-05T03:44:49.203 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2019-12-05T03:44:49.204 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2019-12-05T03:44:49.344 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2019-12-05T03:44:49.507 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2019-12-05T03:44:49.627 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2019-12-05T03:44:49.786 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-12-05T03:44:49.943 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2019-12-05T03:44:50.096 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2019-12-05T03:44:50.239 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2019-12-05T03:44:50.389 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2019-12-05T03:44:50.546 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2019-12-05T03:44:50.822 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2019-12-05T03:44:50.977 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2019-12-05T03:44:51.104 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2019-12-05T03:44:51.260 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2019-12-05T03:44:51.399 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2019-12-05T03:44:51.442 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2019-12-05T03:44:51.443 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com -> localhost] => {"after": "7b315d00bbff69e651613e1408370c0721c0c099", "attempts": 2, "before": "7b315d00bbff69e651613e1408370c0721c0c099", "changed": false, "remote_url_changed": false} 2019-12-05T03:44:51.483 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:51 +0000 (0:00:10.716) 0:00:36.942 ***** 2019-12-05T03:44:51.560 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:44:51.562 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2019-12-05T03:44:51.680 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2019-12-05T03:44:51.773 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2019-12-05T03:44:51.848 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2019-12-05T03:44:51.906 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2019-12-05T03:44:52.021 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2019-12-05T03:44:52.064 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2019-12-05T03:44:52.138 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2019-12-05T03:44:52.200 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCWy2i6Iv6IWLh53Z44O4fQ0ctxR8odCAWIZAaSQXAxxC++RS+95Zr+BZ5wJwsBOyP1G4AAhl+9uwnn3NmDDG7fKGexPoQrTZZ27KdJ3bHpZRq5LJf9byWFwz4rDsqIqkGjI9sUkfa6nV7ci2BdEkIgLupTT2uXUzTb/njOjI7Fc+cQ7ac4QfJ+yeIcqxeje/YYDF3068V4z1yynk9q2KRXYdERKQghaWDNJlbdBhn/fmsam6okOtUnsXjE88qGPd+LVHWfK0EfYvYXiAoOaJDK8d4EXnJ4RKJceQPBk8ravuQtKVwnRIr8WtmILHuoztthfwqb2WvZ5iMDt6v7oQZ alfredo@papaya.local", "key_options": null, "keyfile": "/home/adeza/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adeza", "validate_certs": true} 2019-12-05T03:44:52.298 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2019-12-05T03:44:52.363 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2019-12-05T03:44:52.365 INFO:teuthology.task.ansible.out:lidate_certs": true} 2019-12-05T03:44:52.459 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2019-12-05T03:44:52.527 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2019-12-05T03:44:52.637 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2019-12-05T03:44:52.691 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2019-12-05T03:44:52.692 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2019-12-05T03:44:52.798 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2019-12-05T03:44:52.818 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2019-12-05T03:44:52.982 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2019-12-05T03:44:52.984 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2019-12-05T03:44:52.996 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:53.119 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2019-12-05T03:44:53.142 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2019-12-05T03:44:53.144 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2019-12-05T03:44:53.177 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:53.178 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:53.189 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:53.276 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2019-12-05T03:44:53.278 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2019-12-05T03:44:53.350 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2019-12-05T03:44:53.424 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2019-12-05T03:44:53.426 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2019-12-05T03:44:53.477 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2019-12-05T03:44:53.479 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2019-12-05T03:44:53.562 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz1UnJy64hXJKl1OsqRPlZ84m/fyHE8/Hqimy5s8sWcvRs2tL5oK30zFataqv1BC7r46+9t1eGUIRAuBg6QPuJnJCnPzS8yTVJ6DqSDGE2NAnpcMK5fSb+qgQ2adHFkjzZ4eKZbnDJMjYBtpUEp1Ve2ncdq5YCy6hGLIstkGq331ULBc/Lm3ZHBwy5I51S8eldkuP975otBYSPZaaN25QDncZzrW36zb3VwoGUAANEfHC1kLgTTFjx0bdsAGYCduXzyyXls8qSv9gbzcRzZZoH5B7tj8VDBoHszPnqGjGqwtWaelifYE/Svp+8fJKLlzRUM+XGNZoNcRl1/1XVhYV/ deepika@deepika", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2019-12-05T03:44:53.638 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2019-12-05T03:44:53.683 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2019-12-05T03:44:53.790 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2019-12-05T03:44:53.843 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2019-12-05T03:44:53.955 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2019-12-05T03:44:53.978 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2019-12-05T03:44:54.087 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2019-12-05T03:44:54.133 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2019-12-05T03:44:54.134 INFO:teuthology.task.ansible.out: 2019-12-05T03:44:54.219 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2019-12-05T03:44:54.278 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2019-12-05T03:44:54.392 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2019-12-05T03:44:54.479 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2019-12-05T03:44:54.529 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2019-12-05T03:44:54.530 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2019-12-05T03:44:54.604 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2019-12-05T03:44:54.669 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2019-12-05T03:44:54.671 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2019-12-05T03:44:54.754 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2019-12-05T03:44:54.807 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2019-12-05T03:44:54.902 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2019-12-05T03:44:54.976 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2019-12-05T03:44:55.061 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2019-12-05T03:44:55.127 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2019-12-05T03:44:55.129 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2019-12-05T03:44:55.232 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2019-12-05T03:44:55.265 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2019-12-05T03:44:55.362 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2019-12-05T03:44:55.416 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2019-12-05T03:44:55.505 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2019-12-05T03:44:55.581 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2019-12-05T03:44:55.684 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2019-12-05T03:44:55.686 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-12-05T03:44:55.752 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2019-12-05T03:44:55.830 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2019-12-05T03:44:55.912 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2019-12-05T03:44:56.001 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2019-12-05T03:44:56.084 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2019-12-05T03:44:56.085 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2019-12-05T03:44:56.128 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:56 +0000 (0:00:04.643) 0:00:41.586 ***** 2019-12-05T03:44:56.172 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-05T03:44:56.173 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:56.186 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:56.209 INFO:teuthology.task.ansible.out: 2019-12-05T03:44:56.216 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:44:56.217 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf0 2019-12-05T03:44:56.219 INFO:teuthology.task.ansible.out:7f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:56.242 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:56.254 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:56.265 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:56.277 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:56.362 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:44:56.363 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2019-12-05T03:44:56.405 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-05T03:44:56.406 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2019-12-05T03:44:56.427 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:56.512 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:44:56.513 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2019-12-05T03:44:56.545 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-05T03:44:56.546 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2019-12-05T03:44:56.673 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:44:56.674 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2019-12-05T03:44:56.676 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-05T03:44:56.677 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2019-12-05T03:44:56.827 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:44:56.828 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0Ke 2019-12-05T03:44:56.830 INFO:teuthology.task.ansible.out:fP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2019-12-05T03:44:56.840 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:56.852 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:56.863 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:56.885 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:56.897 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:56.916 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:56.921 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:56.932 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:56.945 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:56.957 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:56.958 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-05T03:44:56.960 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:56.977 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:56.978 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.119 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:44:57.120 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-12-05T03:44:57.124 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.138 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.144 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.156 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.158 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.170 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.183 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.184 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.195 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.206 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.217 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.228 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.240 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.241 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.265 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.266 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.279 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.290 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:44:57.292 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.303 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.318 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.329 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.340 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.351 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.363 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.376 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.388 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.399 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.400 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.411 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.423 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.424 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2019-12-05T03:44:57.451 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.459 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.492 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.493 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.494 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.505 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.506 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.519 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.531 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.548 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.559 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.560 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.572 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.574 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.585 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:44:57.588 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2019-12-05T03:44:57.591 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2019-12-05T03:44:57.608 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-05T03:44:57.610 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.621 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.633 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.634 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.658 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.669 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.669 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.681 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.696 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.716 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.729 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.730 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.731 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.752 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.753 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.764 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:44:57.766 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2019-12-05T03:44:57.767 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.777 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.790 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.801 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.812 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.814 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.825 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.836 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.847 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.859 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.870 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.884 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:57.925 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:44:57.927 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2019-12-05T03:44:57.966 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:57 +0000 (0:00:01.839) 0:00:43.426 ***** 2019-12-05T03:44:57.994 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2019-12-05T03:44:57.996 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:44:58.042 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:44:58 +0000 (0:00:00.076) 0:00:43.502 ***** 2019-12-05T03:44:58.064 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:44:58.064 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2019-12-05T03:44:58.206 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2019-12-05T03:44:58.227 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:44:58.230 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2019-12-05T03:44:58.360 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:44:58.362 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2019-12-05T03:44:58.363 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-12-05T03:44:58.372 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:44:58.373 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2019-12-05T03:44:58.514 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:44:58.516 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2019-12-05T03:44:58.518 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2019-12-05T03:44:58.519 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi158.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2019-12-05T03:44:58.675 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2019-12-05T03:44:58.678 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:44:58.678 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2019-12-05T03:44:58.811 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2019-12-05T03:44:58.840 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi158.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2019-12-05T03:44:59.000 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:44:59.003 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2019-12-05T03:44:59.033 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:44:59.035 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2019-12-05T03:44:59.162 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2019-12-05T03:44:59.196 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:44:59.198 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2019-12-05T03:44:59.311 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi158.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2019-12-05T03:44:59.340 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2019-12-05T03:44:59.470 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:44:59.471 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2019-12-05T03:44:59.481 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:44:59.483 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2019-12-05T03:44:59.614 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:44:59.616 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2019-12-05T03:44:59.652 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:44:59.654 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2019-12-05T03:44:59.762 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:44:59.764 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2019-12-05T03:44:59.815 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:44:59.817 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2019-12-05T03:44:59.910 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:44:59.912 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2019-12-05T03:44:59.949 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:44:59.950 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2019-12-05T03:44:59.951 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2019-12-05T03:45:00.066 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:00.068 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2019-12-05T03:45:00.099 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:45:00.101 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2019-12-05T03:45:00.201 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:00.203 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2019-12-05T03:45:00.237 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:45:00.238 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2019-12-05T03:45:00.322 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:00.326 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2019-12-05T03:45:00.389 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:45:00.390 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2019-12-05T03:45:00.391 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2019-12-05T03:45:00.459 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi158.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2019-12-05T03:45:00.620 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2019-12-05T03:45:00.683 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:45:00.685 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2019-12-05T03:45:00.814 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi158.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2019-12-05T03:45:00.828 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:45:00.829 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2019-12-05T03:45:00.972 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi158.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2019-12-05T03:45:00.981 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:45:00.983 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2019-12-05T03:45:01.110 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:01.112 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2019-12-05T03:45:01.143 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:45:01.145 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-12-05T03:45:01.260 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:01.262 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2019-12-05T03:45:01.294 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:45:01.295 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2019-12-05T03:45:01.458 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2019-12-05T03:45:01.593 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2019-12-05T03:45:01.690 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:01.691 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jj", "name": "jj", "remove": false, "state": "absent"} 2019-12-05T03:45:01.724 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:45:01.726 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2019-12-05T03:45:01.907 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2019-12-05T03:45:02.040 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2019-12-05T03:45:02.103 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:02.104 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "amarangone", "name": "amarangone", "remove": false, "state": "absent"} 2019-12-05T03:45:02.186 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:45:02.188 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2019-12-05T03:45:02.346 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2019-12-05T03:45:02.492 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2019-12-05T03:45:02.493 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:02.494 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "oprypin", "name": "oprypin", "remove": false, "state": "absent"} 2019-12-05T03:45:02.663 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:45:02.665 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2019-12-05T03:45:02.815 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2019-12-05T03:45:02.903 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:02.905 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "adamyanova", "name": "adamyanova", "remove": false, "state": "absent"} 2019-12-05T03:45:02.956 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:45:02.957 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2019-12-05T03:45:03.109 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2019-12-05T03:45:03.270 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2019-12-05T03:45:03.344 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:03.346 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "sbillah", "name": "sbillah", "remove": false, "state": "absent"} 2019-12-05T03:45:03.411 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2019-12-05T03:45:03.561 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2019-12-05T03:45:03.705 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2019-12-05T03:45:03.742 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:03.743 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "onyb", "name": "onyb", "remove": false, "state": "absent"} 2019-12-05T03:45:03.849 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:45:03.851 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2019-12-05T03:45:03.999 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2019-12-05T03:45:04.113 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:04.115 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jwilliamson", "name": "jwilliamson", "remove": false, "state": "absent"} 2019-12-05T03:45:04.148 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:45:04.149 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2019-12-05T03:45:04.321 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2019-12-05T03:45:04.486 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2019-12-05T03:45:04.487 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2019-12-05T03:45:04.548 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:04.550 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "kmroz", "name": "kmroz", "remove": false, "state": "absent"} 2019-12-05T03:45:04.634 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:45:04.634 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2019-12-05T03:45:04.636 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2019-12-05T03:45:04.783 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz1UnJy64hXJKl1OsqRPlZ84m/fyHE8/Hqimy5s8sWcvRs2tL5oK30zFataqv1BC7r46+9t1eGUIRAuBg6QPuJnJCnPzS8yTVJ6DqSDGE2NAnpcMK5fSb+qgQ2adHFkjzZ4eKZbnDJMjYBtpUEp1Ve2ncdq5YCy6hGLIstkGq331ULBc/Lm3ZHBwy5I51S8eldkuP975otBYSPZaaN25QDncZzrW36zb3VwoGUAANEfHC1kLgTTFjx0bdsAGYCduXzyyXls8qSv9gbzcRzZZoH5B7tj8VDBoHszPnqGjGqwtWaelifYE/Svp+8fJKLlzRUM+XGNZoNcRl1/1XVhYV/ deepika@deepika", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2019-12-05T03:45:04.951 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2019-12-05T03:45:05.039 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** changed: [smithi158.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "shehbazj", "name": "shehbazj", "remove": false, "state": "absent"} 2019-12-05T03:45:05.100 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:45:05.102 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2019-12-05T03:45:05.303 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2019-12-05T03:45:05.463 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2019-12-05T03:45:05.496 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:05.498 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "remove": false, "state": "absent"} 2019-12-05T03:45:05.608 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:45:05.612 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2019-12-05T03:45:05.777 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2019-12-05T03:45:05.928 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2019-12-05T03:45:05.950 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:05.952 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "asheplyakov", "name": "asheplyakov", "remove": false, "state": "absent"} 2019-12-05T03:45:06.077 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:45:06.079 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2019-12-05T03:45:06.228 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2019-12-05T03:45:06.379 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2019-12-05T03:45:06.412 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:06.414 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "liupan", "name": "liupan", "remove": false, "state": "absent"} 2019-12-05T03:45:06.540 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:45:06.541 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2019-12-05T03:45:06.562 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:06.563 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2019-12-05T03:45:06.681 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2019-12-05T03:45:06.683 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:45:06.684 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2019-12-05T03:45:06.830 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi158.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2019-12-05T03:45:06.849 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:45:06.850 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2019-12-05T03:45:06.950 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:06.952 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2019-12-05T03:45:07.003 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:45:07.005 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2019-12-05T03:45:07.006 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-12-05T03:45:07.077 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:07.078 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2019-12-05T03:45:07.151 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-05T03:45:07.153 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2019-12-05T03:45:07.205 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:07.206 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2019-12-05T03:45:07.294 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** changed: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2019-12-05T03:45:07.370 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:07.372 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2019-12-05T03:45:07.410 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:07 +0000 (0:00:09.368) 0:00:52.870 ***** 2019-12-05T03:45:07.569 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-05T03:45:07.571 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:07.581 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:07.593 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:07.593 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:07.605 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:07.616 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:07.616 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:07.627 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:07.639 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:07.729 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:07.730 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "fche", "name": "fche", "remove": false, "state": "absent"} 2019-12-05T03:45:07.820 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:07 +0000 (0:00:00.409) 0:00:53.280 ***** 2019-12-05T03:45:07.827 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-05T03:45:07.828 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2019-12-05T03:45:07.830 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:07.963 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2019-12-05T03:45:08.093 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2019-12-05T03:45:08.248 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2019-12-05T03:45:08.249 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "checksum": "4d6d0da35c32595244f0557c86cc20a1ae54bb67", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "283e36f6f6840b00622b73078c099c15", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575517507.85-5863596738790/source", "state": "file", "uid": 0} 2019-12-05T03:45:08.290 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:08 +0000 (0:00:00.469) 0:00:53.749 ***** 2019-12-05T03:45:08.295 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-05T03:45:08.299 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2019-12-05T03:45:08.300 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.311 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.312 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.323 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2019-12-05T03:45:08.327 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => { "msg": "Host smithi158.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.366 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:08 +0000 (0:00:00.075) 0:00:53.825 ***** 2019-12-05T03:45:08.372 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.373 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.374 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.375 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.387 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.398 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.399 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.410 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2019-12-05T03:45:08.411 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.474 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:08 +0000 (0:00:00.106) 0:00:53.932 ***** 2019-12-05T03:45:08.478 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.480 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.482 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.483 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.485 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.486 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.499 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2019-12-05T03:45:08.501 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.551 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:08 +0000 (0:00:00.079) 0:00:54.011 ***** 2019-12-05T03:45:08.557 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.558 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.560 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.561 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.572 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.574 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.575 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.598 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2019-12-05T03:45:08.600 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.655 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:08 +0000 (0:00:00.103) 0:00:54.115 ***** 2019-12-05T03:45:08.664 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.665 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.667 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.669 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.672 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.674 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.675 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.677 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2019-12-05T03:45:08.678 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.723 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:08 +0000 (0:00:00.067) 0:00:54.182 ***** 2019-12-05T03:45:08.734 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.736 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.737 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.751 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.753 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.796 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:08 +0000 (0:00:00.073) 0:00:54.256 ***** 2019-12-05T03:45:08.803 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.804 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.805 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.817 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.818 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.829 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.840 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.841 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.842 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.912 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:08 +0000 (0:00:00.115) 0:00:54.372 ***** 2019-12-05T03:45:08.920 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.921 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.922 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.924 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.925 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.927 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.939 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.941 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.942 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.943 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2019-12-05T03:45:08.944 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.946 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:08.992 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:08 +0000 (0:00:00.080) 0:00:54.452 ***** 2019-12-05T03:45:08.999 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:09.000 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:09.001 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:09.002 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:09.004 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:09.015 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:09.026 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2019-12-05T03:45:09.028 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:09.087 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:09 +0000 (0:00:00.094) 0:00:54.547 ***** 2019-12-05T03:45:09.094 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:09.094 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:09.096 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:09.097 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:09.109 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2019-12-05T03:45:09.110 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:09.174 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:09 +0000 (0:00:00.087) 0:00:54.634 ***** 2019-12-05T03:45:09.181 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-05T03:45:09.181 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:09.183 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:09.184 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:09.185 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:09.187 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:09.188 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:09.361 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:09 +0000 (0:00:00.186) 0:00:54.820 ***** 2019-12-05T03:45:09.366 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2019-12-05T03:45:09.367 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-05T03:45:09.368 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-05T03:45:09.417 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:09 +0000 (0:00:00.050) 0:00:54.871 ***** 2019-12-05T03:45:09.419 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:09.463 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:09 +0000 (0:00:00.051) 0:00:54.923 ***** 2019-12-05T03:45:09.469 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2019-12-05T03:45:09.471 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:09.513 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:09 +0000 (0:00:00.049) 0:00:54.973 ***** 2019-12-05T03:45:09.556 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:09.600 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:09 +0000 (0:00:00.087) 0:00:55.060 ***** 2019-12-05T03:45:09.631 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2019-12-05T03:45:09.633 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-05T03:45:09.689 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:09 +0000 (0:00:00.080) 0:00:55.141 ***** 2019-12-05T03:45:09.690 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi096.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2019-12-05T03:45:09.712 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2019-12-05T03:45:09.714 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:09.754 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:09 +0000 (0:00:00.072) 0:00:55.214 ***** 2019-12-05T03:45:09.783 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2019-12-05T03:45:09.785 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-05T03:45:09.786 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi096.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2019-12-05T03:45:09.834 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:09 +0000 (0:00:00.076) 0:00:55.290 ***** 2019-12-05T03:45:09.879 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2019-12-05T03:45:09.881 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:09.925 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:09 +0000 (0:00:00.090) 0:00:55.381 ***** 2019-12-05T03:45:09.931 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi096.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2019-12-05T03:45:09.951 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:09.994 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:09 +0000 (0:00:00.073) 0:00:55.454 ***** 2019-12-05T03:45:10.023 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2019-12-05T03:45:10.025 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:10.067 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:10 +0000 (0:00:00.072) 0:00:55.527 ***** 2019-12-05T03:45:10.073 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:10.074 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2019-12-05T03:45:10.097 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2019-12-05T03:45:10.098 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:10.139 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:10 +0000 (0:00:00.071) 0:00:55.598 ***** 2019-12-05T03:45:10.165 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi158.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-05T03:45:10.206 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:10 +0000 (0:00:00.067) 0:00:55.666 ***** 2019-12-05T03:45:10.222 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:10.224 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2019-12-05T03:45:10.236 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2019-12-05T03:45:10.237 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:10.293 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:10 +0000 (0:00:00.086) 0:00:55.752 ***** 2019-12-05T03:45:10.325 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2019-12-05T03:45:10.326 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:10.367 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:10 +0000 (0:00:00.074) 0:00:55.827 ***** 2019-12-05T03:45:10.374 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi096.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2019-12-05T03:45:10.397 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2019-12-05T03:45:10.398 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:10.440 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:10 +0000 (0:00:00.073) 0:00:55.900 ***** 2019-12-05T03:45:10.467 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2019-12-05T03:45:10.468 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:10.525 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:10 +0000 (0:00:00.084) 0:00:55.985 ***** 2019-12-05T03:45:10.534 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:10.535 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2019-12-05T03:45:10.547 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2019-12-05T03:45:10.549 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:10.589 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:10 +0000 (0:00:00.063) 0:00:56.048 ***** 2019-12-05T03:45:10.618 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:10.621 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2019-12-05T03:45:10.622 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2019-12-05T03:45:10.623 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:10.692 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:10 +0000 (0:00:00.103) 0:00:56.151 ***** 2019-12-05T03:45:10.718 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2019-12-05T03:45:10.720 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-05T03:45:10.763 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:10 +0000 (0:00:00.071) 0:00:56.223 ***** 2019-12-05T03:45:10.781 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:10.781 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2019-12-05T03:45:10.804 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2019-12-05T03:45:10.844 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:10 +0000 (0:00:00.080) 0:00:56.303 ***** 2019-12-05T03:45:10.878 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2019-12-05T03:45:10.879 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:10.919 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:10 +0000 (0:00:00.075) 0:00:56.379 ***** 2019-12-05T03:45:10.924 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:10.925 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2019-12-05T03:45:10.952 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:10.988 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:10 +0000 (0:00:00.069) 0:00:56.448 ***** 2019-12-05T03:45:11.028 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** skipping: [smithi158.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/18/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/18/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:11.037 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/18/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/18/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:11.039 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:11.041 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2019-12-05T03:45:11.085 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:11 +0000 (0:00:00.096) 0:00:56.544 ***** 2019-12-05T03:45:11.113 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2019-12-05T03:45:11.119 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2019-12-05T03:45:11.120 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2019-12-05T03:45:11.180 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:11 +0000 (0:00:00.095) 0:00:56.640 ***** 2019-12-05T03:45:11.186 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:11.187 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2019-12-05T03:45:11.227 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** 2019-12-05T03:45:11.228 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/18/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/18/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/18/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/18/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:11.276 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:11 +0000 (0:00:00.095) 0:00:56.736 ***** 2019-12-05T03:45:11.303 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** 2019-12-05T03:45:11.304 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:11.342 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:11 +0000 (0:00:00.066) 0:00:56.802 ***** 2019-12-05T03:45:11.348 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:11.349 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2019-12-05T03:45:11.382 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-12-05T03:45:11.384 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/18/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/18/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/18/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/18/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:11.427 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:11 +0000 (0:00:00.084) 0:00:56.887 ***** 2019-12-05T03:45:11.444 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:11.445 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2019-12-05T03:45:11.583 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-12-05T03:45:11.585 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.012780", "end": "2019-12-05 03:45:11.571336", "rc": 0, "start": "2019-12-05 03:45:11.558556", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2019-12-05T03:45:11.656 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:11 +0000 (0:00:00.228) 0:00:57.115 ***** 2019-12-05T03:45:11.664 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi096.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2019-12-05T03:45:11.697 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2019-12-05T03:45:11.699 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:11.738 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:11 +0000 (0:00:00.081) 0:00:57.197 ***** 2019-12-05T03:45:11.756 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:11.757 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2019-12-05T03:45:11.769 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2019-12-05T03:45:11.770 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:11.812 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:11 +0000 (0:00:00.074) 0:00:57.272 ***** 2019-12-05T03:45:11.838 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-12-05T03:45:11.840 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:11.883 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:11 +0000 (0:00:00.070) 0:00:57.343 ***** 2019-12-05T03:45:11.891 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:11.892 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2019-12-05T03:45:11.904 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2019-12-05T03:45:11.906 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:11.944 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:11 +0000 (0:00:00.061) 0:00:57.404 ***** 2019-12-05T03:45:11.971 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2019-12-05T03:45:11.972 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:12.015 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:12 +0000 (0:00:00.070) 0:00:57.475 ***** 2019-12-05T03:45:12.025 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:12.026 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2019-12-05T03:45:12.049 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2019-12-05T03:45:12.051 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:12.099 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:12 +0000 (0:00:00.083) 0:00:57.558 ***** 2019-12-05T03:45:12.125 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2019-12-05T03:45:12.127 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:12.168 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:12 +0000 (0:00:00.069) 0:00:57.628 ***** 2019-12-05T03:45:12.174 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:12.175 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2019-12-05T03:45:12.302 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2019-12-05T03:45:12.459 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2019-12-05T03:45:12.524 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.192414", "end": "2019-12-05 03:45:12.504415", "rc": 0, "start": "2019-12-05 03:45:12.312001", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-05T03:45:12.567 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:12 +0000 (0:00:00.397) 0:00:58.026 ***** 2019-12-05T03:45:12.593 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2019-12-05T03:45:12.594 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:12.663 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:12 +0000 (0:00:00.096) 0:00:58.122 ***** 2019-12-05T03:45:12.876 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ [WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.062120", "end": "2019-12-05 03:45:12.866711", "rc": 0, "start": "2019-12-05 03:45:12.804591", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-05T03:45:12.923 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:12 +0000 (0:00:00.260) 0:00:58.382 ***** 2019-12-05T03:45:12.929 INFO:teuthology.task.ansible.out: 2019-12-05T03:45:12.930 INFO:teuthology.task.ansible.out:TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:12.932 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jj", "name": "jj", "remove": false, "state": "absent"} 2019-12-05T03:45:13.336 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "amarangone", "name": "amarangone", "remove": false, "state": "absent"} 2019-12-05T03:45:13.752 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "oprypin", "name": "oprypin", "remove": false, "state": "absent"} 2019-12-05T03:45:14.136 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "adamyanova", "name": "adamyanova", "remove": false, "state": "absent"} 2019-12-05T03:45:14.552 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "sbillah", "name": "sbillah", "remove": false, "state": "absent"} 2019-12-05T03:45:15.001 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "onyb", "name": "onyb", "remove": false, "state": "absent"} 2019-12-05T03:45:15.391 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jwilliamson", "name": "jwilliamson", "remove": false, "state": "absent"} 2019-12-05T03:45:15.811 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "kmroz", "name": "kmroz", "remove": false, "state": "absent"} 2019-12-05T03:45:16.224 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "shehbazj", "name": "shehbazj", "remove": false, "state": "absent"} 2019-12-05T03:45:16.578 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** [WARNING]: Could not find aptitude. Using apt-get instead ok: [smithi158.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1575517232, "cache_updated": false, "changed": false} 2019-12-05T03:45:16.627 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:16 +0000 (0:00:03.703) 0:01:02.086 ***** 2019-12-05T03:45:16.634 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:16.635 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "remove": false, "state": "absent"} 2019-12-05T03:45:17.103 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "asheplyakov", "name": "asheplyakov", "remove": false, "state": "absent"} 2019-12-05T03:45:17.469 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2019-12-05T03:45:17.470 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"cache_update_time": 1575517232, "cache_updated": false, "changed": false} 2019-12-05T03:45:17.519 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:17 +0000 (0:00:00.892) 0:01:02.978 ***** 2019-12-05T03:45:17.525 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** changed: [smithi096.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "liupan", "name": "liupan", "remove": false, "state": "absent"} 2019-12-05T03:45:17.548 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2019-12-05T03:45:17.550 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:17.605 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:17 +0000 (0:00:00.086) 0:01:03.065 ***** 2019-12-05T03:45:17.647 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:17.649 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2019-12-05T03:45:17.809 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2019-12-05T03:45:17.945 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2019-12-05T03:45:18.102 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2019-12-05T03:45:18.169 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2019-12-05T03:45:18.170 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2019-12-05T03:45:18.208 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:18 +0000 (0:00:00.603) 0:01:03.668 ***** 2019-12-05T03:45:18.226 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-05T03:45:18.227 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2019-12-05T03:45:18.361 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2019-12-05T03:45:18.501 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2019-12-05T03:45:18.935 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "fche", "name": "fche", "remove": false, "state": "absent"} 2019-12-05T03:45:19.040 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:19 +0000 (0:00:00.829) 0:01:04.497 ***** 2019-12-05T03:45:19.098 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** ok: [smithi158.front.sepia.ceph.com] => {"cache_update_time": 1575517232, "cache_updated": false, "changed": false} 2019-12-05T03:45:19.155 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:19 +0000 (0:00:00.117) 0:01:04.615 ***** 2019-12-05T03:45:19.480 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2019-12-05T03:45:19.480 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => {"changed": true, "checksum": "4d6d0da35c32595244f0557c86cc20a1ae54bb67", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "283e36f6f6840b00622b73078c099c15", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575517519.06-150922093090329/source", "state": "file", "uid": 0} 2019-12-05T03:45:19.545 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:19 +0000 (0:00:00.390) 0:01:05.005 ***** 2019-12-05T03:45:19.555 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-12-05T03:45:19.556 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2019-12-05T03:45:19.579 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** ok: [smithi096.front.sepia.ceph.com] => { "msg": "Host smithi096.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2019-12-05T03:45:19.634 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:19 +0000 (0:00:00.086) 0:01:05.092 ***** 2019-12-05T03:45:19.684 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2019-12-05T03:45:19.686 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2019-12-05T03:45:19.728 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:19 +0000 (0:00:00.095) 0:01:05.187 ***** 2019-12-05T03:45:19.756 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2019-12-05T03:45:19.757 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:19.797 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:19 +0000 (0:00:00.069) 0:01:05.257 ***** 2019-12-05T03:45:19.840 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2019-12-05T03:45:19.841 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:19.913 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:19 +0000 (0:00:00.115) 0:01:05.372 ***** 2019-12-05T03:45:19.924 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-12-05T03:45:19.925 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2019-12-05T03:45:19.948 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2019-12-05T03:45:19.950 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:20.010 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:20 +0000 (0:00:00.095) 0:01:05.468 ***** 2019-12-05T03:45:20.035 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2019-12-05T03:45:20.036 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:20.079 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:20 +0000 (0:00:00.071) 0:01:05.539 ***** 2019-12-05T03:45:20.116 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2019-12-05T03:45:20.118 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:20.165 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:20 +0000 (0:00:00.084) 0:01:05.624 ***** 2019-12-05T03:45:20.208 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:20.247 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:20 +0000 (0:00:00.082) 0:01:05.707 ***** 2019-12-05T03:45:20.255 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-12-05T03:45:20.256 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2019-12-05T03:45:20.301 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:20 +0000 (0:00:00.054) 0:01:05.761 ***** 2019-12-05T03:45:20.309 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2019-12-05T03:45:20.311 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:20.357 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:20 +0000 (0:00:00.050) 0:01:05.811 ***** 2019-12-05T03:45:20.387 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2019-12-05T03:45:20.388 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:20.434 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:20 +0000 (0:00:00.081) 0:01:05.893 ***** 2019-12-05T03:45:20.440 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2019-12-05T03:45:20.440 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2019-12-05T03:45:20.489 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:20 +0000 (0:00:00.055) 0:01:05.949 ***** 2019-12-05T03:45:20.495 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2019-12-05T03:45:20.496 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-05T03:45:20.497 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-05T03:45:20.537 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:20 +0000 (0:00:00.047) 0:01:05.997 ***** 2019-12-05T03:45:20.563 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2019-12-05T03:45:20.565 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:20.606 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:20 +0000 (0:00:00.069) 0:01:06.066 ***** 2019-12-05T03:45:20.634 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2019-12-05T03:45:20.636 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:20.681 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:20 +0000 (0:00:00.074) 0:01:06.141 ***** 2019-12-05T03:45:20.708 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [smithi096.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-05T03:45:20.765 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:20 +0000 (0:00:00.083) 0:01:06.225 ***** 2019-12-05T03:45:20.796 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:20.840 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:20 +0000 (0:00:00.074) 0:01:06.299 ***** 2019-12-05T03:45:20.845 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-12-05T03:45:20.849 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 12725, "state": "file", "uid": 0} 2019-12-05T03:45:20.874 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2019-12-05T03:45:20.876 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-05T03:45:20.915 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:20 +0000 (0:00:00.075) 0:01:06.374 ***** 2019-12-05T03:45:20.941 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2019-12-05T03:45:20.949 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:20.987 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:20 +0000 (0:00:00.068) 0:01:06.442 ***** 2019-12-05T03:45:21.009 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:21.052 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:21 +0000 (0:00:00.069) 0:01:06.512 ***** 2019-12-05T03:45:21.080 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2019-12-05T03:45:21.081 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:21.130 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:21 +0000 (0:00:00.077) 0:01:06.590 ***** 2019-12-05T03:45:21.148 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-12-05T03:45:21.150 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2019-12-05T03:45:21.162 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2019-12-05T03:45:21.163 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:21.204 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:21 +0000 (0:00:00.073) 0:01:06.664 ***** 2019-12-05T03:45:21.232 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2019-12-05T03:45:21.234 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-05T03:45:21.285 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:21 +0000 (0:00:00.081) 0:01:06.745 ***** 2019-12-05T03:45:21.315 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2019-12-05T03:45:21.317 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:21.376 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:21 +0000 (0:00:00.090) 0:01:06.836 ***** 2019-12-05T03:45:21.425 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2019-12-05T03:45:21.426 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:21.466 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:21 +0000 (0:00:00.089) 0:01:06.925 ***** 2019-12-05T03:45:21.482 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-12-05T03:45:21.483 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2019-12-05T03:45:21.525 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:21 +0000 (0:00:00.059) 0:01:06.985 ***** 2019-12-05T03:45:21.531 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2019-12-05T03:45:21.533 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:21.578 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:21 +0000 (0:00:00.048) 0:01:07.033 ***** 2019-12-05T03:45:21.581 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2019-12-05T03:45:21.582 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2019-12-05T03:45:21.625 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:21 +0000 (0:00:00.050) 0:01:07.084 ***** 2019-12-05T03:45:21.631 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2019-12-05T03:45:21.632 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:21.672 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:21 +0000 (0:00:00.047) 0:01:07.132 ***** 2019-12-05T03:45:21.678 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2019-12-05T03:45:21.679 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:21.721 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:21 +0000 (0:00:00.049) 0:01:07.181 ***** 2019-12-05T03:45:21.732 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:21.768 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:21 +0000 (0:00:00.047) 0:01:07.228 ***** 2019-12-05T03:45:21.774 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2019-12-05T03:45:21.776 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-05T03:45:21.822 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:21 +0000 (0:00:00.053) 0:01:07.281 ***** 2019-12-05T03:45:21.827 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2019-12-05T03:45:21.829 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:21.885 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:21 +0000 (0:00:00.062) 0:01:07.344 ***** 2019-12-05T03:45:21.908 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2019-12-05T03:45:21.910 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-05T03:45:21.913 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-05T03:45:21.915 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-05T03:45:21.931 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} TASK [common : Disable all rhsm repos] ***************************************** skipping: [smithi096.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-05T03:45:21.978 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:21 +0000 (0:00:00.093) 0:01:07.438 ***** 2019-12-05T03:45:22.020 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:22 +0000 (0:00:00.040) 0:01:07.479 ***** 2019-12-05T03:45:22.025 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2019-12-05T03:45:22.069 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:22 +0000 (0:00:00.049) 0:01:07.529 ***** 2019-12-05T03:45:22.076 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2019-12-05T03:45:22.078 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:22.136 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:22 +0000 (0:00:00.066) 0:01:07.595 ***** 2019-12-05T03:45:22.145 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2019-12-05T03:45:22.146 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:22.189 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:22 +0000 (0:00:00.053) 0:01:07.649 ***** 2019-12-05T03:45:22.218 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2019-12-05T03:45:22.219 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:22.258 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:22 +0000 (0:00:00.068) 0:01:07.717 ***** 2019-12-05T03:45:22.320 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2019-12-05T03:45:22.323 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/18/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/18/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/18/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/18/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:22.386 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:22 +0000 (0:00:00.128) 0:01:07.846 ***** 2019-12-05T03:45:22.438 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2019-12-05T03:45:22.440 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2019-12-05T03:45:22.493 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:22 +0000 (0:00:00.106) 0:01:07.953 ***** 2019-12-05T03:45:22.546 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** 2019-12-05T03:45:22.547 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/18/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/18/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:22.559 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/18/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/18/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:22.617 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:22 +0000 (0:00:00.124) 0:01:08.077 ***** 2019-12-05T03:45:22.655 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** 2019-12-05T03:45:22.658 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:22.700 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:22 +0000 (0:00:00.082) 0:01:08.160 ***** 2019-12-05T03:45:22.791 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-12-05T03:45:22.792 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/18/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/18/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:22.794 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/18/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/18/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:22.853 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:22 +0000 (0:00:00.152) 0:01:08.313 ***** 2019-12-05T03:45:23.072 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-12-05T03:45:23.072 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.078987", "end": "2019-12-05 03:45:23.119425", "rc": 0, "start": "2019-12-05 03:45:23.040438", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2019-12-05T03:45:23.128 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:23 +0000 (0:00:00.274) 0:01:08.588 ***** 2019-12-05T03:45:23.136 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2019-12-05T03:45:23.137 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"cache_update_time": 1575517232, "cache_updated": false, "changed": false} 2019-12-05T03:45:23.182 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:23 +0000 (0:00:00.054) 0:01:08.642 ***** 2019-12-05T03:45:23.191 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:23.238 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:23 +0000 (0:00:00.055) 0:01:08.698 ***** 2019-12-05T03:45:23.267 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2019-12-05T03:45:23.269 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:23.310 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:23 +0000 (0:00:00.071) 0:01:08.770 ***** 2019-12-05T03:45:23.347 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-12-05T03:45:23.349 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:23.398 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:23 +0000 (0:00:00.087) 0:01:08.858 ***** 2019-12-05T03:45:23.426 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2019-12-05T03:45:23.427 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:23.485 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:23 +0000 (0:00:00.086) 0:01:08.945 ***** 2019-12-05T03:45:23.515 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2019-12-05T03:45:23.517 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:23.558 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:23 +0000 (0:00:00.072) 0:01:09.018 ***** 2019-12-05T03:45:23.565 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2019-12-05T03:45:23.566 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2019-12-05T03:45:23.609 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:23 +0000 (0:00:00.048) 0:01:09.066 ***** 2019-12-05T03:45:23.612 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2019-12-05T03:45:23.612 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:23.653 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:23 +0000 (0:00:00.046) 0:01:09.112 ***** 2019-12-05T03:45:23.680 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2019-12-05T03:45:23.681 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:23.720 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:23 +0000 (0:00:00.067) 0:01:09.180 ***** 2019-12-05T03:45:23.943 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2019-12-05T03:45:23.945 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2019-12-05T03:45:23.993 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:23 +0000 (0:00:00.272) 0:01:09.452 ***** 2019-12-05T03:45:24.149 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2019-12-05T03:45:24.151 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-05T03:45:24.203 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:24 +0000 (0:00:00.210) 0:01:09.663 ***** 2019-12-05T03:45:24.233 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2019-12-05T03:45:24.235 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:24.276 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:24 +0000 (0:00:00.073) 0:01:09.736 ***** 2019-12-05T03:45:24.317 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** skipping: [smithi158.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-05T03:45:24.354 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:24 +0000 (0:00:00.077) 0:01:09.814 ***** 2019-12-05T03:45:24.381 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2019-12-05T03:45:24.382 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:24.421 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:24 +0000 (0:00:00.067) 0:01:09.881 ***** 2019-12-05T03:45:24.471 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2019-12-05T03:45:24.473 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.615111", "end": "2019-12-05 03:45:24.517356", "rc": 0, "start": "2019-12-05 03:45:23.902245", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-05T03:45:24.512 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:24 +0000 (0:00:00.090) 0:01:09.971 ***** 2019-12-05T03:45:24.539 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2019-12-05T03:45:24.542 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:24.581 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:24 +0000 (0:00:00.068) 0:01:10.040 ***** 2019-12-05T03:45:24.793 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ changed: [smithi096.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.058704", "end": "2019-12-05 03:45:24.838434", "rc": 0, "start": "2019-12-05 03:45:24.779730", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [common : Upload nagios nrpe config.] ************************************* ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "9c3d1d79583cf76a6d81bb2ec150bc4af5ca3c5c", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1166, "state": "file", "uid": 0} 2019-12-05T03:45:24.837 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:24 +0000 (0:00:00.256) 0:01:10.296 ***** 2019-12-05T03:45:24.897 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:24 +0000 (0:00:00.059) 0:01:10.356 ***** 2019-12-05T03:45:25.585 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2019-12-05T03:45:25.589 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2019-12-05 03:43:49 UTC", "ActiveEnterTimestampMonotonic": "19504906", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "remote-fs.target systemd-tmpfiles-setup.service -.mount system.slice time-sync.target sysinit.target var-run.mount basic.target network.target local-fs.target nss-lookup.target systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2019-12-05 03:43:49 UTC", "AssertTimestampMonotonic": "19503617", "Before": "multi-user.target plymouth-quit.service xdm.service shutdown.target getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2019-12-05 03:43:49 UTC", "ConditionTimestampMonotonic": "19503617", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-ser 2019-12-05T03:45:25.591 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1265", "ExecMainStartTimestamp": "Thu 2019-12-05 03:43:49 UTC", "ExecMainStartTimestampMonotonic": "19504873", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Thu 2019-12-05 03:43:49 UTC] ; stop_time=[n/a] ; pid=1265 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2019-12-05 03:43:49 UTC", "InactiveExitTimestampMonotonic": "19504906", "InvocationID": "0807501f07334b979552a95da2e870ad", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "i 2019-12-05T03:45:25.592 INFO:teuthology.task.ansible.out:nfinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128035", "LimitNPROCSoft": "128035", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128035", "LimitSIGPENDINGSoft": "128035", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1265", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", 2019-12-05T03:45:25.593 INFO:teuthology.task.ansible.out: "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2019-12-05 03:43:49 UTC", "StateChangeTimestampMonotonic": "19504906", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2019-12-05 03:43:49 UTC", "WatchdogTimestampMonotonic": "19504905", "WatchdogUSec": "0"}} 2019-12-05T03:45:25.656 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:25 +0000 (0:00:00.759) 0:01:11.116 ***** 2019-12-05T03:45:25.686 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2019-12-05T03:45:25.687 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:25.728 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:25 +0000 (0:00:00.072) 0:01:11.188 ***** 2019-12-05T03:45:25.776 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2019-12-05T03:45:25.778 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:25.825 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:25 +0000 (0:00:00.096) 0:01:11.285 ***** 2019-12-05T03:45:25.852 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2019-12-05T03:45:25.854 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:25.899 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:25 +0000 (0:00:00.073) 0:01:11.358 ***** 2019-12-05T03:45:25.937 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2019-12-05T03:45:25.938 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:25.979 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:25 +0000 (0:00:00.080) 0:01:11.438 ***** 2019-12-05T03:45:26.018 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:26.059 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:26 +0000 (0:00:00.080) 0:01:11.519 ***** 2019-12-05T03:45:26.096 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2019-12-05T03:45:26.097 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:26.155 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:26 +0000 (0:00:00.095) 0:01:11.615 ***** 2019-12-05T03:45:26.185 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:26.224 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:26 +0000 (0:00:00.069) 0:01:11.684 ***** 2019-12-05T03:45:26.251 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2019-12-05T03:45:26.254 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:26.300 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:26 +0000 (0:00:00.076) 0:01:11.760 ***** 2019-12-05T03:45:26.327 INFO:teuthology.task.ansible.out: 2019-12-05T03:45:26.328 INFO:teuthology.task.ansible.out:TASK [common : nrpe - Load SELinux policy package] ***************************** 2019-12-05T03:45:26.330 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:26.381 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:26 +0000 (0:00:00.080) 0:01:11.841 ***** 2019-12-05T03:45:26.411 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2019-12-05T03:45:26.412 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:26.452 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:26 +0000 (0:00:00.070) 0:01:11.912 ***** 2019-12-05T03:45:26.480 INFO:teuthology.task.ansible.out: 2019-12-05T03:45:26.481 INFO:teuthology.task.ansible.out:TASK [testnode : Include package type specific vars.] ************************** ok: [smithi158.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2019-12-05T03:45:26.523 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:26 +0000 (0:00:00.070) 0:01:11.983 ***** 2019-12-05T03:45:26.525 INFO:teuthology.task.ansible.out: 2019-12-05T03:45:26.563 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* ok: [smithi158.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-virtualenv", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "python-configobj", "python-gevent", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "btrfs-tools", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "python-nose", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "python-numpy", "python-matplotlib", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2019-12-05T03:45:26.608 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:26 +0000 (0:00:00.084) 0:01:12.067 ***** 2019-12-05T03:45:26.668 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** ok: [smithi158.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2019-12-05T03:45:26.703 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:26 +0000 (0:00:00.095) 0:01:12.163 ***** 2019-12-05T03:45:26.741 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [smithi158.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-12-05T03:45:26.784 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:26 +0000 (0:00:00.080) 0:01:12.243 ***** 2019-12-05T03:45:26.917 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2019-12-05T03:45:26.919 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2019-12-05T03:45:26.972 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:26 +0000 (0:00:00.189) 0:01:12.432 ***** 2019-12-05T03:45:27.125 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2019-12-05T03:45:27.127 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "gid": 1216, "name": "ubuntu", "state": "present", "system": false} 2019-12-05T03:45:27.173 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:27 +0000 (0:00:00.200) 0:01:12.632 ***** 2019-12-05T03:45:27.200 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2019-12-05T03:45:27.202 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:27.253 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:27 +0000 (0:00:00.072) 0:01:12.705 ***** 2019-12-05T03:45:27.274 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2019-12-05T03:45:27.275 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:27.331 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:27 +0000 (0:00:00.085) 0:01:12.790 ***** 2019-12-05T03:45:27.510 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2019-12-05T03:45:27.511 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2019-12-05T03:45:27.563 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:27 +0000 (0:00:00.232) 0:01:13.023 ***** 2019-12-05T03:45:28.007 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2019-12-05T03:45:28.078 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:28 +0000 (0:00:00.515) 0:01:13.538 ***** 2019-12-05T03:45:28.120 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2019-12-05T03:45:28.121 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi158"}, "changed": false} 2019-12-05T03:45:28.188 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:28 +0000 (0:00:00.110) 0:01:13.648 ***** 2019-12-05T03:45:28.322 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2019-12-05T03:45:28.323 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1575517274, "cache_updated": false, "changed": false} 2019-12-05T03:45:28.374 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:28 +0000 (0:00:00.185) 0:01:13.833 ***** 2019-12-05T03:45:29.164 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2019-12-05T03:45:29.165 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi158.front.sepia.ceph.com", "ansible_hostname": "smithi158", "ansible_nodename": "smithi158"}, "changed": true, "name": "smithi158"} 2019-12-05T03:45:29.207 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:29 +0000 (0:00:00.833) 0:01:14.667 ***** 2019-12-05T03:45:29.223 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2019-12-05T03:45:29.225 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"cache_update_time": 1575517274, "cache_updated": false, "changed": false} 2019-12-05T03:45:29.267 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:29 +0000 (0:00:00.059) 0:01:14.726 ***** 2019-12-05T03:45:29.294 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2019-12-05T03:45:29.296 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:29.338 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:29 +0000 (0:00:00.071) 0:01:14.798 ***** 2019-12-05T03:45:29.612 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2019-12-05T03:45:29.613 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2019-12-05T03:45:29.690 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:29 +0000 (0:00:00.350) 0:01:15.148 ***** 2019-12-05T03:45:29.731 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2019-12-05T03:45:29.732 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2019-12-05T03:45:29.783 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:29 +0000 (0:00:00.093) 0:01:15.242 ***** 2019-12-05T03:45:30.063 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2019-12-05T03:45:30.065 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2019-12-05T03:45:30.131 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:30 +0000 (0:00:00.348) 0:01:15.591 ***** 2019-12-05T03:45:30.603 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2019-12-05T03:45:30.604 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"cache_update_time": 1575517274, "cache_updated": false, "changed": false} 2019-12-05T03:45:30.658 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:30 +0000 (0:00:00.526) 0:01:16.118 ***** 2019-12-05T03:45:30.696 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2019-12-05T03:45:30.697 INFO:teuthology.task.ansible.out: [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually 2019-12-05T03:45:30.698 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2019-12-05T03:45:30.740 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:30 +0000 (0:00:00.081) 0:01:16.199 ***** 2019-12-05T03:45:30.742 INFO:teuthology.task.ansible.out: 2019-12-05T03:45:30.766 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2019-12-05T03:45:30.768 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:30.807 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:30 +0000 (0:00:00.066) 0:01:16.266 ***** 2019-12-05T03:45:30.844 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-12-05T03:45:30.845 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:30.886 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:30 +0000 (0:00:00.079) 0:01:16.345 ***** 2019-12-05T03:45:30.914 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-12-05T03:45:30.914 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:30.954 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:30 +0000 (0:00:00.067) 0:01:16.413 ***** 2019-12-05T03:45:30.985 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:31.021 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:31 +0000 (0:00:00.067) 0:01:16.481 ***** 2019-12-05T03:45:31.061 INFO:teuthology.task.ansible.out: 2019-12-05T03:45:31.063 INFO:teuthology.task.ansible.out:TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-12-05T03:45:31.064 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2019-12-05T03:45:31.077 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-12-05T03:45:31.079 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:31.151 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:31 +0000 (0:00:00.129) 0:01:16.610 ***** 2019-12-05T03:45:31.192 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-12-05T03:45:31.194 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:31.244 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:31 +0000 (0:00:00.093) 0:01:16.704 ***** 2019-12-05T03:45:31.287 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:31.341 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:31 +0000 (0:00:00.092) 0:01:16.796 ***** 2019-12-05T03:45:31.366 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-12-05T03:45:31.417 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:31 +0000 (0:00:00.080) 0:01:16.877 ***** 2019-12-05T03:45:31.428 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-12-05T03:45:31.429 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2019-12-05T03:45:31.441 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-12-05T03:45:31.500 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:31 +0000 (0:00:00.081) 0:01:16.959 ***** 2019-12-05T03:45:31.528 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2019-12-05T03:45:31.530 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:31.577 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:31 +0000 (0:00:00.077) 0:01:17.036 ***** 2019-12-05T03:45:31.630 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2019-12-05T03:45:31.632 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-12-05T03:45:31.687 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:31 +0000 (0:00:00.109) 0:01:17.146 ***** 2019-12-05T03:45:31.688 INFO:teuthology.task.ansible.out: 2019-12-05T03:45:31.716 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:31.718 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-12-05T03:45:31.719 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2019-12-05T03:45:31.770 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:31 +0000 (0:00:00.083) 0:01:17.230 ***** 2019-12-05T03:45:31.814 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:31 +0000 (0:00:00.043) 0:01:17.274 ***** 2019-12-05T03:45:31.842 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-05T03:45:31.843 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:31.899 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:31 +0000 (0:00:00.082) 0:01:17.356 ***** 2019-12-05T03:45:31.905 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2019-12-05T03:45:31.907 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2019-12-05T03:45:31.949 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:31 +0000 (0:00:00.052) 0:01:17.408 ***** 2019-12-05T03:45:31.957 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2019-12-05T03:45:31.961 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:32.004 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:32 +0000 (0:00:00.054) 0:01:17.463 ***** 2019-12-05T03:45:32.031 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:32.076 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:32 +0000 (0:00:00.068) 0:01:17.532 ***** 2019-12-05T03:45:32.100 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2019-12-05T03:45:32.101 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:32.141 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:32 +0000 (0:00:00.068) 0:01:17.601 ***** 2019-12-05T03:45:32.171 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2019-12-05T03:45:32.172 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:32.211 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:32 +0000 (0:00:00.069) 0:01:17.670 ***** 2019-12-05T03:45:32.241 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-12-05T03:45:32.242 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:32.281 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:32 +0000 (0:00:00.070) 0:01:17.741 ***** 2019-12-05T03:45:32.308 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-12-05T03:45:32.310 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-12-05T03:45:32.312 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 12725, "state": "file", "uid": 0} 2019-12-05T03:45:32.357 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:32 +0000 (0:00:00.075) 0:01:17.817 ***** 2019-12-05T03:45:32.390 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-12-05T03:45:32.391 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:32.441 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:32 +0000 (0:00:00.083) 0:01:17.900 ***** 2019-12-05T03:45:32.483 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2019-12-05T03:45:32.485 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:32.526 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:32 +0000 (0:00:00.085) 0:01:17.986 ***** 2019-12-05T03:45:32.570 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:32.627 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:32 +0000 (0:00:00.101) 0:01:18.087 ***** 2019-12-05T03:45:32.658 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-12-05T03:45:32.660 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:32.711 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:32 +0000 (0:00:00.083) 0:01:18.170 ***** 2019-12-05T03:45:32.735 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi096.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2019-12-05T03:45:32.743 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:32.812 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:32 +0000 (0:00:00.100) 0:01:18.271 ***** 2019-12-05T03:45:32.853 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2019-12-05T03:45:32.855 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:32.906 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:32 +0000 (0:00:00.094) 0:01:18.366 ***** 2019-12-05T03:45:32.950 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2019-12-05T03:45:32.952 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:32.999 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:32 +0000 (0:00:00.092) 0:01:18.458 ***** 2019-12-05T03:45:33.117 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-12-05T03:45:33.117 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2019-12-05T03:45:33.171 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:33 +0000 (0:00:00.170) 0:01:18.628 ***** 2019-12-05T03:45:33.199 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2019-12-05T03:45:33.200 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.003382", "end": "2019-12-05 03:45:33.166634", "rc": 0, "start": "2019-12-05 03:45:33.163252", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-05T03:45:33.253 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:33 +0000 (0:00:00.084) 0:01:18.713 ***** 2019-12-05T03:45:33.259 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2019-12-05T03:45:33.262 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2019-12-05T03:45:33.305 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:33 +0000 (0:00:00.051) 0:01:18.764 ***** 2019-12-05T03:45:33.312 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2019-12-05T03:45:33.352 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:33 +0000 (0:00:00.047) 0:01:18.812 ***** 2019-12-05T03:45:33.358 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2019-12-05T03:45:33.358 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:33.409 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:33 +0000 (0:00:00.056) 0:01:18.869 ***** 2019-12-05T03:45:33.465 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* skipping: [smithi096.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-05T03:45:33.505 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:33 +0000 (0:00:00.095) 0:01:18.964 ***** 2019-12-05T03:45:33.545 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2019-12-05T03:45:33.547 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-05T03:45:33.557 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-05T03:45:33.570 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-05T03:45:33.571 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-05T03:45:33.615 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:33 +0000 (0:00:00.109) 0:01:19.074 ***** 2019-12-05T03:45:33.646 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2019-12-05T03:45:33.647 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:33.695 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:33 +0000 (0:00:00.080) 0:01:19.154 ***** 2019-12-05T03:45:33.702 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2019-12-05T03:45:33.703 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2019-12-05T03:45:33.747 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:33 +0000 (0:00:00.051) 0:01:19.206 ***** 2019-12-05T03:45:33.773 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2019-12-05T03:45:33.773 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:33.816 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:33 +0000 (0:00:00.069) 0:01:19.276 ***** 2019-12-05T03:45:34.582 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2019-12-05T03:45:34.582 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"cache_update_time": 1575517274, "cache_updated": false, "changed": false} 2019-12-05T03:45:34.623 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:34 +0000 (0:00:00.806) 0:01:20.083 ***** 2019-12-05T03:45:34.984 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2019-12-05T03:45:34.985 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2019-12-05T03:45:35.040 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:35 +0000 (0:00:00.417) 0:01:20.500 ***** 2019-12-05T03:45:35.089 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2019-12-05T03:45:35.091 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2019-12-05T03:45:35.393 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2019-12-05T03:45:35.439 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:35 +0000 (0:00:00.398) 0:01:20.898 ***** 2019-12-05T03:45:35.626 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2019-12-05T03:45:35.628 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-05T03:45:35.674 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:35 +0000 (0:00:00.234) 0:01:21.133 ***** 2019-12-05T03:45:35.728 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2019-12-05T03:45:35.731 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:35.786 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:35 +0000 (0:00:00.112) 0:01:21.246 ***** 2019-12-05T03:45:35.832 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2019-12-05T03:45:35.834 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-05T03:45:35.874 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:35 +0000 (0:00:00.087) 0:01:21.333 ***** 2019-12-05T03:45:35.914 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2019-12-05T03:45:35.916 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:35.955 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:35 +0000 (0:00:00.081) 0:01:21.414 ***** 2019-12-05T03:45:35.973 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* ok: [smithi158.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2019-12-05T03:45:36.018 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:36 +0000 (0:00:00.062) 0:01:21.477 ***** 2019-12-05T03:45:36.301 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "checksum": "9c3d1d79583cf76a6d81bb2ec150bc4af5ca3c5c", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1166, "state": "file", "uid": 0} 2019-12-05T03:45:36.351 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:36 +0000 (0:00:00.333) 0:01:21.810 ***** 2019-12-05T03:45:36.585 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2019-12-05T03:45:36.589 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2019-12-05 03:44:05 UTC", "ActiveEnterTimestampMonotonic": "20372619", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "var-run.mount systemd-journald.socket time-sync.target -.mount network.target local-fs.target remote-fs.target system.slice basic.target nss-lookup.target systemd-tmpfiles-setup.service sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2019-12-05 03:44:05 UTC", "AssertTimestampMonotonic": "20371560", "Before": "plymouth-quit.service shutdown.target multi-user.target getty@tty1.service xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2019-12-05 03:44:05 UTC", "ConditionTimestampMonotonic": "20371560", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-ser 2019-12-05T03:45:36.590 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1267", "ExecMainStartTimestamp": "Thu 2019-12-05 03:44:05 UTC", "ExecMainStartTimestampMonotonic": "20372582", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Thu 2019-12-05 03:44:05 UTC] ; stop_time=[n/a] ; pid=1267 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2019-12-05 03:44:05 UTC", "InactiveExitTimestampMonotonic": "20372619", "InvocationID": "0552d2472b764353984094cc3275cf00", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "i 2019-12-05T03:45:36.592 INFO:teuthology.task.ansible.out:nfinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128035", "LimitNPROCSoft": "128035", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128035", "LimitSIGPENDINGSoft": "128035", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1267", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", 2019-12-05T03:45:36.593 INFO:teuthology.task.ansible.out: "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2019-12-05 03:44:05 UTC", "StateChangeTimestampMonotonic": "20372619", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2019-12-05 03:44:05 UTC", "WatchdogTimestampMonotonic": "20372618", "WatchdogUSec": "0"}} 2019-12-05T03:45:36.636 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:36 +0000 (0:00:00.284) 0:01:22.095 ***** 2019-12-05T03:45:36.673 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2019-12-05T03:45:36.675 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:36.718 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:36 +0000 (0:00:00.082) 0:01:22.178 ***** 2019-12-05T03:45:36.757 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2019-12-05T03:45:36.761 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:36.813 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:36 +0000 (0:00:00.094) 0:01:22.272 ***** 2019-12-05T03:45:36.839 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2019-12-05T03:45:36.841 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:36.893 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:36 +0000 (0:00:00.080) 0:01:22.353 ***** 2019-12-05T03:45:36.912 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2019-12-05T03:45:36.915 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"cache_update_time": 1575517232, "cache_updated": false, "changed": false} 2019-12-05T03:45:36.958 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:36 +0000 (0:00:00.065) 0:01:22.418 ***** 2019-12-05T03:45:36.964 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2019-12-05T03:45:36.965 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:37.006 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:37 +0000 (0:00:00.047) 0:01:22.465 ***** 2019-12-05T03:45:37.011 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2019-12-05T03:45:37.053 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:37 +0000 (0:00:00.047) 0:01:22.512 ***** 2019-12-05T03:45:37.059 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2019-12-05T03:45:37.069 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:37.100 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:37 +0000 (0:00:00.047) 0:01:22.560 ***** 2019-12-05T03:45:37.127 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2019-12-05T03:45:37.129 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:37.168 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:37 +0000 (0:00:00.067) 0:01:22.627 ***** 2019-12-05T03:45:37.197 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:37.237 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:37 +0000 (0:00:00.068) 0:01:22.696 ***** 2019-12-05T03:45:37.246 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** [WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.035151", "end": "2019-12-05 03:45:37.211238", "rc": 0, "start": "2019-12-05 03:45:37.176087", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-05T03:45:37.286 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:37 +0000 (0:00:00.049) 0:01:22.746 ***** 2019-12-05T03:45:37.291 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2019-12-05T03:45:37.294 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:37.334 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:37 +0000 (0:00:00.048) 0:01:22.794 ***** 2019-12-05T03:45:37.366 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2019-12-05T03:45:37.367 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:37.416 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:37 +0000 (0:00:00.081) 0:01:22.875 ***** 2019-12-05T03:45:37.447 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2019-12-05T03:45:37.448 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:37.500 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:37 +0000 (0:00:00.079) 0:01:22.954 ***** 2019-12-05T03:45:37.554 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2019-12-05T03:45:37.555 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2019-12-05T03:45:37.597 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:37 +0000 (0:00:00.102) 0:01:23.056 ***** 2019-12-05T03:45:37.651 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2019-12-05T03:45:37.652 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-virtualenv", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "python-configobj", "python-gevent", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "btrfs-tools", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "python-nose", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "python-numpy", "python-matplotlib", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2019-12-05T03:45:37.696 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:37 +0000 (0:00:00.099) 0:01:23.156 ***** 2019-12-05T03:45:37.734 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2019-12-05T03:45:37.735 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2019-12-05T03:45:37.775 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:37 +0000 (0:00:00.079) 0:01:23.235 ***** 2019-12-05T03:45:37.852 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [smithi096.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-12-05T03:45:37.888 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:37 +0000 (0:00:00.112) 0:01:23.348 ***** 2019-12-05T03:45:38.024 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2019-12-05T03:45:38.025 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2019-12-05T03:45:38.069 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:38 +0000 (0:00:00.180) 0:01:23.528 ***** 2019-12-05T03:45:38.200 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2019-12-05T03:45:38.202 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "gid": 1216, "name": "ubuntu", "state": "present", "system": false} 2019-12-05T03:45:38.245 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:38 +0000 (0:00:00.175) 0:01:23.704 ***** 2019-12-05T03:45:38.271 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2019-12-05T03:45:38.273 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:38.322 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:38 +0000 (0:00:00.076) 0:01:23.780 ***** 2019-12-05T03:45:38.347 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2019-12-05T03:45:38.349 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:38.388 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:38 +0000 (0:00:00.067) 0:01:23.848 ***** 2019-12-05T03:45:38.563 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2019-12-05T03:45:38.564 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2019-12-05T03:45:38.607 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:38 +0000 (0:00:00.218) 0:01:24.066 ***** 2019-12-05T03:45:39.068 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2019-12-05T03:45:39.105 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:39 +0000 (0:00:00.498) 0:01:24.565 ***** 2019-12-05T03:45:39.148 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2019-12-05T03:45:39.150 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi096"}, "changed": false} 2019-12-05T03:45:39.188 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:39 +0000 (0:00:00.082) 0:01:24.648 ***** 2019-12-05T03:45:39.669 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2019-12-05T03:45:39.671 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi096.front.sepia.ceph.com", "ansible_hostname": "smithi096", "ansible_nodename": "smithi096"}, "changed": true, "name": "smithi096"} 2019-12-05T03:45:39.714 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:39 +0000 (0:00:00.525) 0:01:25.173 ***** 2019-12-05T03:45:40.050 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2019-12-05T03:45:40.050 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2019-12-05T03:45:40.098 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:40 +0000 (0:00:00.384) 0:01:25.557 ***** 2019-12-05T03:45:40.139 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2019-12-05T03:45:40.140 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"cache_update_time": 1575517232, "cache_updated": false, "changed": false} 2019-12-05T03:45:40.190 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:40 +0000 (0:00:00.091) 0:01:25.649 ***** 2019-12-05T03:45:40.428 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2019-12-05T03:45:40.482 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:40 +0000 (0:00:00.292) 0:01:25.941 ***** 2019-12-05T03:45:40.987 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2019-12-05T03:45:40.990 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2019-12-05T03:45:41.028 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:41 +0000 (0:00:00.545) 0:01:26.487 ***** 2019-12-05T03:45:41.055 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2019-12-05T03:45:41.056 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:41.095 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:41 +0000 (0:00:00.066) 0:01:26.554 ***** 2019-12-05T03:45:41.121 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-12-05T03:45:41.123 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:41.165 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:41 +0000 (0:00:00.070) 0:01:26.625 ***** 2019-12-05T03:45:41.203 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-12-05T03:45:41.203 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:41.258 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:41 +0000 (0:00:00.092) 0:01:26.718 ***** 2019-12-05T03:45:41.290 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-12-05T03:45:41.291 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:41.342 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:41 +0000 (0:00:00.083) 0:01:26.801 ***** 2019-12-05T03:45:41.379 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-12-05T03:45:41.381 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:41.420 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:41 +0000 (0:00:00.077) 0:01:26.879 ***** 2019-12-05T03:45:41.451 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:41.490 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:41 +0000 (0:00:00.070) 0:01:26.950 ***** 2019-12-05T03:45:41.518 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-12-05T03:45:41.519 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:41.559 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:41 +0000 (0:00:00.068) 0:01:27.019 ***** 2019-12-05T03:45:41.587 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-12-05T03:45:41.630 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:41 +0000 (0:00:00.070) 0:01:27.089 ***** 2019-12-05T03:45:41.667 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-12-05T03:45:41.715 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:41 +0000 (0:00:00.085) 0:01:27.175 ***** 2019-12-05T03:45:41.747 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2019-12-05T03:45:41.748 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:41.812 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:41 +0000 (0:00:00.096) 0:01:27.271 ***** 2019-12-05T03:45:41.852 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2019-12-05T03:45:41.853 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-12-05T03:45:41.906 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:41 +0000 (0:00:00.094) 0:01:27.366 ***** 2019-12-05T03:45:41.936 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2019-12-05T03:45:41.937 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:41.977 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:41 +0000 (0:00:00.071) 0:01:27.437 ***** 2019-12-05T03:45:42.004 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-05T03:45:42.006 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:42.051 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:42 +0000 (0:00:00.073) 0:01:27.511 ***** 2019-12-05T03:45:42.079 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2019-12-05T03:45:42.080 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:42.123 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:42 +0000 (0:00:00.072) 0:01:27.583 ***** 2019-12-05T03:45:42.150 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2019-12-05T03:45:42.152 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:42.204 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:42 +0000 (0:00:00.080) 0:01:27.663 ***** 2019-12-05T03:45:42.230 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2019-12-05T03:45:42.232 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:42.291 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:42 +0000 (0:00:00.087) 0:01:27.750 ***** 2019-12-05T03:45:42.318 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2019-12-05T03:45:42.319 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:42.360 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:42 +0000 (0:00:00.069) 0:01:27.820 ***** 2019-12-05T03:45:42.397 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-12-05T03:45:42.399 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:42.440 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:42 +0000 (0:00:00.079) 0:01:27.900 ***** 2019-12-05T03:45:42.469 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-12-05T03:45:42.471 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:42.511 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:42 +0000 (0:00:00.070) 0:01:27.971 ***** 2019-12-05T03:45:42.539 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-12-05T03:45:42.540 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:42.582 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:42 +0000 (0:00:00.070) 0:01:28.042 ***** 2019-12-05T03:45:42.630 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2019-12-05T03:45:42.632 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:42.675 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:42 +0000 (0:00:00.093) 0:01:28.135 ***** 2019-12-05T03:45:42.702 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-12-05T03:45:42.703 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:42.742 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:42 +0000 (0:00:00.066) 0:01:28.201 ***** 2019-12-05T03:45:42.768 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-12-05T03:45:42.770 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:42.809 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:42 +0000 (0:00:00.066) 0:01:28.268 ***** 2019-12-05T03:45:42.835 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2019-12-05T03:45:42.837 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:42.881 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:42 +0000 (0:00:00.072) 0:01:28.341 ***** 2019-12-05T03:45:42.919 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2019-12-05T03:45:42.919 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:42.970 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:42 +0000 (0:00:00.088) 0:01:28.429 ***** 2019-12-05T03:45:43.007 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2019-12-05T03:45:43.015 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:43.052 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:43 +0000 (0:00:00.082) 0:01:28.511 ***** 2019-12-05T03:45:43.181 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2019-12-05T03:45:43.182 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.004746", "end": "2019-12-05 03:45:43.226595", "rc": 0, "start": "2019-12-05 03:45:43.221849", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-05T03:45:43.232 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:43 +0000 (0:00:00.180) 0:01:28.691 ***** 2019-12-05T03:45:43.259 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2019-12-05T03:45:43.299 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:43 +0000 (0:00:00.067) 0:01:28.759 ***** 2019-12-05T03:45:43.663 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2019-12-05T03:45:43.664 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2019-12-05T03:45:43.703 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:43 +0000 (0:00:00.403) 0:01:29.162 ***** 2019-12-05T03:45:43.740 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2019-12-05T03:45:43.742 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:43.780 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:43 +0000 (0:00:00.077) 0:01:29.240 ***** 2019-12-05T03:45:44.945 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2019-12-05T03:45:44.946 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2019-12-05T03:45:45.861 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2019-12-05T03:45:45.909 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:45 +0000 (0:00:02.129) 0:01:31.369 ***** 2019-12-05T03:45:46.815 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2019-12-05T03:45:46.816 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"cache_update_time": 1575517274, "cache_updated": false, "changed": false} 2019-12-05T03:45:46.865 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:46 +0000 (0:00:00.956) 0:01:32.325 ***** 2019-12-05T03:45:46.892 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2019-12-05T03:45:46.932 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:46 +0000 (0:00:00.066) 0:01:32.391 ***** 2019-12-05T03:45:47.103 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2019-12-05T03:45:47.104 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.029598", "end": "2019-12-05 03:45:47.134409", "rc": 0, "start": "2019-12-05 03:45:47.104811", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-05T03:45:47.146 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:47 +0000 (0:00:00.214) 0:01:32.605 ***** 2019-12-05T03:45:49.273 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2019-12-05T03:45:49.275 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 52 not upgraded.\nAfter this operation, 47.5 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137174 files and directorie 2019-12-05T03:45:49.276 INFO:teuthology.task.ansible.out:s currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.19) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.19) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.19) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.19) ...\r\nRemoving librbd1 (12.2.12-0ubuntu0.18.04.3) ...\r\nRemoving librados2 (12.2.12-0ubuntu0.18.04.3) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 52 not upgraded.", "After this operation, 47.5 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Readin 2019-12-05T03:45:49.278 INFO:teuthology.task.ansible.out:g database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137174 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.19) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.19) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.19) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.19) ...", "Removing librbd1 (12.2.12-0ubuntu0.18.04.3) ...", "Removing librados2 (12.2.12-0ubuntu0.18.04.3) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1) ..."]} 2019-12-05T03:45:49.316 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:49 +0000 (0:00:02.170) 0:01:34.776 ***** 2019-12-05T03:45:50.068 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2019-12-05T03:45:50.070 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"cache_update_time": 1575517274, "cache_updated": false, "changed": false} 2019-12-05T03:45:50.109 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:50 +0000 (0:00:00.791) 0:01:35.568 ***** 2019-12-05T03:45:50.179 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-12-05T03:45:50.180 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"cache_update_time": 1575517232, "cache_updated": false, "changed": false} 2019-12-05T03:45:50.224 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:50 +0000 (0:00:00.114) 0:01:35.683 ***** 2019-12-05T03:45:50.250 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2019-12-05T03:45:50.252 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:45:50.300 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:50 +0000 (0:00:00.072) 0:01:35.756 ***** 2019-12-05T03:45:59.033 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** changed: [smithi096.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 52 not upgraded.\nAfter this operation, 47.5 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database .. 2019-12-05T03:45:59.035 INFO:teuthology.task.ansible.out:. 95%\r(Reading database ... 100%\r(Reading database ... 137174 files and directories currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.19) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.19) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.19) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.19) ...\r\nRemoving librbd1 (12.2.12-0ubuntu0.18.04.3) ...\r\nRemoving librados2 (12.2.12-0ubuntu0.18.04.3) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 52 not upgraded.", "After this operation, 47.5 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading d 2019-12-05T03:45:59.036 INFO:teuthology.task.ansible.out:atabase ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137174 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.19) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.19) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.19) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.19) ...", "Removing librbd1 (12.2.12-0ubuntu0.18.04.3) ...", "Removing librados2 (12.2.12-0ubuntu0.18.04.3) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1) ..."]} 2019-12-05T03:45:59.072 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:59 +0000 (0:00:08.775) 0:01:44.532 ***** 2019-12-05T03:45:59.337 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-12-05T03:45:59.339 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"cache_update_time": 1575517232, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.4).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 52 not upgraded.\nNeed to get 10.4 MB of archives.\nAfter this operation, 47.5 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.12-0ubuntu0.18.04.3 [2702 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.12-0ubuntu0.18.04.3 [920 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.21 [39.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.21 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.21 [5197 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.21 [868 kB]\nFetched 10.4 MB in 1s (9361 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database .. 2019-12-05T03:45:59.340 INFO:teuthology.task.ansible.out:. 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137032 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.12-0ubuntu0.18.04.3_amd64.deb ...\r\nUnpacking librados2 (12.2.12-0ubuntu0.18.04.3) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.12-0ubuntu0.18.04.3_amd64.deb ...\r\nUnpacking librbd1 (12.2.12-0ubuntu0.18.04.3) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up librados2 (12.2.12-0ubuntu0.18.04.3) ...\r\nSetting up librbd1 (12.2.12-0ubuntu0.18.04.3) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubunt 2019-12-05T03:45:59.342 INFO:teuthology.task.ansible.out:u1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.4).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 52 not upgraded.", "Need to get 10.4 MB of archives.", "After this operation, 47.5 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.12-0ubuntu0.18.04.3 [2702 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.12-0ubuntu0.18.04.3 [920 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.21 [39.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.21 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.21 [5197 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.21 [868 kB]", "Fetched 10.4 MB in 1s (9361 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Rea 2019-12-05T03:45:59.343 INFO:teuthology.task.ansible.out:ding database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137032 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.12-0ubuntu0.18.04.3_amd64.deb ...", "Unpacking librados2 (12.2.12-0ubuntu0.18.04.3) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.12-0ubuntu0.18.04.3_amd64.deb ...", "Unpacking librbd1 (12.2.12-0ubuntu0.18.04.3) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up librados2 (12.2.12-0ubuntu0.18.04.3) ...", "Setting up librbd1 (12.2.12-0ubuntu0.18.04.3) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1) ..."]} 2019-12-05T03:45:59.387 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:59 +0000 (0:00:00.314) 0:01:44.847 ***** 2019-12-05T03:45:59.929 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-12-05T03:45:59.930 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"cache_update_time": 1575517274, "cache_updated": false, "changed": false} 2019-12-05T03:45:59.972 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:45:59 +0000 (0:00:00.584) 0:01:45.431 ***** 2019-12-05T03:46:00.009 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2019-12-05T03:46:00.010 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:00.051 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:00 +0000 (0:00:00.079) 0:01:45.511 ***** 2019-12-05T03:46:00.053 INFO:teuthology.task.ansible.out: 2019-12-05T03:46:00.291 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2019-12-05T03:46:00.292 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"cache_update_time": 1575517232, "cache_updated": false, "changed": false} 2019-12-05T03:46:00.334 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:00 +0000 (0:00:00.282) 0:01:45.794 ***** 2019-12-05T03:46:00.489 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2019-12-05T03:46:00.490 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2019-12-05T03:46:00.530 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:00 +0000 (0:00:00.196) 0:01:45.990 ***** 2019-12-05T03:46:00.567 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2019-12-05T03:46:00.569 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:00.611 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:00 +0000 (0:00:00.080) 0:01:46.070 ***** 2019-12-05T03:46:00.743 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2019-12-05T03:46:00.744 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2019-12-05T03:46:00.804 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:00 +0000 (0:00:00.192) 0:01:46.263 ***** 2019-12-05T03:46:01.169 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2019-12-05T03:46:01.171 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2019-12-05T03:46:01.214 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:01 +0000 (0:00:00.410) 0:01:46.674 ***** 2019-12-05T03:46:01.383 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2019-12-05T03:46:01.385 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1216, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2019-12-05T03:46:01.427 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:01 +0000 (0:00:00.213) 0:01:46.887 ***** 2019-12-05T03:46:01.572 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** ok: [smithi158.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-05T03:46:01.631 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:01 +0000 (0:00:00.203) 0:01:47.090 ***** 2019-12-05T03:46:01.979 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2019-12-05T03:46:01.981 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Thu 2019-12-05 03:43:49 UTC", "ActiveEnterTimestampMonotonic": "20214428", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target network.target remote-fs.target -.mount sysinit.target nss-lookup.target system.slice systemd-journald.socket systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2019-12-05 03:43:49 UTC", "AssertTimestampMonotonic": "19501368", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2019-12-05 03:43:49 UTC", "ConditionTimestampMonotonic": "19501368", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2019-12-05T03:46:01.983 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1358", "ExecMainStartTimestamp": "Thu 2019-12-05 03:43:49 UTC", "ExecMainStartTimestampMonotonic": "20214418", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2019-12-05 03:43:49 UTC", "InactiveExitTimestampMonotonic": "19502004", "InvocationID": "fd3629962ed540628a8b8cc2e8cd8cac", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2019-12-05T03:46:01.985 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128035", "LimitNPROCSoft": "128035", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128035", "LimitSIGPENDINGSoft": "128035", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1358", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": 2019-12-05T03:46:01.986 INFO:teuthology.task.ansible.out: "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2019-12-05 03:43:49 UTC", "StateChangeTimestampMonotonic": "20214428", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2019-12-05 03:43:49 UTC", "WatchdogTimestampMonotonic": "20214427", "WatchdogUSec": "0"}} 2019-12-05T03:46:02.036 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:02 +0000 (0:00:00.395) 0:01:47.486 ***** 2019-12-05T03:46:02.061 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-12-05T03:46:02.063 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:02.119 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:02 +0000 (0:00:00.092) 0:01:47.579 ***** 2019-12-05T03:46:02.158 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-12-05T03:46:02.160 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:02.230 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:02 +0000 (0:00:00.110) 0:01:47.689 ***** 2019-12-05T03:46:02.258 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-12-05T03:46:02.260 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:02.300 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:02 +0000 (0:00:00.070) 0:01:47.760 ***** 2019-12-05T03:46:02.329 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-12-05T03:46:02.331 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:02.370 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:02 +0000 (0:00:00.070) 0:01:47.830 ***** 2019-12-05T03:46:02.398 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-12-05T03:46:02.399 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:02.447 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:02 +0000 (0:00:00.075) 0:01:47.905 ***** 2019-12-05T03:46:02.484 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-12-05T03:46:02.486 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:02.531 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:02 +0000 (0:00:00.085) 0:01:47.991 ***** 2019-12-05T03:46:02.558 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-12-05T03:46:02.560 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:02.609 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:02 +0000 (0:00:00.077) 0:01:48.068 ***** 2019-12-05T03:46:02.646 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-12-05T03:46:02.648 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:02.708 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:02 +0000 (0:00:00.099) 0:01:48.168 ***** 2019-12-05T03:46:02.735 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-12-05T03:46:02.737 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:02.784 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:02 +0000 (0:00:00.076) 0:01:48.244 ***** 2019-12-05T03:46:02.812 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:02.861 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:02 +0000 (0:00:00.076) 0:01:48.320 ***** 2019-12-05T03:46:02.888 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-12-05T03:46:02.889 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:02.936 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:02 +0000 (0:00:00.074) 0:01:48.395 ***** 2019-12-05T03:46:02.963 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-12-05T03:46:02.964 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:03.012 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:03 +0000 (0:00:00.075) 0:01:48.471 ***** 2019-12-05T03:46:03.038 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-12-05T03:46:03.040 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:03.085 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:03 +0000 (0:00:00.073) 0:01:48.545 ***** 2019-12-05T03:46:03.113 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-12-05T03:46:03.114 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:03.183 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:03 +0000 (0:00:00.098) 0:01:48.643 ***** 2019-12-05T03:46:03.210 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-05T03:46:03.212 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:03.255 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:03 +0000 (0:00:00.071) 0:01:48.715 ***** 2019-12-05T03:46:03.292 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-12-05T03:46:03.293 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:03.333 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:03 +0000 (0:00:00.078) 0:01:48.793 ***** 2019-12-05T03:46:03.369 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-12-05T03:46:03.371 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:03.410 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:03 +0000 (0:00:00.076) 0:01:48.870 ***** 2019-12-05T03:46:03.436 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-12-05T03:46:03.438 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:03.477 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:03 +0000 (0:00:00.066) 0:01:48.936 ***** 2019-12-05T03:46:03.504 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-12-05T03:46:03.505 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:03.543 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:03 +0000 (0:00:00.066) 0:01:49.003 ***** 2019-12-05T03:46:03.591 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-12-05T03:46:03.592 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:03.631 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:03 +0000 (0:00:00.087) 0:01:49.091 ***** 2019-12-05T03:46:03.677 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-05T03:46:03.678 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:03.727 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:03 +0000 (0:00:00.095) 0:01:49.187 ***** 2019-12-05T03:46:03.774 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-12-05T03:46:03.776 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:03.815 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:03 +0000 (0:00:00.087) 0:01:49.275 ***** 2019-12-05T03:46:03.842 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-12-05T03:46:03.844 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:03.885 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:03 +0000 (0:00:00.069) 0:01:49.345 ***** 2019-12-05T03:46:03.911 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-05T03:46:03.913 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:03.951 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:03 +0000 (0:00:00.066) 0:01:49.411 ***** 2019-12-05T03:46:03.979 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2019-12-05T03:46:03.981 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:04.024 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:04 +0000 (0:00:00.072) 0:01:49.483 ***** 2019-12-05T03:46:04.171 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2019-12-05T03:46:04.172 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2019-12-05T03:46:04.221 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:04 +0000 (0:00:00.196) 0:01:49.680 ***** 2019-12-05T03:46:04.574 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-12-05T03:46:04.574 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2019-12-05T03:46:04.630 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:04 +0000 (0:00:00.408) 0:01:50.089 ***** 2019-12-05T03:46:04.657 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:04.701 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:04 +0000 (0:00:00.071) 0:01:50.161 ***** 2019-12-05T03:46:05.041 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2019-12-05T03:46:05.043 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2019-12-05T03:46:05.083 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:05 +0000 (0:00:00.382) 0:01:50.543 ***** 2019-12-05T03:46:05.437 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2019-12-05T03:46:05.438 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2019-12-05T03:46:05.482 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:05 +0000 (0:00:00.399) 0:01:50.942 ***** 2019-12-05T03:46:05.785 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2019-12-05T03:46:05.786 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2019-12-05T03:46:05.835 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:05 +0000 (0:00:00.352) 0:01:51.294 ***** 2019-12-05T03:46:05.989 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2019-12-05T03:46:05.990 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-05T03:46:06.032 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:06 +0000 (0:00:00.197) 0:01:51.492 ***** 2019-12-05T03:46:06.059 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2019-12-05T03:46:06.061 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:06.103 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:06 +0000 (0:00:00.071) 0:01:51.563 ***** 2019-12-05T03:46:06.141 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2019-12-05T03:46:06.143 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:06.182 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:06 +0000 (0:00:00.078) 0:01:51.641 ***** 2019-12-05T03:46:06.226 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:06.262 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:06 +0000 (0:00:00.080) 0:01:51.722 ***** 2019-12-05T03:46:06.289 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2019-12-05T03:46:06.291 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:06.332 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:06 +0000 (0:00:00.069) 0:01:51.791 ***** 2019-12-05T03:46:06.358 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2019-12-05T03:46:06.359 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:06.398 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:06 +0000 (0:00:00.066) 0:01:51.858 ***** 2019-12-05T03:46:06.436 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-05T03:46:06.438 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2019-12-05T03:46:06.474 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:06 +0000 (0:00:00.076) 0:01:51.934 ***** 2019-12-05T03:46:06.532 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2019-12-05T03:46:06.534 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2019-12-05T03:46:06.544 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2019-12-05T03:46:06.545 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2019-12-05T03:46:06.557 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2019-12-05T03:46:06.568 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2019-12-05T03:46:06.580 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2019-12-05T03:46:06.581 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2019-12-05T03:46:06.593 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2019-12-05T03:46:06.604 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2019-12-05T03:46:06.615 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2019-12-05T03:46:06.626 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2019-12-05T03:46:06.641 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2019-12-05T03:46:06.643 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2019-12-05T03:46:06.644 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2019-12-05T03:46:06.666 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2019-12-05T03:46:06.715 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:06 +0000 (0:00:00.240) 0:01:52.175 ***** 2019-12-05T03:46:06.862 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2019-12-05T03:46:06.864 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003877", "end": "2019-12-05 03:46:06.845697", "rc": 0, "start": "2019-12-05 03:46:06.841820", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2019-12-05T03:46:06.906 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:06 +0000 (0:00:00.191) 0:01:52.366 ***** 2019-12-05T03:46:06.946 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:07.031 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:07 +0000 (0:00:00.124) 0:01:52.490 ***** 2019-12-05T03:46:07.079 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2019-12-05T03:46:07.080 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:07.125 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:07 +0000 (0:00:00.094) 0:01:52.585 ***** 2019-12-05T03:46:07.158 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2019-12-05T03:46:07.160 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:07.222 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:07 +0000 (0:00:00.096) 0:01:52.682 ***** 2019-12-05T03:46:08.066 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2019-12-05T03:46:08.068 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"cache_update_time": 1575517232, "cache_updated": false, "changed": false} 2019-12-05T03:46:08.110 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:08 +0000 (0:00:00.888) 0:01:53.570 ***** 2019-12-05T03:46:08.148 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2019-12-05T03:46:08.149 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:08.198 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:08 +0000 (0:00:00.087) 0:01:53.658 ***** 2019-12-05T03:46:08.248 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-12-05T03:46:08.249 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item={u'block_used': 13713665, u'uuid': u'e17a1a1d-4a16-4f42-a170-a33513a36c81', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 226381443, u'size_available': 927258390528, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60905935, u'device': u'/dev/sda1', u'inode_used': 149041, u'block_size': 4096, u'options': u'rw,relatime,errors=remount-ro,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226381443, "block_size": 4096, "block_total": 240095108, "block_used": 13713665, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905935, "inode_total": 61054976, "inode_used": 149041, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927258390528, "size_total": 983429562368, "uuid": "e17a1a1d-4a16-4f42-a170-a33513a36c81"}} 2019-12-05T03:46:08.289 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:08 +0000 (0:00:00.090) 0:01:53.748 ***** 2019-12-05T03:46:08.433 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2019-12-05T03:46:08.434 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.010236", "end": "2019-12-05 03:46:08.401918", "rc": 0, "start": "2019-12-05 03:46:08.391682", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-05T03:46:08.511 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:08 +0000 (0:00:00.221) 0:01:53.970 ***** 2019-12-05T03:46:08.571 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2019-12-05T03:46:08.571 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={u'block_used': 13713665, u'uuid': u'e17a1a1d-4a16-4f42-a170-a33513a36c81', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 226381443, u'size_available': 927258390528, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60905935, u'device': u'/dev/sda1', u'inode_used': 149041, u'block_size': 4096, u'options': u'rw,relatime,errors=remount-ro,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226381443, "block_size": 4096, "block_total": 240095108, "block_used": 13713665, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905935, "inode_total": 61054976, "inode_used": 149041, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927258390528, "size_total": 983429562368, "uuid": "e17a1a1d-4a16-4f42-a170-a33513a36c81"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:08.624 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:08 +0000 (0:00:00.113) 0:01:54.083 ***** 2019-12-05T03:46:08.665 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2019-12-05T03:46:08.721 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:08 +0000 (0:00:00.097) 0:01:54.181 ***** 2019-12-05T03:46:08.770 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-05T03:46:08.771 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XLCL', u'wwn-0x5000c50092940704'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XLCL', u'wwn': u'0x5000c50092940704', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'cfq', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'e17a1a1d-4a16-4f42-a170-a33513a36c81', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XLCL-part1', u'wwn-0x5000c50092940704-part1'], u'uuids': [u'e17a1a1d-4a16-4f42-a170-a33513a36c81']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XLCL", "wwn-0x5000c50092940704"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XLCL-part1", "wwn-0x5000c50092940704-part1"], "labels": [], "masters": [], "uuids": ["e17a1a1d-4a16-4f42-a170-a33513a36c81"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "e17a1a1d-4a16-4f42-a170-a33513a36c81"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XLCL", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "vir 2019-12-05T03:46:08.772 INFO:teuthology.task.ansible.out:tual": 1, "wwn": "0x5000c50092940704"}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:08.783 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:08.785 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:08.798 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:08.800 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:08.812 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:08.824 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:08.836 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:08.849 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:08.903 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-12-05T03:46:08.911 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => {"cache_update_time": 1575517274, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.4).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 52 not upgraded.\nNeed to get 10.4 MB of archives.\nAfter this operation, 47.5 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.12-0ubuntu0.18.04.3 [2702 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.12-0ubuntu0.18.04.3 [920 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.21 [39.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.21 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.21 [5197 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.21 [868 kB]\nFetched 10.4 MB in 1s (9597 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database .. 2019-12-05T03:46:08.912 INFO:teuthology.task.ansible.out:. 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137032 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.12-0ubuntu0.18.04.3_amd64.deb ...\r\nUnpacking librados2 (12.2.12-0ubuntu0.18.04.3) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.12-0ubuntu0.18.04.3_amd64.deb ...\r\nUnpacking librbd1 (12.2.12-0ubuntu0.18.04.3) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up librados2 (12.2.12-0ubuntu0.18.04.3) ...\r\nSetting up librbd1 (12.2.12-0ubuntu0.18.04.3) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubunt 2019-12-05T03:46:08.914 INFO:teuthology.task.ansible.out:u1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.4).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 52 not upgraded.", "Need to get 10.4 MB of archives.", "After this operation, 47.5 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.12-0ubuntu0.18.04.3 [2702 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.12-0ubuntu0.18.04.3 [920 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.21 [39.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.21 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.21 [5197 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.21 [868 kB]", "Fetched 10.4 MB in 1s (9597 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Rea 2019-12-05T03:46:08.916 INFO:teuthology.task.ansible.out:ding database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137032 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.12-0ubuntu0.18.04.3_amd64.deb ...", "Unpacking librados2 (12.2.12-0ubuntu0.18.04.3) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.12-0ubuntu0.18.04.3_amd64.deb ...", "Unpacking librbd1 (12.2.12-0ubuntu0.18.04.3) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up librados2 (12.2.12-0ubuntu0.18.04.3) ...", "Setting up librbd1 (12.2.12-0ubuntu0.18.04.3) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1) ..."]} 2019-12-05T03:46:08.960 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:08 +0000 (0:00:00.238) 0:01:54.419 ***** 2019-12-05T03:46:08.961 INFO:teuthology.task.ansible.out: 2019-12-05T03:46:09.855 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* ok: [smithi096.front.sepia.ceph.com] => {"cache_update_time": 1575517274, "cache_updated": false, "changed": false} 2019-12-05T03:46:09.896 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:09 +0000 (0:00:00.935) 0:01:55.355 ***** 2019-12-05T03:46:10.037 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2019-12-05T03:46:10.095 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:10 +0000 (0:00:00.199) 0:01:55.555 ***** 2019-12-05T03:46:10.097 INFO:teuthology.task.ansible.out: 2019-12-05T03:46:10.124 INFO:teuthology.task.ansible.out: 2019-12-05T03:46:10.125 INFO:teuthology.task.ansible.out:TASK [testnode : Enable xattr for this boot.] ********************************** 2019-12-05T03:46:10.126 INFO:teuthology.task.ansible.out: skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:10.171 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:10 +0000 (0:00:00.075) 0:01:55.631 ***** 2019-12-05T03:46:10.327 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2019-12-05T03:46:10.372 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:10 +0000 (0:00:00.201) 0:01:55.832 ***** 2019-12-05T03:46:10.738 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2019-12-05T03:46:10.738 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2019-12-05T03:46:10.779 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:10 +0000 (0:00:00.406) 0:01:56.239 ***** 2019-12-05T03:46:10.958 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2019-12-05T03:46:10.958 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1216, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2019-12-05T03:46:11.001 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:10 +0000 (0:00:00.221) 0:01:56.461 ***** 2019-12-05T03:46:11.109 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-05T03:46:11.110 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-HDLIBC-pwHM-f35L-4Ftv-uUrb-KYjO-B75aof', u'nvme-INTEL_SSDPEDMD400G4_CVFT6233005J400BGN', u'nvme-nvme.8086-43564654363233333030354a34303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:02.120139", "end": "2019-12-05 03:46:11.068883", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-HDLIBC-pwHM-f35L-4Ftv-uUrb-KYjO-B75aof", "nvme-INTEL_SSDPEDMD400G4_CVFT6233005J400BGN", "nvme-nvme.8086-43564654363233333030354a34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-05 03:46:08.948744", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2019-12-05T03:46:11.111 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-05T03:46:11.163 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2019-12-05T03:46:11.165 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-05T03:46:11.204 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:11 +0000 (0:00:00.202) 0:01:56.663 ***** 2019-12-05T03:46:11.534 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2019-12-05T03:46:11.536 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Thu 2019-12-05 03:44:05 UTC", "ActiveEnterTimestampMonotonic": "21136414", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target remote-fs.target basic.target system.slice systemd-journald.socket systemd-tmpfiles-setup.service -.mount nss-lookup.target network.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2019-12-05 03:44:05 UTC", "AssertTimestampMonotonic": "20370796", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2019-12-05 03:44:05 UTC", "ConditionTimestampMonotonic": "20370796", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2019-12-05T03:46:11.537 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1365", "ExecMainStartTimestamp": "Thu 2019-12-05 03:44:05 UTC", "ExecMainStartTimestampMonotonic": "21136403", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2019-12-05 03:44:05 UTC", "InactiveExitTimestampMonotonic": "20371497", "InvocationID": "e5b6f993e35f4c84836ea45d6606e80f", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2019-12-05T03:46:11.539 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128035", "LimitNPROCSoft": "128035", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128035", "LimitSIGPENDINGSoft": "128035", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1365", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": 2019-12-05T03:46:11.540 INFO:teuthology.task.ansible.out: "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2019-12-05 03:44:05 UTC", "StateChangeTimestampMonotonic": "21136414", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2019-12-05 03:44:05 UTC", "WatchdogTimestampMonotonic": "21136413", "WatchdogUSec": "0"}} 2019-12-05T03:46:11.600 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:11 +0000 (0:00:00.396) 0:01:57.059 ***** 2019-12-05T03:46:11.640 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-12-05T03:46:11.642 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:11.696 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:11 +0000 (0:00:00.096) 0:01:57.156 ***** 2019-12-05T03:46:11.723 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-12-05T03:46:11.724 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:11.763 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:11 +0000 (0:00:00.067) 0:01:57.223 ***** 2019-12-05T03:46:11.791 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-12-05T03:46:11.793 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:11.854 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:11 +0000 (0:00:00.090) 0:01:57.313 ***** 2019-12-05T03:46:11.884 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-12-05T03:46:11.886 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:11.945 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:11 +0000 (0:00:00.091) 0:01:57.405 ***** 2019-12-05T03:46:11.972 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-12-05T03:46:11.974 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:12.014 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:12 +0000 (0:00:00.068) 0:01:57.474 ***** 2019-12-05T03:46:12.044 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-12-05T03:46:12.044 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:12.086 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:12 +0000 (0:00:00.071) 0:01:57.546 ***** 2019-12-05T03:46:12.114 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-12-05T03:46:12.127 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:12.155 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:12 +0000 (0:00:00.068) 0:01:57.615 ***** 2019-12-05T03:46:12.182 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-12-05T03:46:12.184 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:12.223 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:12 +0000 (0:00:00.067) 0:01:57.682 ***** 2019-12-05T03:46:12.250 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-12-05T03:46:12.252 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:12.297 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:12 +0000 (0:00:00.074) 0:01:57.757 ***** 2019-12-05T03:46:12.327 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-12-05T03:46:12.328 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:12.369 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:12 +0000 (0:00:00.071) 0:01:57.828 ***** 2019-12-05T03:46:12.398 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-05T03:46:12.399 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-4c3Jf16fcOxxxdxEXRbZDIvDxhtZHdpsVgpdIrD6jEGc1Am3fjuwqhAOJ7zMjko9'], u'uuids': [u'fd279e12-36eb-4a95-8ea7-8c73cd8fa8fa']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.151982", "end": "2019-12-05 03:46:12.349797", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-4c3Jf16fcOxxxdxEXRbZDIvDxhtZHdpsVgpdIrD6jEGc1Am3fjuwqhAOJ7zMjko9"], "labels": [], "masters": [], "uuids": ["fd279e12-36eb-4a95-8ea7-8c73cd8fa8fa"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-05 03:46:11.197815", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-05T03:46:12.401 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:12.442 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:12 +0000 (0:00:00.072) 0:01:57.901 ***** 2019-12-05T03:46:12.468 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-12-05T03:46:12.469 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:12.513 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:12 +0000 (0:00:00.071) 0:01:57.973 ***** 2019-12-05T03:46:12.540 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-12-05T03:46:12.541 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:12.584 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:12 +0000 (0:00:00.070) 0:01:58.043 ***** 2019-12-05T03:46:12.611 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-12-05T03:46:12.612 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:12.656 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:12 +0000 (0:00:00.071) 0:01:58.115 ***** 2019-12-05T03:46:12.683 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-05T03:46:12.684 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:12.726 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:12 +0000 (0:00:00.070) 0:01:58.186 ***** 2019-12-05T03:46:12.764 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-12-05T03:46:12.766 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:12.806 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:12 +0000 (0:00:00.080) 0:01:58.266 ***** 2019-12-05T03:46:12.833 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-12-05T03:46:12.833 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:12.876 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:12 +0000 (0:00:00.069) 0:01:58.336 ***** 2019-12-05T03:46:12.902 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-12-05T03:46:12.904 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:12.946 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:12 +0000 (0:00:00.070) 0:01:58.406 ***** 2019-12-05T03:46:12.948 INFO:teuthology.task.ansible.out: 2019-12-05T03:46:12.994 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-12-05T03:46:12.995 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:13.045 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:13 +0000 (0:00:00.098) 0:01:58.505 ***** 2019-12-05T03:46:13.094 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-12-05T03:46:13.095 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:13.145 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:13 +0000 (0:00:00.099) 0:01:58.605 ***** 2019-12-05T03:46:13.171 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-05T03:46:13.173 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:13.214 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:13 +0000 (0:00:00.069) 0:01:58.674 ***** 2019-12-05T03:46:13.241 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:13.287 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:13 +0000 (0:00:00.072) 0:01:58.747 ***** 2019-12-05T03:46:13.316 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-12-05T03:46:13.317 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:13.360 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:13 +0000 (0:00:00.072) 0:01:58.819 ***** 2019-12-05T03:46:13.386 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-05T03:46:13.388 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:13.431 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:13 +0000 (0:00:00.071) 0:01:58.890 ***** 2019-12-05T03:46:13.471 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:13.515 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:13 +0000 (0:00:00.084) 0:01:58.974 ***** 2019-12-05T03:46:13.652 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-05T03:46:13.653 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-4c3Jf16fcOxxxdxEXRbZDIvDxhtZHdps8hFWr7M9Wr0bsDE3lseDR0HkDSwda8QA'], u'uuids': [u'eaf12ad5-3f9e-41fb-a882-90094f06092f']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.126912", "end": "2019-12-05 03:46:13.608341", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-4c3Jf16fcOxxxdxEXRbZDIvDxhtZHdps8hFWr7M9Wr0bsDE3lseDR0HkDSwda8QA"], "labels": [], "masters": [], "uuids": ["eaf12ad5-3f9e-41fb-a882-90094f06092f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-05 03:46:12.481429", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-05T03:46:13.655 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2019-12-05T03:46:13.697 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:13 +0000 (0:00:00.182) 0:01:59.157 ***** 2019-12-05T03:46:14.041 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-12-05T03:46:14.042 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2019-12-05T03:46:14.097 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:14 +0000 (0:00:00.400) 0:01:59.557 ***** 2019-12-05T03:46:14.136 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-12-05T03:46:14.137 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:14.177 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:14 +0000 (0:00:00.079) 0:01:59.636 ***** 2019-12-05T03:46:14.509 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2019-12-05T03:46:14.509 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2019-12-05T03:46:14.555 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:14 +0000 (0:00:00.378) 0:02:00.015 ***** 2019-12-05T03:46:14.885 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2019-12-05T03:46:14.887 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2019-12-05T03:46:14.927 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:14 +0000 (0:00:00.371) 0:02:00.386 ***** 2019-12-05T03:46:14.933 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-05T03:46:14.935 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-4c3Jf16fcOxxxdxEXRbZDIvDxhtZHdps40txjyg9gJR41fjN2Oqb59uLkPiWyRYv'], u'uuids': [u'eab4b3cd-3f12-4e4e-b0d9-c323135936e9']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.139132", "end": "2019-12-05 03:46:14.865609", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-4c3Jf16fcOxxxdxEXRbZDIvDxhtZHdps40txjyg9gJR41fjN2Oqb59uLkPiWyRYv"], "labels": [], "masters": [], "uuids": ["eab4b3cd-3f12-4e4e-b0d9-c323135936e9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-05 03:46:13.726477", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-05T03:46:15.247 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2019-12-05T03:46:15.249 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2019-12-05T03:46:15.290 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:15 +0000 (0:00:00.362) 0:02:00.749 ***** 2019-12-05T03:46:15.417 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2019-12-05T03:46:15.418 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-05T03:46:15.459 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:15 +0000 (0:00:00.169) 0:02:00.919 ***** 2019-12-05T03:46:15.486 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2019-12-05T03:46:15.488 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:15.531 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:15 +0000 (0:00:00.071) 0:02:00.991 ***** 2019-12-05T03:46:15.559 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2019-12-05T03:46:15.560 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:15.602 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:15 +0000 (0:00:00.070) 0:02:01.062 ***** 2019-12-05T03:46:15.628 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2019-12-05T03:46:15.630 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:15.684 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:15 +0000 (0:00:00.081) 0:02:01.143 ***** 2019-12-05T03:46:15.711 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2019-12-05T03:46:15.713 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:15.756 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:15 +0000 (0:00:00.072) 0:02:01.216 ***** 2019-12-05T03:46:15.801 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2019-12-05T03:46:15.802 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:15.850 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:15 +0000 (0:00:00.093) 0:02:01.309 ***** 2019-12-05T03:46:15.888 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-05T03:46:15.889 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2019-12-05T03:46:15.934 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:15 +0000 (0:00:00.083) 0:02:01.393 ***** 2019-12-05T03:46:15.982 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2019-12-05T03:46:15.984 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2019-12-05T03:46:15.994 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2019-12-05T03:46:16.007 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2019-12-05T03:46:16.007 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2019-12-05T03:46:16.018 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2019-12-05T03:46:16.029 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2019-12-05T03:46:16.040 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2019-12-05T03:46:16.052 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2019-12-05T03:46:16.052 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2019-12-05T03:46:16.063 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2019-12-05T03:46:16.074 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2019-12-05T03:46:16.085 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2019-12-05T03:46:16.096 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2019-12-05T03:46:16.111 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2019-12-05T03:46:16.153 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:16 +0000 (0:00:00.219) 0:02:01.613 ***** 2019-12-05T03:46:16.213 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-05T03:46:16.215 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-4c3Jf16fcOxxxdxEXRbZDIvDxhtZHdps58IFIOeY0GiiXNMZFLXZNN9bJTcFGTeQ'], u'uuids': [u'72bd013d-8891-4754-b0a7-c40da315fba5']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.170136", "end": "2019-12-05 03:46:16.165240", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-4c3Jf16fcOxxxdxEXRbZDIvDxhtZHdps58IFIOeY0GiiXNMZFLXZNN9bJTcFGTeQ"], "labels": [], "masters": [], "uuids": ["72bd013d-8891-4754-b0a7-c40da315fba5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-05 03:46:14.995104", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-05T03:46:16.314 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2019-12-05T03:46:16.316 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003759", "end": "2019-12-05 03:46:16.291890", "rc": 0, "start": "2019-12-05 03:46:16.288131", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2019-12-05T03:46:16.368 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:16 +0000 (0:00:00.214) 0:02:01.827 ***** 2019-12-05T03:46:16.405 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2019-12-05T03:46:16.406 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:16.451 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:16 +0000 (0:00:00.083) 0:02:01.911 ***** 2019-12-05T03:46:16.479 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:16.519 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:16 +0000 (0:00:00.067) 0:02:01.979 ***** 2019-12-05T03:46:16.546 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2019-12-05T03:46:16.547 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:16.587 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:16 +0000 (0:00:00.067) 0:02:02.046 ***** 2019-12-05T03:46:17.500 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2019-12-05T03:46:17.501 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"cache_update_time": 1575517274, "cache_updated": false, "changed": false} 2019-12-05T03:46:17.540 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:17 +0000 (0:00:00.953) 0:02:03.000 ***** 2019-12-05T03:46:17.547 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-05T03:46:17.549 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-4c3Jf16fcOxxxdxEXRbZDIvDxhtZHdpsjhtg79R11dDgsWdNwba3jfHmWa7zzo6u'], u'uuids': [u'dc5f8567-558d-42f9-8eeb-e85d7267c6e5']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.157323", "end": "2019-12-05 03:46:17.457227", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-4c3Jf16fcOxxxdxEXRbZDIvDxhtZHdpsjhtg79R11dDgsWdNwba3jfHmWa7zzo6u"], "labels": [], "masters": [], "uuids": ["dc5f8567-558d-42f9-8eeb-e85d7267c6e5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-05 03:46:16.299904", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-05T03:46:17.579 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2019-12-05T03:46:17.581 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:17.624 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:17 +0000 (0:00:00.083) 0:02:03.084 ***** 2019-12-05T03:46:17.661 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:17 +0000 (0:00:00.037) 0:02:03.121 ***** 2019-12-05T03:46:17.680 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-12-05T03:46:17.681 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={u'block_used': 13713665, u'uuid': u'e17a1a1d-4a16-4f42-a170-a33513a36c81', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 226381443, u'size_available': 927258390528, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60905935, u'device': u'/dev/sda1', u'inode_used': 149041, u'block_size': 4096, u'options': u'rw,relatime,errors=remount-ro,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226381443, "block_size": 4096, "block_total": 240095108, "block_used": 13713665, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905935, "inode_total": 61054976, "inode_used": 149041, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927258390528, "size_total": 983429562368, "uuid": "e17a1a1d-4a16-4f42-a170-a33513a36c81"}} 2019-12-05T03:46:17.735 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:17 +0000 (0:00:00.073) 0:02:03.194 ***** 2019-12-05T03:46:17.745 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-05T03:46:17.747 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XLCL', u'wwn-0x5000c50092940704'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XLCL', u'wwn': u'0x5000c50092940704', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'cfq', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'e17a1a1d-4a16-4f42-a170-a33513a36c81', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XLCL-part1', u'wwn-0x5000c50092940704-part1'], u'uuids': [u'e17a1a1d-4a16-4f42-a170-a33513a36c81']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XLCL", "wwn-0x5000c50092940704"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XLCL-part1", "wwn-0x5000c50092940704-part1"], "labels": [], "masters": [], "uuids": ["e17a1a1d-4a16-4f42-a170-a33513a36c81"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "e17a1a1d-4a16-4f42-a170-a33513a36c81"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XLCL", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "vir 2019-12-05T03:46:17.749 INFO:teuthology.task.ansible.out:tual": 1, "wwn": "0x5000c50092940704"}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:17.750 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:17.752 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:17.754 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:17.766 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:17.779 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:17.781 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:17.803 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:17.816 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:17.904 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi096.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009748", "end": "2019-12-05 03:46:17.920457", "rc": 0, "start": "2019-12-05 03:46:17.910709", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-05T03:46:17.966 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:17 +0000 (0:00:00.231) 0:02:03.426 ***** 2019-12-05T03:46:18.004 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-05T03:46:18.005 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-HDLIBC-pwHM-f35L-4Ftv-uUrb-KYjO-B75aof', u'nvme-INTEL_SSDPEDMD400G4_CVFT6233005J400BGN', u'nvme-nvme.8086-43564654363233333030354a34303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.058278", "end": "2019-12-05 03:46:17.947588", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-HDLIBC-pwHM-f35L-4Ftv-uUrb-KYjO-B75aof", "nvme-INTEL_SSDPEDMD400G4_CVFT6233005J400BGN", "nvme-nvme.8086-43564654363233333030354a34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-05 03:46:17.889310", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 11 2019-12-05T03:46:18.007 INFO:teuthology.task.ansible.out:0 MiB) copied, 0.0394057 s, 2.9 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0394057 s, 2.9 GB/s"], "stdout": "", "stdout_lines": []} 2019-12-05T03:46:18.018 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2019-12-05T03:46:18.018 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'block_used': 13713665, u'uuid': u'e17a1a1d-4a16-4f42-a170-a33513a36c81', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 226381443, u'size_available': 927258390528, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60905935, u'device': u'/dev/sda1', u'inode_used': 149041, u'block_size': 4096, u'options': u'rw,relatime,errors=remount-ro,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226381443, "block_size": 4096, "block_total": 240095108, "block_used": 13713665, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905935, "inode_total": 61054976, "inode_used": 149041, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927258390528, "size_total": 983429562368, "uuid": "e17a1a1d-4a16-4f42-a170-a33513a36c81"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:18.070 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:18 +0000 (0:00:00.104) 0:02:03.530 ***** 2019-12-05T03:46:18.118 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2019-12-05T03:46:18.176 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:18 +0000 (0:00:00.105) 0:02:03.635 ***** 2019-12-05T03:46:18.226 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-05T03:46:18.227 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QGMP', u'wwn-0x5000c50091dfbebc'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5QGMP', u'wwn': u'0x5000c50091dfbebc', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'cfq', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'e17a1a1d-4a16-4f42-a170-a33513a36c81', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QGMP-part1', u'wwn-0x5000c50091dfbebc-part1'], u'uuids': [u'e17a1a1d-4a16-4f42-a170-a33513a36c81']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QGMP", "wwn-0x5000c50091dfbebc"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QGMP-part1", "wwn-0x5000c50091dfbebc-part1"], "labels": [], "masters": [], "uuids": ["e17a1a1d-4a16-4f42-a170-a33513a36c81"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "e17a1a1d-4a16-4f42-a170-a33513a36c81"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QGMP", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "vir 2019-12-05T03:46:18.229 INFO:teuthology.task.ansible.out:tual": 1, "wwn": "0x5000c50091dfbebc"}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:18.250 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:18.262 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:18.275 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-05T03:46:18.276 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-4c3Jf16fcOxxxdxEXRbZDIvDxhtZHdpsVgpdIrD6jEGc1Am3fjuwqhAOJ7zMjko9'], u'uuids': [u'fd279e12-36eb-4a95-8ea7-8c73cd8fa8fa']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.154603", "end": "2019-12-05 03:46:18.236918", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-4c3Jf16fcOxxxdxEXRbZDIvDxhtZHdpsVgpdIrD6jEGc1Am3fjuwqhAOJ7zMjko9"], "labels": [], "masters": [], "uuids": ["fd279e12-36eb-4a95-8ea7-8c73cd8fa8fa"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-05 03:46:18.082315", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.150376 s, 767 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.150376 s, 767 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-05T03:46:18.278 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** skipping: [smithi096.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:18.290 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:18.302 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:18.314 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:18.326 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:18.338 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:18.531 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-05T03:46:18.532 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-4c3Jf16fcOxxxdxEXRbZDIvDxhtZHdps8hFWr7M9Wr0bsDE3lseDR0HkDSwda8QA'], u'uuids': [u'eaf12ad5-3f9e-41fb-a882-90094f06092f']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.143113", "end": "2019-12-05 03:46:18.482109", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-4c3Jf16fcOxxxdxEXRbZDIvDxhtZHdps8hFWr7M9Wr0bsDE3lseDR0HkDSwda8QA"], "labels": [], "masters": [], "uuids": ["eaf12ad5-3f9e-41fb-a882-90094f06092f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-05 03:46:18.338996", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.139426 s, 827 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.139426 s, 827 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-05T03:46:18.795 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-4c3Jf16fcOxxxdxEXRbZDIvDxhtZHdps40txjyg9gJR41fjN2Oqb59uLkPiWyRYv'], u'uuids': [u'eab4b3cd-3f12-4e4e-b0d9-c323135936e9']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.151605", "end": "2019-12-05 03:46:18.751792", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-4c3Jf16fcOxxxdxEXRbZDIvDxhtZHdps40txjyg9gJR41fjN2Oqb59uLkPiWyRYv"], "labels": [], "masters": [], "uuids": ["eab4b3cd-3f12-4e4e-b0d9-c323135936e9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-05 03:46:18.600187", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.147342 s, 783 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.147342 s, 783 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-05T03:46:19.088 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-4c3Jf16fcOxxxdxEXRbZDIvDxhtZHdps58IFIOeY0GiiXNMZFLXZNN9bJTcFGTeQ'], u'uuids': [u'72bd013d-8891-4754-b0a7-c40da315fba5']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.157103", "end": "2019-12-05 03:46:19.038652", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-4c3Jf16fcOxxxdxEXRbZDIvDxhtZHdps58IFIOeY0GiiXNMZFLXZNN9bJTcFGTeQ"], "labels": [], "masters": [], "uuids": ["72bd013d-8891-4754-b0a7-c40da315fba5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-05 03:46:18.881549", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.152821 s, 755 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.152821 s, 755 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-05T03:46:19.361 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-4c3Jf16fcOxxxdxEXRbZDIvDxhtZHdpsjhtg79R11dDgsWdNwba3jfHmWa7zzo6u'], u'uuids': [u'dc5f8567-558d-42f9-8eeb-e85d7267c6e5']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.148626", "end": "2019-12-05 03:46:19.309088", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-4c3Jf16fcOxxxdxEXRbZDIvDxhtZHdpsjhtg79R11dDgsWdNwba3jfHmWa7zzo6u"], "labels": [], "masters": [], "uuids": ["dc5f8567-558d-42f9-8eeb-e85d7267c6e5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-05 03:46:19.160462", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.144095 s, 800 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.144095 s, 800 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-05T03:46:19.415 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:19 +0000 (0:00:01.239) 0:02:04.875 ***** 2019-12-05T03:46:19.715 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2019-12-05T03:46:19.716 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.159077", "end": "2019-12-05 03:46:19.664845", "rc": 0, "start": "2019-12-05 03:46:19.505768", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-05T03:46:19.756 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:19 +0000 (0:00:00.340) 0:02:05.216 ***** 2019-12-05T03:46:19.990 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2019-12-05T03:46:19.991 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.068863", "end": "2019-12-05 03:46:19.938320", "rc": 0, "start": "2019-12-05 03:46:19.869457", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-05T03:46:20.050 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:20 +0000 (0:00:00.293) 0:02:05.510 ***** 2019-12-05T03:46:20.077 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2019-12-05T03:46:20.121 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:20 +0000 (0:00:00.071) 0:02:05.581 ***** 2019-12-05T03:46:20.149 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:20.193 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:20 +0000 (0:00:00.071) 0:02:05.652 ***** 2019-12-05T03:46:20.230 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2019-12-05T03:46:20.232 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:20.275 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:20 +0000 (0:00:00.081) 0:02:05.734 ***** 2019-12-05T03:46:20.302 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-12-05T03:46:20.303 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:20.351 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:20 +0000 (0:00:00.075) 0:02:05.810 ***** 2019-12-05T03:46:20.378 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2019-12-05T03:46:20.379 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:20.421 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:20 +0000 (0:00:00.070) 0:02:05.881 ***** 2019-12-05T03:46:20.555 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2019-12-05T03:46:20.746 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} Thursday 05 December 2019 03:46:20 +0000 (0:00:00.175) 0:02:06.057 ***** TASK [testnode : Set root disk] ************************************************ skipping: [smithi158.front.sepia.ceph.com] => (item={u'block_used': 13713665, u'uuid': u'e17a1a1d-4a16-4f42-a170-a33513a36c81', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 226381443, u'size_available': 927258390528, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60905935, u'device': u'/dev/sda1', u'inode_used': 149041, u'block_size': 4096, u'options': u'rw,relatime,errors=remount-ro,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226381443, "block_size": 4096, "block_total": 240095108, "block_used": 13713665, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905935, "inode_total": 61054976, "inode_used": 149041, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927258390528, "size_total": 983429562368, "uuid": "e17a1a1d-4a16-4f42-a170-a33513a36c81"}, "skip_reason": "Conditional result was False"} Thursday 05 December 2019 03:46:20 +0000 (0:00:00.079) 0:02:06.137 ***** TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi096.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-i0033s-8cd6-G9fa-o1qU-MbeZ-45Ks-ENcRKi', u'nvme-INTEL_SSDPEDMD400G4_PHFT620400NH400BGN', u'nvme-nvme.8086-504846543632303430304e4834303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size' 2019-12-05T03:46:20.747 INFO:teuthology.task.ansible.out:: u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:02.233333", "end": "2019-12-05 03:46:20.716199", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-i0033s-8cd6-G9fa-o1qU-MbeZ-45Ks-ENcRKi", "nvme-INTEL_SSDPEDMD400G4_PHFT620400NH400BGN", "nvme-nvme.8086-504846543632303430304e4834303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-05 03:46:18.482866", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Thursday 05 December 2019 03:46:20 +0000 (0:00:00.067) 0:02:06.204 ***** 2019-12-05T03:46:20.787 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-05T03:46:20.789 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:20.829 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:20 +0000 (0:00:00.084) 0:02:06.289 ***** 2019-12-05T03:46:20.867 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-05T03:46:20.869 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:20.920 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:20 +0000 (0:00:00.090) 0:02:06.379 ***** 2019-12-05T03:46:20.964 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:21.016 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:21 +0000 (0:00:00.096) 0:02:06.476 ***** 2019-12-05T03:46:21.053 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2019-12-05T03:46:21.055 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:21.106 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:21 +0000 (0:00:00.090) 0:02:06.566 ***** 2019-12-05T03:46:21.134 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2019-12-05T03:46:21.136 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:21.188 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:21 +0000 (0:00:00.081) 0:02:06.647 ***** 2019-12-05T03:46:21.806 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2019-12-05T03:46:21.808 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2019-12-05T03:46:21.848 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:21 +0000 (0:00:00.660) 0:02:07.307 ***** 2019-12-05T03:46:22.001 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-05T03:46:22.002 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-CctiNheGjDVOmEKQORXVaH7tYsSmk3JxkPyzoLz9KYjV51sjMuiHIwkHctywnuIB'], u'uuids': [u'1a30e6dc-e96f-4bf1-8299-9a9421a514a5']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.150423", "end": "2019-12-05 03:46:22.009071", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-CctiNheGjDVOmEKQORXVaH7tYsSmk3JxkPyzoLz9KYjV51sjMuiHIwkHctywnuIB"], "labels": [], "masters": [], "uuids": ["1a30e6dc-e96f-4bf1-8299-9a9421a514a5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-05 03:46:20.858648", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-05T03:46:22.424 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi158.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-05T03:46:22.654 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-05T03:46:22.911 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-05T03:46:23.162 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-05T03:46:23.248 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-05T03:46:23.250 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-CctiNheGjDVOmEKQORXVaH7tYsSmk3JxULcHelBzIATiqbDiacEjZRdbjF5algpO'], u'uuids': [u'59465598-a9ea-426f-a370-f96e791d0d12']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.127993", "end": "2019-12-05 03:46:23.256965", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-CctiNheGjDVOmEKQORXVaH7tYsSmk3JxULcHelBzIATiqbDiacEjZRdbjF5algpO"], "labels": [], "masters": [], "uuids": ["59465598-a9ea-426f-a370-f96e791d0d12"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-05 03:46:22.128972", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-05T03:46:23.419 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-12-05T03:46:23.421 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-05T03:46:23.464 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:23 +0000 (0:00:01.616) 0:02:08.924 ***** 2019-12-05T03:46:23.617 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-12-05T03:46:23.618 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2019-12-05T03:46:23.658 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:23 +0000 (0:00:00.194) 0:02:09.118 ***** 2019-12-05T03:46:23.696 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-12-05T03:46:23.700 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:23.852 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-05T03:46:23.981 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-05T03:46:24.112 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-05T03:46:24.227 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-05T03:46:24.277 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:24 +0000 (0:00:00.613) 0:02:09.731 ***** 2019-12-05T03:46:24.419 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2019-12-05T03:46:24.421 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2019-12-05T03:46:24.470 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:24 +0000 (0:00:00.197) 0:02:09.929 ***** 2019-12-05T03:46:24.512 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [smithi158.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2019-12-05T03:46:24.551 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:24 +0000 (0:00:00.080) 0:02:10.010 ***** 2019-12-05T03:46:24.560 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi096.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-CctiNheGjDVOmEKQORXVaH7tYsSmk3JxmEG0mEK70lKcsxdAF4e72lPj73z0Zah2'], u'uuids': [u'929304af-8106-4e25-840b-ab390836e817']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.137472", "end": "2019-12-05 03:46:24.557125", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-CctiNheGjDVOmEKQORXVaH7tYsSmk3JxmEG0mEK70lKcsxdAF4e72lPj73z0Zah2"], "labels": [], "masters": [], "uuids": ["929304af-8106-4e25-840b-ab390836e817"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-05 03:46:23.419653", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! 2019-12-05T03:46:24.562 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or", "other utilities."]} 2019-12-05T03:46:25.073 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi158.front.sepia.ceph.com] => {"changed": true} 2019-12-05T03:46:25.130 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:25 +0000 (0:00:00.579) 0:02:10.590 ***** 2019-12-05T03:46:25.132 INFO:teuthology.task.ansible.out: 2019-12-05T03:46:25.666 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2019-12-05T03:46:25.667 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2019-12-05T03:46:25.718 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:25 +0000 (0:00:00.587) 0:02:11.177 ***** 2019-12-05T03:46:25.884 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "gid": 1216, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2019-12-05T03:46:25.934 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:25 +0000 (0:00:00.216) 0:02:11.394 ***** 2019-12-05T03:46:26.014 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-05T03:46:26.015 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-CctiNheGjDVOmEKQORXVaH7tYsSmk3JxDOhCIStzGZdUuNfrpXW6JWlHRY76waKa'], u'uuids': [u'60b1ddea-a3a2-460c-af6b-47123122f395']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.336754", "end": "2019-12-05 03:46:26.015348", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-CctiNheGjDVOmEKQORXVaH7tYsSmk3JxDOhCIStzGZdUuNfrpXW6JWlHRY76waKa"], "labels": [], "masters": [], "uuids": ["60b1ddea-a3a2-460c-af6b-47123122f395"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-05 03:46:24.678594", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-05T03:46:26.080 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2019-12-05T03:46:26.080 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2019-12-05T03:46:26.150 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:26 +0000 (0:00:00.215) 0:02:11.609 ***** 2019-12-05T03:46:26.524 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1216, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2019-12-05T03:46:26.575 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:26 +0000 (0:00:00.425) 0:02:12.034 ***** 2019-12-05T03:46:26.977 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2019-12-05T03:46:27.017 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:27 +0000 (0:00:00.442) 0:02:12.476 ***** 2019-12-05T03:46:27.326 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-05T03:46:27.327 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-CctiNheGjDVOmEKQORXVaH7tYsSmk3Jx4aGvvCqR5x5IMKmChdjtfhnSdgIDMzYu'], u'uuids': [u'59225384-37b2-440d-8f5d-532c69c3a136']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.140987", "end": "2019-12-05 03:46:27.315918", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-CctiNheGjDVOmEKQORXVaH7tYsSmk3Jx4aGvvCqR5x5IMKmChdjtfhnSdgIDMzYu"], "labels": [], "masters": [], "uuids": ["59225384-37b2-440d-8f5d-532c69c3a136"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-05 03:46:26.174931", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-05T03:46:27.394 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:27 +0000 (0:00:00.377) 0:02:12.854 ***** 2019-12-05T03:46:27.445 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-05T03:46:27.447 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QGMP', u'wwn-0x5000c50091dfbebc'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5QGMP', u'wwn': u'0x5000c50091dfbebc', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'cfq', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'e17a1a1d-4a16-4f42-a170-a33513a36c81', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QGMP-part1', u'wwn-0x5000c50091dfbebc-part1'], u'uuids': [u'e17a1a1d-4a16-4f42-a170-a33513a36c81']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QGMP", "wwn-0x5000c50091dfbebc"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QGMP-part1", "wwn-0x5000c50091dfbebc-part1"], "labels": [], "masters": [], "uuids": ["e17a1a1d-4a16-4f42-a170-a33513a36c81"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "e17a1a1d-4a16-4f42-a170-a33513a36c81"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QGMP", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "vir 2019-12-05T03:46:27.449 INFO:teuthology.task.ansible.out:tual": 1, "wwn": "0x5000c50091dfbebc"}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:27.463 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:27.465 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:27.478 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:27.480 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:27.494 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:27.506 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:27.508 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:27.520 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:27.794 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-i0033s-8cd6-G9fa-o1qU-MbeZ-45Ks-ENcRKi', u'nvme-INTEL_SSDPEDMD400G4_PHFT620400NH400BGN', u'nvme-nvme.8086-504846543632303430304e4834303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.141422", "end": "2019-12-05 03:46:27.802332", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-i0033s-8cd6-G9fa-o1qU-MbeZ-45Ks-ENcRKi", "nvme-INTEL_SSDPEDMD400G4_PHFT620400NH400BGN", "nvme-nvme.8086-504846543632303430304e4834303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-05 03:46:27.660910", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 11 2019-12-05T03:46:27.796 INFO:teuthology.task.ansible.out:0 MiB) copied, 0.0402077 s, 2.9 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0402077 s, 2.9 GB/s"], "stdout": "", "stdout_lines": []} 2019-12-05T03:46:27.990 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2019-12-05T03:46:27.991 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"cache_update_time": 1575517232, "cache_updated": false, "changed": false} 2019-12-05T03:46:28.052 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:28 +0000 (0:00:00.657) 0:02:13.512 ***** 2019-12-05T03:46:28.071 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-05T03:46:28.073 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-CctiNheGjDVOmEKQORXVaH7tYsSmk3JxkPyzoLz9KYjV51sjMuiHIwkHctywnuIB'], u'uuids': [u'1a30e6dc-e96f-4bf1-8299-9a9421a514a5']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.148303", "end": "2019-12-05 03:46:28.086413", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-CctiNheGjDVOmEKQORXVaH7tYsSmk3JxkPyzoLz9KYjV51sjMuiHIwkHctywnuIB"], "labels": [], "masters": [], "uuids": ["1a30e6dc-e96f-4bf1-8299-9a9421a514a5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-05 03:46:27.938110", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.145637 s, 792 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.145637 s, 792 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-05T03:46:28.260 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2019-12-05T03:46:28.262 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.046085", "end": "2019-12-05 03:46:28.210726", "rc": 0, "start": "2019-12-05 03:46:28.164641", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2019-12-05T03:46:28.312 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:28 +0000 (0:00:00.260) 0:02:13.772 ***** 2019-12-05T03:46:28.350 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2019-12-05T03:46:28.352 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:28.432 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:28 +0000 (0:00:00.119) 0:02:13.892 ***** 2019-12-05T03:46:28.434 INFO:teuthology.task.ansible.out: 2019-12-05T03:46:28.439 INFO:teuthology.task.ansible.out: 2019-12-05T03:46:28.441 INFO:teuthology.task.ansible.out:TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-05T03:46:28.443 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-CctiNheGjDVOmEKQORXVaH7tYsSmk3JxULcHelBzIATiqbDiacEjZRdbjF5algpO'], u'uuids': [u'59465598-a9ea-426f-a370-f96e791d0d12']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.153051", "end": "2019-12-05 03:46:28.379103", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-CctiNheGjDVOmEKQORXVaH7tYsSmk3JxULcHelBzIATiqbDiacEjZRdbjF5algpO"], "labels": [], "masters": [], "uuids": ["59465598-a9ea-426f-a370-f96e7 2019-12-05T03:46:28.444 INFO:teuthology.task.ansible.out:91d0d12"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-05 03:46:28.226052", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.148269 s, 778 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.148269 s, 778 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-05T03:46:28.466 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2019-12-05T03:46:28.467 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:28.509 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:28 +0000 (0:00:00.076) 0:02:13.968 ***** 2019-12-05T03:46:28.676 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-05T03:46:28.677 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-CctiNheGjDVOmEKQORXVaH7tYsSmk3JxmEG0mEK70lKcsxdAF4e72lPj73z0Zah2'], u'uuids': [u'929304af-8106-4e25-840b-ab390836e817']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.159347", "end": "2019-12-05 03:46:28.688652", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-CctiNheGjDVOmEKQORXVaH7tYsSmk3JxmEG0mEK70lKcsxdAF4e72lPj73z0Zah2"], "labels": [], "masters": [], "uuids": ["929304af-8106-4e25-840b-ab390836e817"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-05 03:46:28.529305", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.156656 s, 736 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.156656 s, 736 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-05T03:46:28.974 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-CctiNheGjDVOmEKQORXVaH7tYsSmk3JxDOhCIStzGZdUuNfrpXW6JWlHRY76waKa'], u'uuids': [u'60b1ddea-a3a2-460c-af6b-47123122f395']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.153264", "end": "2019-12-05 03:46:28.979498", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-CctiNheGjDVOmEKQORXVaH7tYsSmk3JxDOhCIStzGZdUuNfrpXW6JWlHRY76waKa"], "labels": [], "masters": [], "uuids": ["60b1ddea-a3a2-460c-af6b-47123122f395"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-05 03:46:28.826234", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.150378 s, 767 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.150378 s, 767 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-05T03:46:29.249 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-CctiNheGjDVOmEKQORXVaH7tYsSmk3Jx4aGvvCqR5x5IMKmChdjtfhnSdgIDMzYu'], u'uuids': [u'59225384-37b2-440d-8f5d-532c69c3a136']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.148542", "end": "2019-12-05 03:46:29.246004", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-CctiNheGjDVOmEKQORXVaH7tYsSmk3Jx4aGvvCqR5x5IMKmChdjtfhnSdgIDMzYu"], "labels": [], "masters": [], "uuids": ["59225384-37b2-440d-8f5d-532c69c3a136"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-05 03:46:29.097462", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.144439 s, 799 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.144439 s, 799 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-05T03:46:29.309 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:29 +0000 (0:00:00.799) 0:02:14.768 ***** 2019-12-05T03:46:29.359 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2019-12-05T03:46:29.360 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"cache_update_time": 1575517232, "cache_updated": false, "changed": false} 2019-12-05T03:46:29.407 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:29 +0000 (0:00:00.097) 0:02:14.866 ***** 2019-12-05T03:46:29.456 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2019-12-05T03:46:29.457 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:29.502 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:29 +0000 (0:00:00.095) 0:02:14.962 ***** 2019-12-05T03:46:29.571 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2019-12-05T03:46:29.573 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.127950", "end": "2019-12-05 03:46:29.583893", "rc": 0, "start": "2019-12-05 03:46:29.455943", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-05T03:46:29.623 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:29 +0000 (0:00:00.120) 0:02:15.083 ***** 2019-12-05T03:46:29.802 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2019-12-05T03:46:29.804 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.045051", "end": "2019-12-05 03:46:29.823693", "rc": 0, "start": "2019-12-05 03:46:29.778642", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-05T03:46:29.849 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:29 +0000 (0:00:00.226) 0:02:15.309 ***** 2019-12-05T03:46:29.864 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2019-12-05T03:46:29.901 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:29 +0000 (0:00:00.051) 0:02:15.361 ***** 2019-12-05T03:46:29.906 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2019-12-05T03:46:29.951 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:29 +0000 (0:00:00.050) 0:02:15.411 ***** 2019-12-05T03:46:29.957 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2019-12-05T03:46:29.959 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:30.006 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:30 +0000 (0:00:00.054) 0:02:15.465 ***** 2019-12-05T03:46:30.013 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2019-12-05T03:46:30.013 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:30.064 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:30 +0000 (0:00:00.058) 0:02:15.524 ***** 2019-12-05T03:46:30.113 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2019-12-05T03:46:30.114 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:30.152 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:30 +0000 (0:00:00.088) 0:02:15.612 ***** 2019-12-05T03:46:30.190 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-12-05T03:46:30.200 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:30.245 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:30 +0000 (0:00:00.092) 0:02:15.705 ***** 2019-12-05T03:46:30.253 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2019-12-05T03:46:30.256 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2019-12-05 03:43:57 UTC", "ActiveEnterTimestampMonotonic": "27486091", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount system.slice sysinit.target basic.target systemd-journald.socket network.target systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2019-12-05 03:43:48 UTC", "AssertTimestampMonotonic": "19136100", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2019-12-05 03:43:48 UTC", "ConditionTimestampMonotonic": "19136099", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2019-12-05T03:46:30.257 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1820", "ExecMainStartTimestamp": "Thu 2019-12-05 03:43:57 UTC", "ExecMainStartTimestampMonotonic": "27486063", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2019-12-05 03:43:48 UTC", "InactiveExitTimestampMonotonic": "19137005", "InvocationID": "dcc90839009b44848fb664f609109f93", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128035", "LimitNPROCSoft": "128035", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limi 2019-12-05T03:46:30.259 INFO:teuthology.task.ansible.out:tRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128035", "LimitSIGPENDINGSoft": "128035", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1820", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2019-12-05 03:43:57 UTC", "StateChangeTimestampMonoton 2019-12-05T03:46:30.261 INFO:teuthology.task.ansible.out:ic": "27486091", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2019-12-05 03:43:57 UTC", "WatchdogTimestampMonotonic": "27486090", "WatchdogUSec": "0"}} 2019-12-05T03:46:30.301 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:30 +0000 (0:00:00.056) 0:02:15.761 ***** 2019-12-05T03:46:30.307 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2019-12-05T03:46:30.309 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:30.351 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:30 +0000 (0:00:00.049) 0:02:15.811 ***** 2019-12-05T03:46:30.358 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2019-12-05T03:46:30.360 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:30.402 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:30 +0000 (0:00:00.050) 0:02:15.861 ***** 2019-12-05T03:46:30.484 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2019-12-05T03:46:30.485 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-05T03:46:30.533 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:30 +0000 (0:00:00.131) 0:02:15.993 ***** 2019-12-05T03:46:30.573 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-12-05T03:46:30.574 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={u'block_used': 13713665, u'uuid': u'e17a1a1d-4a16-4f42-a170-a33513a36c81', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 226381443, u'size_available': 927258390528, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60905935, u'device': u'/dev/sda1', u'inode_used': 149041, u'block_size': 4096, u'options': u'rw,relatime,errors=remount-ro,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226381443, "block_size": 4096, "block_total": 240095108, "block_used": 13713665, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905935, "inode_total": 61054976, "inode_used": 149041, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927258390528, "size_total": 983429562368, "uuid": "e17a1a1d-4a16-4f42-a170-a33513a36c81"}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:30.625 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:30 +0000 (0:00:00.091) 0:02:16.085 ***** 2019-12-05T03:46:30.652 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2019-12-05T03:46:30.656 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:30.703 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:30 +0000 (0:00:00.077) 0:02:16.162 ***** 2019-12-05T03:46:30.730 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-05T03:46:30.731 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:30.796 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:30 +0000 (0:00:00.086) 0:02:16.248 ***** 2019-12-05T03:46:30.827 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-05T03:46:30.829 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:30.880 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:30 +0000 (0:00:00.091) 0:02:16.340 ***** 2019-12-05T03:46:30.908 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2019-12-05T03:46:30.910 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:30.954 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:30 +0000 (0:00:00.073) 0:02:16.413 ***** 2019-12-05T03:46:30.991 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2019-12-05T03:46:30.993 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:31.044 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:31 +0000 (0:00:00.083) 0:02:16.497 ***** 2019-12-05T03:46:31.077 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2019-12-05T03:46:31.079 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:31.120 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:31 +0000 (0:00:00.082) 0:02:16.580 ***** 2019-12-05T03:46:31.287 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2019-12-05T03:46:31.289 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"cache_update_time": 1575517232, "cache_updated": false, "changed": false} 2019-12-05T03:46:31.335 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:31 +0000 (0:00:00.214) 0:02:16.795 ***** 2019-12-05T03:46:31.487 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2019-12-05T03:46:31.489 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "gid": 1216, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2019-12-05T03:46:31.490 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** changed: [smithi096.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2019-12-05T03:46:31.536 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:31 +0000 (0:00:00.200) 0:02:16.995 ***** 2019-12-05T03:46:31.578 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:31 +0000 (0:00:00.041) 0:02:17.037 ***** 2019-12-05T03:46:31.788 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-12-05T03:46:31.790 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-05T03:46:31.936 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2019-12-05T03:46:31.938 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1216, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2019-12-05T03:46:31.976 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:31 +0000 (0:00:00.398) 0:02:17.436 ***** 2019-12-05T03:46:32.026 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-12-05T03:46:32.028 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-05T03:46:32.282 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-05T03:46:32.568 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-05T03:46:32.782 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-05T03:46:32.850 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:32 +0000 (0:00:00.873) 0:02:18.309 ***** 2019-12-05T03:46:32.996 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-12-05T03:46:32.997 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2019-12-05T03:46:33.036 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:33 +0000 (0:00:00.186) 0:02:18.496 ***** 2019-12-05T03:46:33.042 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2019-12-05T03:46:33.043 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2019-12-05T03:46:33.094 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:33 +0000 (0:00:00.057) 0:02:18.553 ***** 2019-12-05T03:46:33.101 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-12-05T03:46:33.102 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:33.224 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-05T03:46:33.356 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-05T03:46:33.480 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-05T03:46:33.590 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2019-12-05T03:46:33.592 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false} 2019-12-05T03:46:33.635 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:33 +0000 (0:00:00.541) 0:02:19.095 ***** 2019-12-05T03:46:33.642 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-12-05T03:46:33.643 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-05T03:46:33.691 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:33 +0000 (0:00:00.055) 0:02:19.150 ***** 2019-12-05T03:46:33.698 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2019-12-05T03:46:33.699 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2019-12-05T03:46:33.742 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:33 +0000 (0:00:00.051) 0:02:19.202 ***** 2019-12-05T03:46:33.845 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2019-12-05T03:46:33.846 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2019-12-05T03:46:33.891 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:33 +0000 (0:00:00.148) 0:02:19.350 ***** 2019-12-05T03:46:33.910 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2019-12-05T03:46:33.911 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1575517198.2246351, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1575517198.2206352, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 68551, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1575517198.2206352, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1369884456", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2019-12-05T03:46:33.958 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:33 +0000 (0:00:00.066) 0:02:19.417 ***** 2019-12-05T03:46:33.965 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2019-12-05T03:46:33.967 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2019-12-05T03:46:34.018 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:34 +0000 (0:00:00.060) 0:02:19.478 ***** 2019-12-05T03:46:34.243 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2019-12-05T03:46:34.245 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => {"changed": true} 2019-12-05T03:46:34.294 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:34 +0000 (0:00:00.275) 0:02:19.754 ***** 2019-12-05T03:46:34.376 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2019-12-05T03:46:34.378 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2019-12-05T03:46:34.432 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:34 +0000 (0:00:00.137) 0:02:19.891 ***** 2019-12-05T03:46:34.470 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2019-12-05T03:46:34.472 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2019-12-05T03:46:34.511 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:34 +0000 (0:00:00.079) 0:02:19.971 ***** 2019-12-05T03:46:34.536 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2019-12-05T03:46:34.537 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2019-12-05T03:46:34.578 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:34 +0000 (0:00:00.065) 0:02:20.037 ***** 2019-12-05T03:46:34.584 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2019-12-05T03:46:34.585 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:34.626 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:34 +0000 (0:00:00.048) 0:02:20.085 ***** 2019-12-05T03:46:34.721 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2019-12-05T03:46:34.722 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "gid": 1216, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2019-12-05T03:46:34.766 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:34 +0000 (0:00:00.140) 0:02:20.226 ***** 2019-12-05T03:46:34.773 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2019-12-05T03:46:34.775 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-12-05T03:46:34.816 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:34 +0000 (0:00:00.049) 0:02:20.275 ***** 2019-12-05T03:46:34.898 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2019-12-05T03:46:34.898 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2019-12-05T03:46:34.940 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:34 +0000 (0:00:00.124) 0:02:20.400 ***** 2019-12-05T03:46:34.946 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2019-12-05T03:46:34.947 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2019-12-05T03:46:34.989 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:34 +0000 (0:00:00.048) 0:02:20.448 ***** 2019-12-05T03:46:35.016 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2019-12-05T03:46:35.017 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:35.071 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:35 +0000 (0:00:00.082) 0:02:20.531 ***** 2019-12-05T03:46:35.109 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2019-12-05T03:46:35.110 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2019-12-05T03:46:35.112 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi158.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2019-12-05T03:46:35.133 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2019-12-05T03:46:35.144 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2019-12-05T03:46:35.193 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:35 +0000 (0:00:00.121) 0:02:20.653 ***** 2019-12-05T03:46:35.230 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2019-12-05T03:46:35.231 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:35.242 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:35.254 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:35.265 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:35.277 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:35.324 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:35 +0000 (0:00:00.130) 0:02:20.783 ***** 2019-12-05T03:46:35.332 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2019-12-05T03:46:35.333 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1216, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2019-12-05T03:46:35.379 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:35 +0000 (0:00:00.055) 0:02:20.839 ***** 2019-12-05T03:46:35.386 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:35.437 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:35 +0000 (0:00:00.058) 0:02:20.897 ***** 2019-12-05T03:46:35.470 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:35.512 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:35 +0000 (0:00:00.074) 0:02:20.971 ***** 2019-12-05T03:46:35.549 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2019-12-05T03:46:35.550 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:35.608 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:35 +0000 (0:00:00.096) 0:02:21.068 ***** 2019-12-05T03:46:35.638 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:35.680 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:35 +0000 (0:00:00.071) 0:02:21.139 ***** 2019-12-05T03:46:35.717 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2019-12-05T03:46:35.719 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:35.768 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:35 +0000 (0:00:00.088) 0:02:21.228 ***** 2019-12-05T03:46:35.775 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2019-12-05T03:46:35.776 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2019-12-05T03:46:35.823 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:35 +0000 (0:00:00.054) 0:02:21.283 ***** 2019-12-05T03:46:35.830 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-12-05T03:46:35.832 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:35.886 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:35 +0000 (0:00:00.062) 0:02:21.346 ***** 2019-12-05T03:46:35.912 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2019-12-05T03:46:35.914 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:35.955 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:35 +0000 (0:00:00.069) 0:02:21.415 ***** 2019-12-05T03:46:35.982 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-12-05T03:46:35.983 INFO:teuthology.task.ansible.out:skipping: [smithi158.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:36.021 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:36 +0000 (0:00:00.066) 0:02:21.481 ***** 2019-12-05T03:46:36.193 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-12-05T03:46:36.194 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.011292", "end": "2019-12-05 03:46:36.124691", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2019-12-05 03:46:36.113399", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-05T03:46:36.320 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006186", "end": "2019-12-05 03:46:36.259760", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2019-12-05 03:46:36.253574", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-05T03:46:36.435 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005450", "end": "2019-12-05 03:46:36.387701", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2019-12-05 03:46:36.382251", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2019-12-05T03:46:36.568 INFO:teuthology.task.ansible.out:ok: [smithi158.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.007784", "end": "2019-12-05 03:46:36.507506", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2019-12-05 03:46:36.499722", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-05T03:46:36.614 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:36 +0000 (0:00:00.592) 0:02:22.073 ***** 2019-12-05T03:46:36.640 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2019-12-05T03:46:36.689 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:36 +0000 (0:00:00.074) 0:02:22.148 ***** 2019-12-05T03:46:36.821 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2019-12-05T03:46:36.823 INFO:teuthology.task.ansible.out:changed: [smithi158.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** ok: [smithi096.front.sepia.ceph.com] => {"cache_update_time": 1575517274, "cache_updated": false, "changed": false} 2019-12-05T03:46:36.864 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:36 +0000 (0:00:00.175) 0:02:22.323 ***** 2019-12-05T03:46:37.053 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2019-12-05T03:46:37.055 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.046682", "end": "2019-12-05 03:46:37.065707", "rc": 0, "start": "2019-12-05 03:46:37.019025", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2019-12-05T03:46:37.091 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:37 +0000 (0:00:00.227) 0:02:22.551 ***** 2019-12-05T03:46:37.118 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2019-12-05T03:46:37.119 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:37.160 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:37 +0000 (0:00:00.068) 0:02:22.619 ***** 2019-12-05T03:46:37.196 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2019-12-05T03:46:37.198 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:37.237 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:37 +0000 (0:00:00.077) 0:02:22.697 ***** 2019-12-05T03:46:38.114 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2019-12-05T03:46:38.115 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"cache_update_time": 1575517274, "cache_updated": false, "changed": false} 2019-12-05T03:46:38.171 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:38 +0000 (0:00:00.933) 0:02:23.630 ***** 2019-12-05T03:46:38.202 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:38.239 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:38 +0000 (0:00:00.068) 0:02:23.699 ***** 2019-12-05T03:46:38.623 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2019-12-05T03:46:38.626 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2019-12-05T03:46:38.686 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:38 +0000 (0:00:00.446) 0:02:24.145 ***** 2019-12-05T03:46:38.712 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2019-12-05T03:46:38.714 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:38.759 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:38 +0000 (0:00:00.073) 0:02:24.218 ***** 2019-12-05T03:46:38.980 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2019-12-05 03:44:13 UTC", "ActiveEnterTimestampMonotonic": "28413068", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target systemd-tmpfiles-setup.service systemd-journald.socket system.slice network.target -.mount sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2019-12-05 03:44:04 UTC", "AssertTimestampMonotonic": "20064295", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2019-12-05 03:44:04 UTC", "ConditionTimestampMonotonic": "20064295", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Dele 2019-12-05T03:46:38.982 INFO:teuthology.task.ansible.out:gate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1864", "ExecMainStartTimestamp": "Thu 2019-12-05 03:44:13 UTC", "ExecMainStartTimestampMonotonic": "28413020", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2019-12-05 03:44:04 UTC", "InactiveExitTimestampMonotonic": "20064983", "InvocationID": "06bd9246c8ac415a93b34e331d704e8a", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128035", "LimitNPROCSoft": "128035", "LimitRSS": "infi 2019-12-05T03:46:38.984 INFO:teuthology.task.ansible.out:nity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128035", "LimitSIGPENDINGSoft": "128035", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1864", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", 2019-12-05T03:46:38.987 INFO:teuthology.task.ansible.out: "StateChangeTimestamp": "Thu 2019-12-05 03:44:13 UTC", "StateChangeTimestampMonotonic": "28413068", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2019-12-05 03:44:13 UTC", "WatchdogTimestampMonotonic": "28413065", "WatchdogUSec": "0"}} 2019-12-05T03:46:39.021 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:39 +0000 (0:00:00.262) 0:02:24.480 ***** 2019-12-05T03:46:39.058 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:39.102 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:39 +0000 (0:00:00.081) 0:02:24.562 ***** 2019-12-05T03:46:39.994 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2019-12-05T03:46:39.996 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"cache_update_time": 1575517274, "cache_updated": false, "changed": false} 2019-12-05T03:46:40.036 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:40 +0000 (0:00:00.934) 0:02:25.496 ***** 2019-12-05T03:46:40.168 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2019-12-05T03:46:40.168 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "gid": 1216, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2019-12-05T03:46:40.209 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:40 +0000 (0:00:00.172) 0:02:25.669 ***** 2019-12-05T03:46:40.567 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2019-12-05T03:46:40.569 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1216, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2019-12-05T03:46:40.609 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:40 +0000 (0:00:00.399) 0:02:26.069 ***** 2019-12-05T03:46:41.381 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2019-12-05T03:46:41.382 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2019-12-05T03:46:41.422 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:41 +0000 (0:00:00.813) 0:02:26.882 ***** 2019-12-05T03:46:41.898 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2019-12-05T03:46:41.899 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false} 2019-12-05T03:46:41.953 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:41 +0000 (0:00:00.527) 0:02:27.410 ***** 2019-12-05T03:46:41.980 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2019-12-05T03:46:41.981 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2019-12-05T03:46:42.026 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:42 +0000 (0:00:00.076) 0:02:27.486 ***** 2019-12-05T03:46:42.179 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2019-12-05T03:46:42.180 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1575517210.8914702, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1575517210.8874702, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 68551, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1575517210.8874702, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1369884456", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2019-12-05T03:46:42.226 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:42 +0000 (0:00:00.199) 0:02:27.685 ***** 2019-12-05T03:46:42.369 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2019-12-05T03:46:42.371 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2019-12-05T03:46:42.412 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:42 +0000 (0:00:00.186) 0:02:27.872 ***** 2019-12-05T03:46:42.439 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2019-12-05T03:46:42.440 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2019-12-05T03:46:42.490 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:42 +0000 (0:00:00.077) 0:02:27.949 ***** 2019-12-05T03:46:42.519 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:42.574 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:42 +0000 (0:00:00.084) 0:02:28.034 ***** 2019-12-05T03:46:42.717 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2019-12-05T03:46:42.719 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-12-05T03:46:42.773 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:42 +0000 (0:00:00.198) 0:02:28.233 ***** 2019-12-05T03:46:42.919 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi096.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2019-12-05T03:46:42.968 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:42 +0000 (0:00:00.194) 0:02:28.427 ***** 2019-12-05T03:46:42.996 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:43.048 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:43 +0000 (0:00:00.080) 0:02:28.508 ***** 2019-12-05T03:46:43.086 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2019-12-05T03:46:43.087 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2019-12-05T03:46:43.098 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2019-12-05T03:46:43.099 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2019-12-05T03:46:43.100 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2019-12-05T03:46:43.148 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:43 +0000 (0:00:00.100) 0:02:28.608 ***** 2019-12-05T03:46:43.185 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2019-12-05T03:46:43.187 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:43.198 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:43.199 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:43.210 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:43.222 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:43.268 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:43 +0000 (0:00:00.120) 0:02:28.728 ***** 2019-12-05T03:46:43.295 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-05T03:46:43.302 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:43.338 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:43 +0000 (0:00:00.070) 0:02:28.798 ***** 2019-12-05T03:46:43.365 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2019-12-05T03:46:43.367 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:43.405 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:43 +0000 (0:00:00.066) 0:02:28.864 ***** 2019-12-05T03:46:43.431 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2019-12-05T03:46:43.433 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:43.475 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:43 +0000 (0:00:00.070) 0:02:28.934 ***** 2019-12-05T03:46:43.504 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:43.567 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:43 +0000 (0:00:00.090) 0:02:29.025 ***** 2019-12-05T03:46:43.596 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2019-12-05T03:46:43.598 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:43.691 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:43 +0000 (0:00:00.125) 0:02:29.151 ***** 2019-12-05T03:46:43.718 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-12-05T03:46:43.719 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:43.766 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:43 +0000 (0:00:00.075) 0:02:29.226 ***** 2019-12-05T03:46:43.794 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2019-12-05T03:46:43.796 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:43.857 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:43 +0000 (0:00:00.090) 0:02:29.316 ***** 2019-12-05T03:46:43.884 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-12-05T03:46:43.886 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-05T03:46:43.947 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:43 +0000 (0:00:00.089) 0:02:29.406 ***** 2019-12-05T03:46:44.123 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-12-05T03:46:44.124 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010171", "end": "2019-12-05 03:46:44.117673", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2019-12-05 03:46:44.107502", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-05T03:46:44.252 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006098", "end": "2019-12-05 03:46:44.247147", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2019-12-05 03:46:44.241049", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-05T03:46:44.375 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.004566", "end": "2019-12-05 03:46:44.375750", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2019-12-05 03:46:44.371184", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2019-12-05T03:46:44.506 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.007101", "end": "2019-12-05 03:46:44.502313", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2019-12-05 03:46:44.495212", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-05T03:46:44.569 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:44 +0000 (0:00:00.622) 0:02:30.029 ***** 2019-12-05T03:46:44.597 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2019-12-05T03:46:44.636 INFO:teuthology.task.ansible.out:Thursday 05 December 2019 03:46:44 +0000 (0:00:00.066) 0:02:30.096 ***** 2019-12-05T03:46:44.762 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2019-12-05T03:46:44.763 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2019-12-05T03:46:44.886 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2019-12-05T03:46:44.889 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2019-12-05T03:46:44.892 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2019-12-05T03:46:44.897 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* smithi096.front.sepia.ceph.com : ok=113 changed=32 unreachable=0 failed=0 skipped=167 rescued=0 ignored=0 smithi158.front.sepia.ceph.com : ok=113 changed=32 unreachable=0 failed=0 skipped=167 rescued=0 ignored=0 Thursday 05 December 2019 03:46:44 +0000 (0:00:00.256) 0:02:30.352 ***** =============================================================================== users : Create all admin users with sudo access. ----------------------- 15.87s users : Update authorized_keys using the keys repo ---------------------- 4.64s Gathering Facts --------------------------------------------------------- 2.80s testnode : Update apt cache. -------------------------------------------- 2.17s testnode : Install apt keys --------------------------------------------- 2.13s ansible-managed : Add authorized keys for the ansible user. ------------- 1.54s testnode : Zap all non-root disks --------------------------------------- 1.24s testnode : Install python-apt ------------------------------------------- 0.96s testnode : Make sure apt dependencies are installed --------------------- 0.95s testnode : Install non aarch64 packages --------------------------------- 0.94s testnode : Install python-pip on apt based systems. --------------------- 0.93s testnode : Install ntp package on apt based systems. -------------------- 0.93s common : Install Kerberos Packages (Debian) ----------------------------- 0.83s testnode : Install packages via pip ------------------------------------- 0.81s Gathering Facts --------------------------------------------------------- 0.78s users : Clone the keys repo --------------------------------------------- 0.74s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 0.74s testnode : Blow away lingering OSD data and FSIDs ----------------------- 0.66s testnode : List any leftover Ceph artifacts fr 2019-12-05T03:46:44.898 INFO:teuthology.task.ansible.out:om previous jobs ---------- 0.62s testnode : Add ssh pubkeys ---------------------------------------------- 0.55s 2019-12-05T03:46:45.205 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi158.front.sepia.ceph.com'), Remote(name='ubuntu@smithi096.front.sepia.ceph.com')] 2019-12-05T03:46:45.207 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-05T03:46:45.208 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi158.front.sepia.ceph.com', 'timeout': 60} 2019-12-05T03:46:45.294 INFO:teuthology.orchestra.run.smithi158:> true 2019-12-05T03:46:45.501 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-05T03:46:45.501 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi096.front.sepia.ceph.com', 'timeout': 60} 2019-12-05T03:46:45.585 INFO:teuthology.orchestra.run.smithi096:> true 2019-12-05T03:46:45.790 INFO:teuthology.run_tasks:Running task clock... 2019-12-05T03:46:45.805 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2019-12-05T03:46:45.805 INFO:teuthology.orchestra.run.smithi158:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-12-05T03:46:45.867 INFO:teuthology.orchestra.run.smithi158.stdout: 5 Dec 03:46:45 ntpd[7671]: ntpd 4.2.8p10@1.3728-o (1): Starting 2019-12-05T03:46:45.868 INFO:teuthology.orchestra.run.smithi158.stdout: 5 Dec 03:46:45 ntpd[7671]: Command line: ntpd -gq 2019-12-05T03:46:45.868 INFO:teuthology.orchestra.run.smithi158.stdout: 5 Dec 03:46:45 ntpd[7671]: proto: precision = 0.120 usec (-23) 2019-12-05T03:46:45.869 INFO:teuthology.orchestra.run.smithi158.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2019-12-05T03:46:45.870 INFO:teuthology.orchestra.run.smithi158.stderr:restrict ::: KOD does nothing without LIMITED. 2019-12-05T03:46:45.870 INFO:teuthology.orchestra.run.smithi158.stdout: 5 Dec 03:46:45 ntpd[7671]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2019-12-05T03:46:45.870 INFO:teuthology.orchestra.run.smithi158.stdout: 5 Dec 03:46:45 ntpd[7671]: restrict ::: KOD does nothing without LIMITED. 2019-12-05T03:46:45.870 INFO:teuthology.orchestra.run.smithi158.stdout: 5 Dec 03:46:45 ntpd[7671]: Listen and drop on 0 v6wildcard [::]:123 2019-12-05T03:46:45.870 INFO:teuthology.orchestra.run.smithi158.stdout: 5 Dec 03:46:45 ntpd[7671]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2019-12-05T03:46:45.870 INFO:teuthology.orchestra.run.smithi158.stdout: 5 Dec 03:46:45 ntpd[7671]: Listen normally on 2 lo 127.0.0.1:123 2019-12-05T03:46:45.871 INFO:teuthology.orchestra.run.smithi158.stdout: 5 Dec 03:46:45 ntpd[7671]: Listen normally on 3 enp3s0f1 172.21.15.158:123 2019-12-05T03:46:45.872 INFO:teuthology.orchestra.run.smithi158.stdout: 5 Dec 03:46:45 ntpd[7671]: Listen normally on 4 lo [::1]:123 2019-12-05T03:46:45.872 INFO:teuthology.orchestra.run.smithi158.stdout: 5 Dec 03:46:45 ntpd[7671]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:726f%5]:123 2019-12-05T03:46:45.872 INFO:teuthology.orchestra.run.smithi158.stdout: 5 Dec 03:46:45 ntpd[7671]: Listening on routing socket on fd #22 for interface updates 2019-12-05T03:46:46.868 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Dec 03:46:46 ntpd[7671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2019-12-05T03:46:46.868 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Dec 03:46:46 ntpd[7671]: can't open /var/log/ntpstats/rawstats.20191205: Permission denied 2019-12-05T03:46:46.868 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Dec 03:46:46 ntpd[7671]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2019-12-05T03:46:46.869 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Dec 03:46:46 ntpd[7671]: can't open /var/log/ntpstats/peerstats.20191205: Permission denied 2019-12-05T03:46:48.868 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Dec 03:46:48 ntpd[7671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2019-12-05T03:46:48.868 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Dec 03:46:48 ntpd[7671]: can't open /var/log/ntpstats/rawstats.20191205: Permission denied 2019-12-05T03:46:48.868 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Dec 03:46:48 ntpd[7671]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2019-12-05T03:46:48.869 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Dec 03:46:48 ntpd[7671]: can't open /var/log/ntpstats/peerstats.20191205: Permission denied 2019-12-05T03:46:50.868 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Dec 03:46:50 ntpd[7671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2019-12-05T03:46:50.868 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Dec 03:46:50 ntpd[7671]: can't open /var/log/ntpstats/rawstats.20191205: Permission denied 2019-12-05T03:46:50.868 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Dec 03:46:50 ntpd[7671]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2019-12-05T03:46:50.868 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Dec 03:46:50 ntpd[7671]: can't open /var/log/ntpstats/peerstats.20191205: Permission denied 2019-12-05T03:46:52.868 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Dec 03:46:52 ntpd[7671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2019-12-05T03:46:52.868 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Dec 03:46:52 ntpd[7671]: can't open /var/log/ntpstats/rawstats.20191205: Permission denied 2019-12-05T03:46:52.869 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Dec 03:46:52 ntpd[7671]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2019-12-05T03:46:52.869 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Dec 03:46:52 ntpd[7671]: can't open /var/log/ntpstats/peerstats.20191205: Permission denied 2019-12-05T03:46:52.869 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Dec 03:46:52 ntpd[7671]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2019-12-05T03:46:52.869 INFO:teuthology.orchestra.run.smithi158.stderr: 5 Dec 03:46:52 ntpd[7671]: can't open /var/log/ntpstats/loopstats.20191205: Permission denied 2019-12-05T03:46:52.869 INFO:teuthology.orchestra.run.smithi158.stdout: 5 Dec 03:46:52 ntpd[7671]: ntpd: time slew +0.023020 s 2019-12-05T03:46:52.869 INFO:teuthology.orchestra.run.smithi158.stdout:ntpd: time slew +0.023020s 2019-12-05T03:46:52.916 INFO:teuthology.orchestra.run.smithi158.stdout: remote refid st t when poll reach delay offset jitter 2019-12-05T03:46:52.916 INFO:teuthology.orchestra.run.smithi158.stdout:============================================================================== 2019-12-05T03:46:52.916 INFO:teuthology.orchestra.run.smithi158.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-05T03:46:52.917 INFO:teuthology.orchestra.run.smithi158.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-05T03:46:52.917 INFO:teuthology.orchestra.run.smithi158.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-05T03:46:52.917 INFO:teuthology.orchestra.run.smithi158.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-05T03:46:52.917 INFO:teuthology.orchestra.run.smithi096:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-12-05T03:46:52.978 INFO:teuthology.orchestra.run.smithi096.stdout: 5 Dec 03:46:52 ntpd[7668]: ntpd 4.2.8p10@1.3728-o (1): Starting 2019-12-05T03:46:52.978 INFO:teuthology.orchestra.run.smithi096.stdout: 5 Dec 03:46:52 ntpd[7668]: Command line: ntpd -gq 2019-12-05T03:46:52.980 INFO:teuthology.orchestra.run.smithi096.stdout: 5 Dec 03:46:52 ntpd[7668]: proto: precision = 0.123 usec (-23) 2019-12-05T03:46:52.981 INFO:teuthology.orchestra.run.smithi096.stdout: 5 Dec 03:46:53 ntpd[7668]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2019-12-05T03:46:52.981 INFO:teuthology.orchestra.run.smithi096.stdout: 5 Dec 03:46:53 ntpd[7668]: restrict ::: KOD does nothing without LIMITED. 2019-12-05T03:46:52.981 INFO:teuthology.orchestra.run.smithi096.stdout: 5 Dec 03:46:53 ntpd[7668]: Listen and drop on 0 v6wildcard [::]:123 2019-12-05T03:46:52.981 INFO:teuthology.orchestra.run.smithi096.stdout: 5 Dec 03:46:53 ntpd[7668]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2019-12-05T03:46:52.982 INFO:teuthology.orchestra.run.smithi096.stdout: 5 Dec 03:46:53 ntpd[7668]: Listen normally on 2 lo 127.0.0.1:123 2019-12-05T03:46:52.982 INFO:teuthology.orchestra.run.smithi096.stdout: 5 Dec 03:46:53 ntpd[7668]: Listen normally on 3 enp3s0f1 172.21.15.96:123 2019-12-05T03:46:52.982 INFO:teuthology.orchestra.run.smithi096.stdout: 5 Dec 03:46:53 ntpd[7668]: Listen normally on 4 lo [::1]:123 2019-12-05T03:46:52.982 INFO:teuthology.orchestra.run.smithi096.stdout: 5 Dec 03:46:53 ntpd[7668]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cc0d%5]:123 2019-12-05T03:46:52.982 INFO:teuthology.orchestra.run.smithi096.stdout: 5 Dec 03:46:53 ntpd[7668]: Listening on routing socket on fd #22 for interface updates 2019-12-05T03:46:52.983 INFO:teuthology.orchestra.run.smithi096.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2019-12-05T03:46:52.983 INFO:teuthology.orchestra.run.smithi096.stderr:restrict ::: KOD does nothing without LIMITED. 2019-12-05T03:46:55.980 INFO:teuthology.orchestra.run.smithi096.stderr: 5 Dec 03:46:56 ntpd[7668]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2019-12-05T03:46:55.980 INFO:teuthology.orchestra.run.smithi096.stderr: 5 Dec 03:46:56 ntpd[7668]: can't open /var/log/ntpstats/rawstats.20191205: Permission denied 2019-12-05T03:46:55.980 INFO:teuthology.orchestra.run.smithi096.stderr: 5 Dec 03:46:56 ntpd[7668]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2019-12-05T03:46:55.980 INFO:teuthology.orchestra.run.smithi096.stderr: 5 Dec 03:46:56 ntpd[7668]: can't open /var/log/ntpstats/peerstats.20191205: Permission denied 2019-12-05T03:46:57.981 INFO:teuthology.orchestra.run.smithi096.stderr: 5 Dec 03:46:58 ntpd[7668]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2019-12-05T03:46:57.981 INFO:teuthology.orchestra.run.smithi096.stderr: 5 Dec 03:46:58 ntpd[7668]: can't open /var/log/ntpstats/rawstats.20191205: Permission denied 2019-12-05T03:46:57.981 INFO:teuthology.orchestra.run.smithi096.stderr: 5 Dec 03:46:58 ntpd[7668]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2019-12-05T03:46:57.981 INFO:teuthology.orchestra.run.smithi096.stderr: 5 Dec 03:46:58 ntpd[7668]: can't open /var/log/ntpstats/peerstats.20191205: Permission denied 2019-12-05T03:46:59.982 INFO:teuthology.orchestra.run.smithi096.stderr: 5 Dec 03:47:00 ntpd[7668]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2019-12-05T03:46:59.982 INFO:teuthology.orchestra.run.smithi096.stderr: 5 Dec 03:47:00 ntpd[7668]: can't open /var/log/ntpstats/rawstats.20191205: Permission denied 2019-12-05T03:46:59.982 INFO:teuthology.orchestra.run.smithi096.stderr: 5 Dec 03:47:00 ntpd[7668]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2019-12-05T03:46:59.982 INFO:teuthology.orchestra.run.smithi096.stderr: 5 Dec 03:47:00 ntpd[7668]: can't open /var/log/ntpstats/peerstats.20191205: Permission denied 2019-12-05T03:47:01.983 INFO:teuthology.orchestra.run.smithi096.stderr: 5 Dec 03:47:02 ntpd[7668]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2019-12-05T03:47:01.983 INFO:teuthology.orchestra.run.smithi096.stderr: 5 Dec 03:47:02 ntpd[7668]: can't open /var/log/ntpstats/rawstats.20191205: Permission denied 2019-12-05T03:47:01.983 INFO:teuthology.orchestra.run.smithi096.stderr: 5 Dec 03:47:02 ntpd[7668]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2019-12-05T03:47:01.983 INFO:teuthology.orchestra.run.smithi096.stderr: 5 Dec 03:47:02 ntpd[7668]: can't open /var/log/ntpstats/peerstats.20191205: Permission denied 2019-12-05T03:47:01.984 INFO:teuthology.orchestra.run.smithi096.stderr: 5 Dec 03:47:01 ntpd[7668]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2019-12-05T03:47:01.984 INFO:teuthology.orchestra.run.smithi096.stderr: 5 Dec 03:47:01 ntpd[7668]: can't open /var/log/ntpstats/loopstats.20191205: Permission denied 2019-12-05T03:47:01.984 INFO:teuthology.orchestra.run.smithi096.stdout: 5 Dec 03:47:01 ntpd[7668]: ntpd: time set -0.025483 s 2019-12-05T03:47:01.984 INFO:teuthology.orchestra.run.smithi096.stdout:ntpd: time set -0.025483s 2019-12-05T03:47:02.101 INFO:teuthology.orchestra.run.smithi096.stdout: remote refid st t when poll reach delay offset jitter 2019-12-05T03:47:02.101 INFO:teuthology.orchestra.run.smithi096.stdout:============================================================================== 2019-12-05T03:47:02.102 INFO:teuthology.orchestra.run.smithi096.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-05T03:47:02.102 INFO:teuthology.orchestra.run.smithi096.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-05T03:47:02.102 INFO:teuthology.orchestra.run.smithi096.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-05T03:47:02.102 INFO:teuthology.orchestra.run.smithi096.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-05T03:47:02.104 INFO:teuthology.run_tasks:Running task install... 2019-12-05T03:47:02.117 DEBUG:teuthology.task.install:project ceph 2019-12-05T03:47:02.117 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': 'c5290805033483ba0cec165c06bde07dae5f19ec'}} 2019-12-05T03:47:02.117 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel']}, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'sha1': 'c5290805033483ba0cec165c06bde07dae5f19ec'} 2019-12-05T03:47:02.118 INFO:teuthology.task.install:Using flavor: basic 2019-12-05T03:47:02.125 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-daemon', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python-ceph', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-daemon', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-cloud', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-ssh', 'ceph-fuse', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python-ceph', 'rbd-fuse']} 2019-12-05T03:47:02.126 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']} 2019-12-05T03:47:02.126 INFO:teuthology.orchestra.run.smithi158:> sudo lsb_release -is 2019-12-05T03:47:02.186 INFO:teuthology.orchestra.run.smithi158.stdout:Ubuntu 2019-12-05T03:47:02.191 DEBUG:teuthology.misc:System to be installed: Ubuntu 2019-12-05T03:47:02.192 INFO:teuthology.orchestra.run.smithi096:> sudo lsb_release -is 2019-12-05T03:47:02.192 INFO:teuthology.orchestra.run.smithi158:> sudo apt-key list | grep Ceph 2019-12-05T03:47:02.245 INFO:teuthology.orchestra.run.smithi096.stdout:Ubuntu 2019-12-05T03:47:02.250 DEBUG:teuthology.misc:System to be installed: Ubuntu 2019-12-05T03:47:02.251 INFO:teuthology.orchestra.run.smithi096:> sudo apt-key list | grep Ceph 2019-12-05T03:47:02.286 INFO:teuthology.orchestra.run.smithi158.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2019-12-05T03:47:02.334 INFO:teuthology.orchestra.run.smithi096.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2019-12-05T03:47:02.337 INFO:teuthology.orchestra.run.smithi158.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2019-12-05T03:47:02.338 INFO:teuthology.orchestra.run.smithi158.stdout:uid [ unknown] Ceph.com (release key) 2019-12-05T03:47:02.339 INFO:teuthology.orchestra.run.smithi158:> sudo lsb_release -is 2019-12-05T03:47:02.393 INFO:teuthology.orchestra.run.smithi096.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2019-12-05T03:47:02.393 INFO:teuthology.orchestra.run.smithi096.stdout:uid [ unknown] Ceph.com (release key) 2019-12-05T03:47:02.393 INFO:teuthology.orchestra.run.smithi158.stdout:Ubuntu 2019-12-05T03:47:02.394 INFO:teuthology.orchestra.run.smithi096:> sudo lsb_release -is 2019-12-05T03:47:02.397 DEBUG:teuthology.misc:System to be installed: Ubuntu 2019-12-05T03:47:02.398 INFO:teuthology.task.install.deb:Installing packages: ceph, ceph-daemon, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python-ceph, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2019-12-05T03:47:02.398 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev on remote deb x86_64 2019-12-05T03:47:02.398 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=c5290805033483ba0cec165c06bde07dae5f19ec 2019-12-05T03:47:02.443 INFO:teuthology.orchestra.run.smithi096.stdout:Ubuntu 2019-12-05T03:47:02.448 DEBUG:teuthology.misc:System to be installed: Ubuntu 2019-12-05T03:47:02.449 INFO:teuthology.task.install.deb:Installing packages: ceph, ceph-daemon, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python-ceph, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2019-12-05T03:47:02.449 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev on remote deb x86_64 2019-12-05T03:47:02.449 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=c5290805033483ba0cec165c06bde07dae5f19ec 2019-12-05T03:47:02.567 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default/ 2019-12-05T03:47:02.568 INFO:teuthology.task.install.deb:Package version is 15.0.0-8014-gc529080-1bionic 2019-12-05T03:47:02.607 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default/ 2019-12-05T03:47:02.607 INFO:teuthology.task.install.deb:Package version is 15.0.0-8014-gc529080-1bionic 2019-12-05T03:47:02.886 INFO:teuthology.orchestra.run.smithi158:> sudo sh -c 'cat > /etc/apt/sources.list.d/ceph.list' 2019-12-05T03:47:02.926 INFO:teuthology.orchestra.run.smithi096:> sudo sh -c 'cat > /etc/apt/sources.list.d/ceph.list' 2019-12-05T03:47:02.937 INFO:teuthology.orchestra.run.smithi158:> sudo apt-get update 2019-12-05T03:47:02.977 INFO:teuthology.orchestra.run.smithi096:> sudo apt-get update 2019-12-05T03:47:03.140 INFO:teuthology.orchestra.run.smithi158.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2019-12-05T03:47:03.226 INFO:teuthology.orchestra.run.smithi158.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic InRelease 2019-12-05T03:47:03.247 INFO:teuthology.orchestra.run.smithi158.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic Release [7,672 B] 2019-12-05T03:47:03.255 INFO:teuthology.orchestra.run.smithi158.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic InRelease 2019-12-05T03:47:03.263 INFO:teuthology.orchestra.run.smithi096.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic InRelease 2019-12-05T03:47:03.270 INFO:teuthology.orchestra.run.smithi158.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic Release.gpg 2019-12-05T03:47:03.284 INFO:teuthology.orchestra.run.smithi096.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic Release [7,672 B] 2019-12-05T03:47:03.294 INFO:teuthology.orchestra.run.smithi158.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main i386 Packages [2,865 B] 2019-12-05T03:47:03.309 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:3 http://security.ubuntu.com/ubuntu bionic-security InRelease 2019-12-05T03:47:03.310 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic InRelease 2019-12-05T03:47:03.310 INFO:teuthology.orchestra.run.smithi096.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic Release.gpg 2019-12-05T03:47:03.332 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 Packages [16.4 kB] 2019-12-05T03:47:03.335 INFO:teuthology.orchestra.run.smithi158.stdout:Hit:7 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2019-12-05T03:47:03.339 INFO:teuthology.orchestra.run.smithi158.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 Packages [16.4 kB] 2019-12-05T03:47:03.363 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main i386 Packages [2,865 B] 2019-12-05T03:47:03.380 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:8 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2019-12-05T03:47:03.415 INFO:teuthology.orchestra.run.smithi158.stdout:Hit:9 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2019-12-05T03:47:03.461 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:9 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2019-12-05T03:47:03.744 INFO:teuthology.orchestra.run.smithi158.stdout:Fetched 26.9 kB in 1s (46.1 kB/s) 2019-12-05T03:47:03.902 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 26.9 kB in 1s (38.6 kB/s) 2019-12-05T03:47:04.889 INFO:teuthology.orchestra.run.smithi158.stdout:Reading package lists... 2019-12-05T03:47:04.937 INFO:teuthology.orchestra.run.smithi158:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.0.0-8014-gc529080-1bionic ceph-daemon=15.0.0-8014-gc529080-1bionic ceph-mds=15.0.0-8014-gc529080-1bionic ceph-mgr=15.0.0-8014-gc529080-1bionic ceph-common=15.0.0-8014-gc529080-1bionic ceph-fuse=15.0.0-8014-gc529080-1bionic ceph-test=15.0.0-8014-gc529080-1bionic radosgw=15.0.0-8014-gc529080-1bionic python-ceph=15.0.0-8014-gc529080-1bionic libcephfs2=15.0.0-8014-gc529080-1bionic libcephfs-dev=15.0.0-8014-gc529080-1bionic librados2=15.0.0-8014-gc529080-1bionic librbd1=15.0.0-8014-gc529080-1bionic rbd-fuse=15.0.0-8014-gc529080-1bionic python3-cephfs=15.0.0-8014-gc529080-1bionic cephfs-shell=15.0.0-8014-gc529080-1bionic 2019-12-05T03:47:05.018 INFO:teuthology.orchestra.run.smithi158.stdout:Reading package lists... 2019-12-05T03:47:05.056 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2019-12-05T03:47:05.100 INFO:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.0.0-8014-gc529080-1bionic ceph-daemon=15.0.0-8014-gc529080-1bionic ceph-mds=15.0.0-8014-gc529080-1bionic ceph-mgr=15.0.0-8014-gc529080-1bionic ceph-common=15.0.0-8014-gc529080-1bionic ceph-fuse=15.0.0-8014-gc529080-1bionic ceph-test=15.0.0-8014-gc529080-1bionic radosgw=15.0.0-8014-gc529080-1bionic python-ceph=15.0.0-8014-gc529080-1bionic libcephfs2=15.0.0-8014-gc529080-1bionic libcephfs-dev=15.0.0-8014-gc529080-1bionic librados2=15.0.0-8014-gc529080-1bionic librbd1=15.0.0-8014-gc529080-1bionic rbd-fuse=15.0.0-8014-gc529080-1bionic python3-cephfs=15.0.0-8014-gc529080-1bionic cephfs-shell=15.0.0-8014-gc529080-1bionic 2019-12-05T03:47:05.184 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2019-12-05T03:47:05.253 INFO:teuthology.orchestra.run.smithi158.stdout:Building dependency tree... 2019-12-05T03:47:05.253 INFO:teuthology.orchestra.run.smithi158.stdout:Reading state information... 2019-12-05T03:47:05.411 INFO:teuthology.orchestra.run.smithi158.stdout:The following additional packages will be installed: 2019-12-05T03:47:05.411 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-base ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2019-12-05T03:47:05.411 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-rook ceph-mgr-ssh 2019-12-05T03:47:05.412 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mon ceph-osd formencode-i18n jq libjq1 libjs-sphinxdoc libjs-underscore 2019-12-05T03:47:05.412 INFO:teuthology.orchestra.run.smithi158.stdout: libleveldb1v5 liblttng-ust0 liboath0 libonig4 librabbitmq4 libradosstriper1 2019-12-05T03:47:05.412 INFO:teuthology.orchestra.run.smithi158.stdout: librdkafka1 librgw2 libsnappy1v5 libxslt1.1 python-attr python-bcrypt 2019-12-05T03:47:05.413 INFO:teuthology.orchestra.run.smithi158.stdout: python-bs4 python-ceph-argparse python-ceph-common python-cephfs 2019-12-05T03:47:05.413 INFO:teuthology.orchestra.run.smithi158.stdout: python-certifi python-chardet python-cherrypy3 python-decorator 2019-12-05T03:47:05.413 INFO:teuthology.orchestra.run.smithi158.stdout: python-dnspython python-fasteners python-formencode python-funcsigs 2019-12-05T03:47:05.413 INFO:teuthology.orchestra.run.smithi158.stdout: python-html5lib python-httplib2 python-joblib python-jwt python-kubernetes 2019-12-05T03:47:05.413 INFO:teuthology.orchestra.run.smithi158.stdout: python-logutils python-lxml python-mako python-markupsafe python-monotonic 2019-12-05T03:47:05.413 INFO:teuthology.orchestra.run.smithi158.stdout: python-oauth2client python-openid python-openssl python-paste 2019-12-05T03:47:05.413 INFO:teuthology.orchestra.run.smithi158.stdout: python-pastedeploy python-pastedeploy-tpl python-pastescript python-pecan 2019-12-05T03:47:05.414 INFO:teuthology.orchestra.run.smithi158.stdout: python-pluggy python-prettytable python-py python-pyasn1 2019-12-05T03:47:05.414 INFO:teuthology.orchestra.run.smithi158.stdout: python-pyasn1-modules python-pyinotify python-pytest python-rados python-rbd 2019-12-05T03:47:05.414 INFO:teuthology.orchestra.run.smithi158.stdout: python-repoze.lru python-requests python-rgw python-routes python-rsa 2019-12-05T03:47:05.414 INFO:teuthology.orchestra.run.smithi158.stdout: python-scgi python-scipy python-simplegeneric python-simplejson 2019-12-05T03:47:05.414 INFO:teuthology.orchestra.run.smithi158.stdout: python-singledispatch python-sklearn python-sklearn-lib python-sqlalchemy 2019-12-05T03:47:05.414 INFO:teuthology.orchestra.run.smithi158.stdout: python-sqlalchemy-ext python-tempita python-uritemplate python-urllib3 2019-12-05T03:47:05.414 INFO:teuthology.orchestra.run.smithi158.stdout: python-waitress python-webencodings python-webob python-websocket 2019-12-05T03:47:05.415 INFO:teuthology.orchestra.run.smithi158.stdout: python-webtest python-werkzeug python-yaml python3-ceph-argparse 2019-12-05T03:47:05.415 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cmd2 python3-colorama python3-pyparsing python3-pyperclip 2019-12-05T03:47:05.415 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rados socat xmlstarlet 2019-12-05T03:47:05.415 INFO:teuthology.orchestra.run.smithi158.stdout:Suggested packages: 2019-12-05T03:47:05.415 INFO:teuthology.orchestra.run.smithi158.stdout: python-influxdb python-attr-doc python-egenix-mxdatetime python-funcsigs-doc 2019-12-05T03:47:05.416 INFO:teuthology.orchestra.run.smithi158.stdout: python-genshi python-lxml-dbg python-lxml-doc python-beaker python-mako-doc 2019-12-05T03:47:05.416 INFO:teuthology.orchestra.run.smithi158.stdout: python-openssl-doc python-openssl-dbg httpd-wsgi libapache2-mod-python 2019-12-05T03:47:05.416 INFO:teuthology.orchestra.run.smithi158.stdout: libapache2-mod-scgi libjs-mochikit python-pastewebkit python-cheetah 2019-12-05T03:47:05.417 INFO:teuthology.orchestra.run.smithi158.stdout: python-cherrypy python-flup python-pecan-doc subversion python-pytest-xdist 2019-12-05T03:47:05.418 INFO:teuthology.orchestra.run.smithi158.stdout: python-pyinotify-doc python-mock python-socks python-scipy-doc python-dap 2019-12-05T03:47:05.418 INFO:teuthology.orchestra.run.smithi158.stdout: python-scikits-optimization python-sklearn-doc ipython python-sqlalchemy-doc 2019-12-05T03:47:05.418 INFO:teuthology.orchestra.run.smithi158.stdout: python-psycopg2 python-pymysql python-fdb python-pymssql python-ntlm 2019-12-05T03:47:05.418 INFO:teuthology.orchestra.run.smithi158.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-pyquery 2019-12-05T03:47:05.418 INFO:teuthology.orchestra.run.smithi158.stdout: python-redis python-pylibmc | python-memcache python-termcolor 2019-12-05T03:47:05.418 INFO:teuthology.orchestra.run.smithi158.stdout: python-watchdog python-werkzeug-doc python-pyparsing-doc 2019-12-05T03:47:05.439 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2019-12-05T03:47:05.439 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2019-12-05T03:47:05.515 INFO:teuthology.orchestra.run.smithi158.stdout:The following NEW packages will be installed: 2019-12-05T03:47:05.516 INFO:teuthology.orchestra.run.smithi158.stdout: ceph ceph-base ceph-common ceph-daemon ceph-fuse ceph-mds ceph-mgr 2019-12-05T03:47:05.516 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2019-12-05T03:47:05.516 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-rook ceph-mgr-ssh 2019-12-05T03:47:05.516 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mon ceph-osd ceph-test cephfs-shell formencode-i18n jq libcephfs-dev 2019-12-05T03:47:05.518 INFO:teuthology.orchestra.run.smithi158.stdout: libcephfs2 libjq1 libjs-sphinxdoc libjs-underscore libleveldb1v5 2019-12-05T03:47:05.518 INFO:teuthology.orchestra.run.smithi158.stdout: liblttng-ust0 liboath0 libonig4 librabbitmq4 libradosstriper1 librdkafka1 2019-12-05T03:47:05.519 INFO:teuthology.orchestra.run.smithi158.stdout: librgw2 libsnappy1v5 libxslt1.1 python-attr python-bcrypt python-bs4 2019-12-05T03:47:05.519 INFO:teuthology.orchestra.run.smithi158.stdout: python-ceph python-ceph-argparse python-ceph-common python-cephfs 2019-12-05T03:47:05.519 INFO:teuthology.orchestra.run.smithi158.stdout: python-certifi python-chardet python-cherrypy3 python-decorator 2019-12-05T03:47:05.519 INFO:teuthology.orchestra.run.smithi158.stdout: python-dnspython python-fasteners python-formencode python-funcsigs 2019-12-05T03:47:05.520 INFO:teuthology.orchestra.run.smithi158.stdout: python-html5lib python-httplib2 python-joblib python-jwt python-kubernetes 2019-12-05T03:47:05.521 INFO:teuthology.orchestra.run.smithi158.stdout: python-logutils python-lxml python-mako python-markupsafe python-monotonic 2019-12-05T03:47:05.522 INFO:teuthology.orchestra.run.smithi158.stdout: python-oauth2client python-openid python-openssl python-paste 2019-12-05T03:47:05.523 INFO:teuthology.orchestra.run.smithi158.stdout: python-pastedeploy python-pastedeploy-tpl python-pastescript python-pecan 2019-12-05T03:47:05.524 INFO:teuthology.orchestra.run.smithi158.stdout: python-pluggy python-prettytable python-py python-pyasn1 2019-12-05T03:47:05.524 INFO:teuthology.orchestra.run.smithi158.stdout: python-pyasn1-modules python-pyinotify python-pytest python-rados python-rbd 2019-12-05T03:47:05.524 INFO:teuthology.orchestra.run.smithi158.stdout: python-repoze.lru python-requests python-rgw python-routes python-rsa 2019-12-05T03:47:05.524 INFO:teuthology.orchestra.run.smithi158.stdout: python-scgi python-scipy python-simplegeneric python-simplejson 2019-12-05T03:47:05.525 INFO:teuthology.orchestra.run.smithi158.stdout: python-singledispatch python-sklearn python-sklearn-lib python-sqlalchemy 2019-12-05T03:47:05.525 INFO:teuthology.orchestra.run.smithi158.stdout: python-sqlalchemy-ext python-tempita python-uritemplate python-urllib3 2019-12-05T03:47:05.525 INFO:teuthology.orchestra.run.smithi158.stdout: python-waitress python-webencodings python-webob python-websocket 2019-12-05T03:47:05.525 INFO:teuthology.orchestra.run.smithi158.stdout: python-webtest python-werkzeug python-yaml python3-ceph-argparse 2019-12-05T03:47:05.525 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cephfs python3-cmd2 python3-colorama python3-pyparsing 2019-12-05T03:47:05.526 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyperclip python3-rados radosgw rbd-fuse socat xmlstarlet 2019-12-05T03:47:05.526 INFO:teuthology.orchestra.run.smithi158.stdout:The following packages will be upgraded: 2019-12-05T03:47:05.526 INFO:teuthology.orchestra.run.smithi158.stdout: librados2 librbd1 2019-12-05T03:47:05.598 INFO:teuthology.orchestra.run.smithi096.stdout:The following additional packages will be installed: 2019-12-05T03:47:05.598 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-base ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2019-12-05T03:47:05.598 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-rook ceph-mgr-ssh 2019-12-05T03:47:05.599 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mon ceph-osd formencode-i18n jq libjq1 libjs-sphinxdoc libjs-underscore 2019-12-05T03:47:05.599 INFO:teuthology.orchestra.run.smithi096.stdout: libleveldb1v5 liblttng-ust0 liboath0 libonig4 librabbitmq4 libradosstriper1 2019-12-05T03:47:05.599 INFO:teuthology.orchestra.run.smithi096.stdout: librdkafka1 librgw2 libsnappy1v5 libxslt1.1 python-attr python-bcrypt 2019-12-05T03:47:05.600 INFO:teuthology.orchestra.run.smithi096.stdout: python-bs4 python-ceph-argparse python-ceph-common python-cephfs 2019-12-05T03:47:05.600 INFO:teuthology.orchestra.run.smithi096.stdout: python-certifi python-chardet python-cherrypy3 python-decorator 2019-12-05T03:47:05.600 INFO:teuthology.orchestra.run.smithi096.stdout: python-dnspython python-fasteners python-formencode python-funcsigs 2019-12-05T03:47:05.600 INFO:teuthology.orchestra.run.smithi096.stdout: python-html5lib python-httplib2 python-joblib python-jwt python-kubernetes 2019-12-05T03:47:05.600 INFO:teuthology.orchestra.run.smithi096.stdout: python-logutils python-lxml python-mako python-markupsafe python-monotonic 2019-12-05T03:47:05.600 INFO:teuthology.orchestra.run.smithi096.stdout: python-oauth2client python-openid python-openssl python-paste 2019-12-05T03:47:05.600 INFO:teuthology.orchestra.run.smithi096.stdout: python-pastedeploy python-pastedeploy-tpl python-pastescript python-pecan 2019-12-05T03:47:05.601 INFO:teuthology.orchestra.run.smithi096.stdout: python-pluggy python-prettytable python-py python-pyasn1 2019-12-05T03:47:05.601 INFO:teuthology.orchestra.run.smithi096.stdout: python-pyasn1-modules python-pyinotify python-pytest python-rados python-rbd 2019-12-05T03:47:05.601 INFO:teuthology.orchestra.run.smithi096.stdout: python-repoze.lru python-requests python-rgw python-routes python-rsa 2019-12-05T03:47:05.601 INFO:teuthology.orchestra.run.smithi096.stdout: python-scgi python-scipy python-simplegeneric python-simplejson 2019-12-05T03:47:05.601 INFO:teuthology.orchestra.run.smithi096.stdout: python-singledispatch python-sklearn python-sklearn-lib python-sqlalchemy 2019-12-05T03:47:05.601 INFO:teuthology.orchestra.run.smithi096.stdout: python-sqlalchemy-ext python-tempita python-uritemplate python-urllib3 2019-12-05T03:47:05.601 INFO:teuthology.orchestra.run.smithi096.stdout: python-waitress python-webencodings python-webob python-websocket 2019-12-05T03:47:05.602 INFO:teuthology.orchestra.run.smithi096.stdout: python-webtest python-werkzeug python-yaml python3-ceph-argparse 2019-12-05T03:47:05.602 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cmd2 python3-colorama python3-pyparsing python3-pyperclip 2019-12-05T03:47:05.602 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rados socat xmlstarlet 2019-12-05T03:47:05.602 INFO:teuthology.orchestra.run.smithi096.stdout:Suggested packages: 2019-12-05T03:47:05.602 INFO:teuthology.orchestra.run.smithi096.stdout: python-influxdb python-attr-doc python-egenix-mxdatetime python-funcsigs-doc 2019-12-05T03:47:05.603 INFO:teuthology.orchestra.run.smithi096.stdout: python-genshi python-lxml-dbg python-lxml-doc python-beaker python-mako-doc 2019-12-05T03:47:05.603 INFO:teuthology.orchestra.run.smithi096.stdout: python-openssl-doc python-openssl-dbg httpd-wsgi libapache2-mod-python 2019-12-05T03:47:05.603 INFO:teuthology.orchestra.run.smithi096.stdout: libapache2-mod-scgi libjs-mochikit python-pastewebkit python-cheetah 2019-12-05T03:47:05.603 INFO:teuthology.orchestra.run.smithi096.stdout: python-cherrypy python-flup python-pecan-doc subversion python-pytest-xdist 2019-12-05T03:47:05.603 INFO:teuthology.orchestra.run.smithi096.stdout: python-pyinotify-doc python-mock python-socks python-scipy-doc python-dap 2019-12-05T03:47:05.603 INFO:teuthology.orchestra.run.smithi096.stdout: python-scikits-optimization python-sklearn-doc ipython python-sqlalchemy-doc 2019-12-05T03:47:05.603 INFO:teuthology.orchestra.run.smithi096.stdout: python-psycopg2 python-pymysql python-fdb python-pymssql python-ntlm 2019-12-05T03:47:05.603 INFO:teuthology.orchestra.run.smithi096.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-pyquery 2019-12-05T03:47:05.604 INFO:teuthology.orchestra.run.smithi096.stdout: python-redis python-pylibmc | python-memcache python-termcolor 2019-12-05T03:47:05.604 INFO:teuthology.orchestra.run.smithi096.stdout: python-watchdog python-werkzeug-doc python-pyparsing-doc 2019-12-05T03:47:05.693 INFO:teuthology.orchestra.run.smithi158.stdout:2 upgraded, 111 newly installed, 0 to remove and 52 not upgraded. 2019-12-05T03:47:05.693 INFO:teuthology.orchestra.run.smithi158.stdout:Need to get 139 MB of archives. 2019-12-05T03:47:05.693 INFO:teuthology.orchestra.run.smithi158.stdout:After this operation, 658 MB of additional disk space will be used. 2019-12-05T03:47:05.693 INFO:teuthology.orchestra.run.smithi158.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 15.0.0-8014-gc529080-1bionic [1,516 kB] 2019-12-05T03:47:05.701 INFO:teuthology.orchestra.run.smithi096.stdout:The following NEW packages will be installed: 2019-12-05T03:47:05.701 INFO:teuthology.orchestra.run.smithi096.stdout: ceph ceph-base ceph-common ceph-daemon ceph-fuse ceph-mds ceph-mgr 2019-12-05T03:47:05.701 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2019-12-05T03:47:05.701 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-rook ceph-mgr-ssh 2019-12-05T03:47:05.702 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mon ceph-osd ceph-test cephfs-shell formencode-i18n jq libcephfs-dev 2019-12-05T03:47:05.702 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs2 libjq1 libjs-sphinxdoc libjs-underscore libleveldb1v5 2019-12-05T03:47:05.703 INFO:teuthology.orchestra.run.smithi096.stdout: liblttng-ust0 liboath0 libonig4 librabbitmq4 libradosstriper1 librdkafka1 2019-12-05T03:47:05.703 INFO:teuthology.orchestra.run.smithi096.stdout: librgw2 libsnappy1v5 libxslt1.1 python-attr python-bcrypt python-bs4 2019-12-05T03:47:05.703 INFO:teuthology.orchestra.run.smithi096.stdout: python-ceph python-ceph-argparse python-ceph-common python-cephfs 2019-12-05T03:47:05.703 INFO:teuthology.orchestra.run.smithi096.stdout: python-certifi python-chardet python-cherrypy3 python-decorator 2019-12-05T03:47:05.703 INFO:teuthology.orchestra.run.smithi096.stdout: python-dnspython python-fasteners python-formencode python-funcsigs 2019-12-05T03:47:05.703 INFO:teuthology.orchestra.run.smithi096.stdout: python-html5lib python-httplib2 python-joblib python-jwt python-kubernetes 2019-12-05T03:47:05.704 INFO:teuthology.orchestra.run.smithi096.stdout: python-logutils python-lxml python-mako python-markupsafe python-monotonic 2019-12-05T03:47:05.704 INFO:teuthology.orchestra.run.smithi096.stdout: python-oauth2client python-openid python-openssl python-paste 2019-12-05T03:47:05.704 INFO:teuthology.orchestra.run.smithi096.stdout: python-pastedeploy python-pastedeploy-tpl python-pastescript python-pecan 2019-12-05T03:47:05.704 INFO:teuthology.orchestra.run.smithi096.stdout: python-pluggy python-prettytable python-py python-pyasn1 2019-12-05T03:47:05.704 INFO:teuthology.orchestra.run.smithi096.stdout: python-pyasn1-modules python-pyinotify python-pytest python-rados python-rbd 2019-12-05T03:47:05.705 INFO:teuthology.orchestra.run.smithi096.stdout: python-repoze.lru python-requests python-rgw python-routes python-rsa 2019-12-05T03:47:05.705 INFO:teuthology.orchestra.run.smithi096.stdout: python-scgi python-scipy python-simplegeneric python-simplejson 2019-12-05T03:47:05.705 INFO:teuthology.orchestra.run.smithi096.stdout: python-singledispatch python-sklearn python-sklearn-lib python-sqlalchemy 2019-12-05T03:47:05.705 INFO:teuthology.orchestra.run.smithi096.stdout: python-sqlalchemy-ext python-tempita python-uritemplate python-urllib3 2019-12-05T03:47:05.705 INFO:teuthology.orchestra.run.smithi096.stdout: python-waitress python-webencodings python-webob python-websocket 2019-12-05T03:47:05.705 INFO:teuthology.orchestra.run.smithi096.stdout: python-webtest python-werkzeug python-yaml python3-ceph-argparse 2019-12-05T03:47:05.706 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cephfs python3-cmd2 python3-colorama python3-pyparsing 2019-12-05T03:47:05.706 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyperclip python3-rados radosgw rbd-fuse socat xmlstarlet 2019-12-05T03:47:05.706 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages will be upgraded: 2019-12-05T03:47:05.706 INFO:teuthology.orchestra.run.smithi096.stdout: librados2 librbd1 2019-12-05T03:47:05.712 INFO:teuthology.orchestra.run.smithi158.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-uritemplate all 0.6-1ubuntu1 [5,042 B] 2019-12-05T03:47:05.795 INFO:teuthology.orchestra.run.smithi158.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyparsing all 2.2.0+dfsg1-2 [52.2 kB] 2019-12-05T03:47:05.879 INFO:teuthology.orchestra.run.smithi096.stdout:2 upgraded, 111 newly installed, 0 to remove and 52 not upgraded. 2019-12-05T03:47:05.879 INFO:teuthology.orchestra.run.smithi096.stdout:Need to get 139 MB of archives. 2019-12-05T03:47:05.879 INFO:teuthology.orchestra.run.smithi096.stdout:After this operation, 658 MB of additional disk space will be used. 2019-12-05T03:47:05.880 INFO:teuthology.orchestra.run.smithi096.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 15.0.0-8014-gc529080-1bionic [1,516 kB] 2019-12-05T03:47:05.901 INFO:teuthology.orchestra.run.smithi096.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-uritemplate all 0.6-1ubuntu1 [5,042 B] 2019-12-05T03:47:05.936 INFO:teuthology.orchestra.run.smithi158.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyperclip all 1.6.0-1 [9,376 B] 2019-12-05T03:47:05.960 INFO:teuthology.orchestra.run.smithi158.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cmd2 all 0.7.9-0ubuntu1 [34.2 kB] 2019-12-05T03:47:05.976 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyparsing all 2.2.0+dfsg1-2 [52.2 kB] 2019-12-05T03:47:06.004 INFO:teuthology.orchestra.run.smithi158.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2019-12-05T03:47:06.089 INFO:teuthology.orchestra.run.smithi096.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyperclip all 1.6.0-1 [9,376 B] 2019-12-05T03:47:06.093 INFO:teuthology.orchestra.run.smithi158.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 15.0.0-8014-gc529080-1bionic [2,984 kB] 2019-12-05T03:47:06.110 INFO:teuthology.orchestra.run.smithi158.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-prettytable all 0.7.2-3 [19.6 kB] 2019-12-05T03:47:06.119 INFO:teuthology.orchestra.run.smithi158.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.1 [33.9 kB] 2019-12-05T03:47:06.133 INFO:teuthology.orchestra.run.smithi158.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/universe amd64 librdkafka1 amd64 0.11.3-1build1 [293 kB] 2019-12-05T03:47:06.137 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cmd2 all 0.7.9-0ubuntu1 [34.2 kB] 2019-12-05T03:47:06.156 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 15.0.0-8014-gc529080-1bionic [2,984 kB] 2019-12-05T03:47:06.180 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2019-12-05T03:47:06.208 INFO:teuthology.orchestra.run.smithi158.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2019-12-05T03:47:06.210 INFO:teuthology.orchestra.run.smithi158.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2019-12-05T03:47:06.233 INFO:teuthology.orchestra.run.smithi158.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2019-12-05T03:47:06.241 INFO:teuthology.orchestra.run.smithi158.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bcrypt amd64 3.1.4-2 [29.8 kB] 2019-12-05T03:47:06.244 INFO:teuthology.orchestra.run.smithi158.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-cherrypy3 all 8.9.1-2 [160 kB] 2019-12-05T03:47:06.264 INFO:teuthology.orchestra.run.smithi158.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-jwt all 1.5.3+ds1-1 [15.8 kB] 2019-12-05T03:47:06.265 INFO:teuthology.orchestra.run.smithi158.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openssl all 17.5.0-1ubuntu1 [41.3 kB] 2019-12-05T03:47:06.272 INFO:teuthology.orchestra.run.smithi158.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-logutils all 0.3.3-5 [16.7 kB] 2019-12-05T03:47:06.274 INFO:teuthology.orchestra.run.smithi158.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-markupsafe amd64 1.0-1build1 [13.0 kB] 2019-12-05T03:47:06.305 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-prettytable all 0.7.2-3 [19.6 kB] 2019-12-05T03:47:06.312 INFO:teuthology.orchestra.run.smithi096.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.1 [33.9 kB] 2019-12-05T03:47:06.325 INFO:teuthology.orchestra.run.smithi096.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/universe amd64 librdkafka1 amd64 0.11.3-1build1 [293 kB] 2019-12-05T03:47:06.353 INFO:teuthology.orchestra.run.smithi158.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-mako all 1.0.7+ds1-1 [60.1 kB] 2019-12-05T03:47:06.356 INFO:teuthology.orchestra.run.smithi158.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplegeneric all 0.8.1-1 [11.5 kB] 2019-12-05T03:47:06.357 INFO:teuthology.orchestra.run.smithi158.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-singledispatch all 3.4.0.3-2 [9,848 B] 2019-12-05T03:47:06.357 INFO:teuthology.orchestra.run.smithi158.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplejson amd64 3.13.2-1 [61.2 kB] 2019-12-05T03:47:06.403 INFO:teuthology.orchestra.run.smithi096.stdout:Get:11 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 15.0.0-8014-gc529080-1bionic [427 kB] 2019-12-05T03:47:06.407 INFO:teuthology.orchestra.run.smithi096.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2019-12-05T03:47:06.410 INFO:teuthology.orchestra.run.smithi096.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2019-12-05T03:47:06.433 INFO:teuthology.orchestra.run.smithi096.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 python-rados amd64 15.0.0-8014-gc529080-1bionic [303 kB] 2019-12-05T03:47:06.434 INFO:teuthology.orchestra.run.smithi096.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2019-12-05T03:47:06.441 INFO:teuthology.orchestra.run.smithi096.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bcrypt amd64 3.1.4-2 [29.8 kB] 2019-12-05T03:47:06.445 INFO:teuthology.orchestra.run.smithi096.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-cherrypy3 all 8.9.1-2 [160 kB] 2019-12-05T03:47:06.460 INFO:teuthology.orchestra.run.smithi096.stdout:Get:18 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 python-ceph-argparse all 15.0.0-8014-gc529080-1bionic [20.2 kB] 2019-12-05T03:47:06.460 INFO:teuthology.orchestra.run.smithi096.stdout:Get:19 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 python-cephfs amd64 15.0.0-8014-gc529080-1bionic [113 kB] 2019-12-05T03:47:06.464 INFO:teuthology.orchestra.run.smithi096.stdout:Get:20 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 python-ceph-common all 15.0.0-8014-gc529080-1bionic [33.0 kB] 2019-12-05T03:47:06.464 INFO:teuthology.orchestra.run.smithi096.stdout:Get:21 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 python-rbd amd64 15.0.0-8014-gc529080-1bionic [262 kB] 2019-12-05T03:47:06.466 INFO:teuthology.orchestra.run.smithi096.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-jwt all 1.5.3+ds1-1 [15.8 kB] 2019-12-05T03:47:06.467 INFO:teuthology.orchestra.run.smithi096.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openssl all 17.5.0-1ubuntu1 [41.3 kB] 2019-12-05T03:47:06.470 INFO:teuthology.orchestra.run.smithi158.stdout:Get:24 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 15.0.0-8014-gc529080-1bionic [427 kB] 2019-12-05T03:47:06.472 INFO:teuthology.orchestra.run.smithi096.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-logutils all 0.3.3-5 [16.7 kB] 2019-12-05T03:47:06.474 INFO:teuthology.orchestra.run.smithi096.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-markupsafe amd64 1.0-1build1 [13.0 kB] 2019-12-05T03:47:06.489 INFO:teuthology.orchestra.run.smithi096.stdout:Get:26 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 15.0.0-8014-gc529080-1bionic [4,538 kB] 2019-12-05T03:47:06.498 INFO:teuthology.orchestra.run.smithi158.stdout:Get:25 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 python-rados amd64 15.0.0-8014-gc529080-1bionic [303 kB] 2019-12-05T03:47:06.504 INFO:teuthology.orchestra.run.smithi096.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-mako all 1.0.7+ds1-1 [60.1 kB] 2019-12-05T03:47:06.509 INFO:teuthology.orchestra.run.smithi096.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplegeneric all 0.8.1-1 [11.5 kB] 2019-12-05T03:47:06.522 INFO:teuthology.orchestra.run.smithi158.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2019-12-05T03:47:06.528 INFO:teuthology.orchestra.run.smithi158.stdout:Get:27 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 python-ceph-argparse all 15.0.0-8014-gc529080-1bionic [20.2 kB] 2019-12-05T03:47:06.529 INFO:teuthology.orchestra.run.smithi158.stdout:Get:28 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 python-cephfs amd64 15.0.0-8014-gc529080-1bionic [113 kB] 2019-12-05T03:47:06.540 INFO:teuthology.orchestra.run.smithi158.stdout:Get:29 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 python-ceph-common all 15.0.0-8014-gc529080-1bionic [33.0 kB] 2019-12-05T03:47:06.547 INFO:teuthology.orchestra.run.smithi158.stdout:Get:30 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 python-rbd amd64 15.0.0-8014-gc529080-1bionic [262 kB] 2019-12-05T03:47:06.563 INFO:teuthology.orchestra.run.smithi158.stdout:Get:31 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 15.0.0-8014-gc529080-1bionic [4,538 kB] 2019-12-05T03:47:06.585 INFO:teuthology.orchestra.run.smithi096.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-singledispatch all 3.4.0.3-2 [9,848 B] 2019-12-05T03:47:06.585 INFO:teuthology.orchestra.run.smithi096.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplejson amd64 3.13.2-1 [61.2 kB] 2019-12-05T03:47:06.737 INFO:teuthology.orchestra.run.smithi096.stdout:Get:31 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 python-rgw amd64 15.0.0-8014-gc529080-1bionic [98.7 kB] 2019-12-05T03:47:06.740 INFO:teuthology.orchestra.run.smithi096.stdout:Get:32 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 15.0.0-8014-gc529080-1bionic [329 kB] 2019-12-05T03:47:06.749 INFO:teuthology.orchestra.run.smithi096.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2019-12-05T03:47:06.761 INFO:teuthology.orchestra.run.smithi096.stdout:Get:34 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 15.0.0-8014-gc529080-1bionic [18.0 MB] 2019-12-05T03:47:06.821 INFO:teuthology.orchestra.run.smithi158.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bs4 all 4.6.0-1 [67.9 kB] 2019-12-05T03:47:06.876 INFO:teuthology.orchestra.run.smithi158.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-waitress all 1.0.1-1 [53.3 kB] 2019-12-05T03:47:06.931 INFO:teuthology.orchestra.run.smithi158.stdout:Get:34 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 python-rgw amd64 15.0.0-8014-gc529080-1bionic [98.7 kB] 2019-12-05T03:47:06.935 INFO:teuthology.orchestra.run.smithi158.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-dnspython all 1.15.0-1 [84.9 kB] 2019-12-05T03:47:06.942 INFO:teuthology.orchestra.run.smithi158.stdout:Get:36 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 15.0.0-8014-gc529080-1bionic [329 kB] 2019-12-05T03:47:06.971 INFO:teuthology.orchestra.run.smithi158.stdout:Get:37 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 15.0.0-8014-gc529080-1bionic [18.0 MB] 2019-12-05T03:47:06.988 INFO:teuthology.orchestra.run.smithi158.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/main amd64 formencode-i18n all 1.3.0-0ubuntu5 [3,382 B] 2019-12-05T03:47:06.990 INFO:teuthology.orchestra.run.smithi158.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-formencode all 1.3.0-0ubuntu5 [69.1 kB] 2019-12-05T03:47:07.013 INFO:teuthology.orchestra.run.smithi096.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bs4 all 4.6.0-1 [67.9 kB] 2019-12-05T03:47:07.014 INFO:teuthology.orchestra.run.smithi158.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-tempita all 0.5.2-2 [13.9 kB] 2019-12-05T03:47:07.018 INFO:teuthology.orchestra.run.smithi158.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2019-12-05T03:47:07.035 INFO:teuthology.orchestra.run.smithi096.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-waitress all 1.0.1-1 [53.3 kB] 2019-12-05T03:47:07.115 INFO:teuthology.orchestra.run.smithi096.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-dnspython all 1.15.0-1 [84.9 kB] 2019-12-05T03:47:07.120 INFO:teuthology.orchestra.run.smithi158.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2019-12-05T03:47:07.121 INFO:teuthology.orchestra.run.smithi158.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy all 1.5.2-4 [25.6 kB] 2019-12-05T03:47:07.124 INFO:teuthology.orchestra.run.smithi158.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webtest all 2.0.28-1ubuntu1 [27.8 kB] 2019-12-05T03:47:07.128 INFO:teuthology.orchestra.run.smithi158.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pecan all 1.2.1-2 [86.1 kB] 2019-12-05T03:47:07.143 INFO:teuthology.orchestra.run.smithi158.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-certifi all 2018.1.18-2 [144 kB] 2019-12-05T03:47:07.155 INFO:teuthology.orchestra.run.smithi096.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/main amd64 formencode-i18n all 1.3.0-0ubuntu5 [3,382 B] 2019-12-05T03:47:07.158 INFO:teuthology.orchestra.run.smithi096.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-formencode all 1.3.0-0ubuntu5 [69.1 kB] 2019-12-05T03:47:07.169 INFO:teuthology.orchestra.run.smithi158.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-chardet all 3.0.4-1 [80.3 kB] 2019-12-05T03:47:07.176 INFO:teuthology.orchestra.run.smithi158.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-urllib3 all 1.22-1ubuntu0.18.04.1 [85.9 kB] 2019-12-05T03:47:07.183 INFO:teuthology.orchestra.run.smithi158.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-requests all 2.18.4-2ubuntu0.1 [58.5 kB] 2019-12-05T03:47:07.188 INFO:teuthology.orchestra.run.smithi158.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-werkzeug all 0.14.1+dfsg1-1 [174 kB] 2019-12-05T03:47:07.189 INFO:teuthology.orchestra.run.smithi096.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-tempita all 0.5.2-2 [13.9 kB] 2019-12-05T03:47:07.192 INFO:teuthology.orchestra.run.smithi096.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2019-12-05T03:47:07.226 INFO:teuthology.orchestra.run.smithi158.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-repoze.lru all 0.7-1 [11.9 kB] 2019-12-05T03:47:07.226 INFO:teuthology.orchestra.run.smithi158.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-underscore all 1.8.3~dfsg-1 [59.9 kB] 2019-12-05T03:47:07.230 INFO:teuthology.orchestra.run.smithi158.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-sphinxdoc all 1.6.7-1ubuntu1 [85.6 kB] 2019-12-05T03:47:07.235 INFO:teuthology.orchestra.run.smithi158.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-routes all 2.4.1-1 [88.3 kB] 2019-12-05T03:47:07.296 INFO:teuthology.orchestra.run.smithi096.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2019-12-05T03:47:07.296 INFO:teuthology.orchestra.run.smithi096.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy all 1.5.2-4 [25.6 kB] 2019-12-05T03:47:07.300 INFO:teuthology.orchestra.run.smithi096.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webtest all 2.0.28-1ubuntu1 [27.8 kB] 2019-12-05T03:47:07.304 INFO:teuthology.orchestra.run.smithi096.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pecan all 1.2.1-2 [86.1 kB] 2019-12-05T03:47:07.315 INFO:teuthology.orchestra.run.smithi096.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-certifi all 2018.1.18-2 [144 kB] 2019-12-05T03:47:07.337 INFO:teuthology.orchestra.run.smithi096.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-chardet all 3.0.4-1 [80.3 kB] 2019-12-05T03:47:07.345 INFO:teuthology.orchestra.run.smithi096.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-urllib3 all 1.22-1ubuntu0.18.04.1 [85.9 kB] 2019-12-05T03:47:07.351 INFO:teuthology.orchestra.run.smithi096.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-requests all 2.18.4-2ubuntu0.1 [58.5 kB] 2019-12-05T03:47:07.356 INFO:teuthology.orchestra.run.smithi096.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-werkzeug all 0.14.1+dfsg1-1 [174 kB] 2019-12-05T03:47:07.402 INFO:teuthology.orchestra.run.smithi158.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-decorator all 4.1.2-1 [9,300 B] 2019-12-05T03:47:07.416 INFO:teuthology.orchestra.run.smithi096.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-repoze.lru all 0.7-1 [11.9 kB] 2019-12-05T03:47:07.416 INFO:teuthology.orchestra.run.smithi096.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-underscore all 1.8.3~dfsg-1 [59.9 kB] 2019-12-05T03:47:07.419 INFO:teuthology.orchestra.run.smithi096.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-sphinxdoc all 1.6.7-1ubuntu1 [85.6 kB] 2019-12-05T03:47:07.421 INFO:teuthology.orchestra.run.smithi096.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-routes all 2.4.1-1 [88.3 kB] 2019-12-05T03:47:07.508 INFO:teuthology.orchestra.run.smithi158.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-scipy amd64 0.19.1-2ubuntu1 [9,689 kB] 2019-12-05T03:47:07.587 INFO:teuthology.orchestra.run.smithi096.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-decorator all 4.1.2-1 [9,300 B] 2019-12-05T03:47:07.668 INFO:teuthology.orchestra.run.smithi096.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-scipy amd64 0.19.1-2ubuntu1 [9,689 kB] 2019-12-05T03:47:07.798 INFO:teuthology.orchestra.run.smithi096.stdout:Get:57 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 15.0.0-8014-gc529080-1bionic [5,087 kB] 2019-12-05T03:47:08.023 INFO:teuthology.orchestra.run.smithi096.stdout:Get:58 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 15.0.0-8014-gc529080-1bionic [1,382 kB] 2019-12-05T03:47:08.092 INFO:teuthology.orchestra.run.smithi096.stdout:Get:59 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 15.0.0-8014-gc529080-1bionic [5,943 kB] 2019-12-05T03:47:08.309 INFO:teuthology.orchestra.run.smithi158.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-sklearn-lib amd64 0.19.1-3 [1,521 kB] 2019-12-05T03:47:08.343 INFO:teuthology.orchestra.run.smithi158.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-joblib all 0.11-1 [112 kB] 2019-12-05T03:47:08.347 INFO:teuthology.orchestra.run.smithi158.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-sklearn all 0.19.1-3 [1,373 kB] 2019-12-05T03:47:08.392 INFO:teuthology.orchestra.run.smithi158.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-monotonic all 1.1-2 [5,262 B] 2019-12-05T03:47:08.392 INFO:teuthology.orchestra.run.smithi158.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-fasteners all 0.12.0-3 [13.4 kB] 2019-12-05T03:47:08.393 INFO:teuthology.orchestra.run.smithi158.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-httplib2 all 0.9.2+dfsg-1ubuntu0.1 [34.7 kB] 2019-12-05T03:47:08.394 INFO:teuthology.orchestra.run.smithi158.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyasn1 all 0.4.2-3 [46.7 kB] 2019-12-05T03:47:08.396 INFO:teuthology.orchestra.run.smithi158.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyasn1-modules all 0.2.1-0.2 [32.8 kB] 2019-12-05T03:47:08.397 INFO:teuthology.orchestra.run.smithi158.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-rsa all 3.4.2-1 [28.9 kB] 2019-12-05T03:47:08.399 INFO:teuthology.orchestra.run.smithi158.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-sqlalchemy all 1.1.11+ds1-1ubuntu1 [682 kB] 2019-12-05T03:47:08.421 INFO:teuthology.orchestra.run.smithi096.stdout:Get:60 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 15.0.0-8014-gc529080-1bionic [22.5 MB] 2019-12-05T03:47:08.425 INFO:teuthology.orchestra.run.smithi096.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-sklearn-lib amd64 0.19.1-3 [1,521 kB] 2019-12-05T03:47:08.437 INFO:teuthology.orchestra.run.smithi158.stdout:Get:67 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 15.0.0-8014-gc529080-1bionic [5,087 kB] 2019-12-05T03:47:08.472 INFO:teuthology.orchestra.run.smithi096.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-joblib all 0.11-1 [112 kB] 2019-12-05T03:47:08.472 INFO:teuthology.orchestra.run.smithi158.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-oauth2client all 4.1.2-3 [61.4 kB] 2019-12-05T03:47:08.473 INFO:teuthology.orchestra.run.smithi096.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-sklearn all 0.19.1-3 [1,373 kB] 2019-12-05T03:47:08.474 INFO:teuthology.orchestra.run.smithi158.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2019-12-05T03:47:08.503 INFO:teuthology.orchestra.run.smithi096.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-monotonic all 1.1-2 [5,262 B] 2019-12-05T03:47:08.503 INFO:teuthology.orchestra.run.smithi096.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-fasteners all 0.12.0-3 [13.4 kB] 2019-12-05T03:47:08.504 INFO:teuthology.orchestra.run.smithi096.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-httplib2 all 0.9.2+dfsg-1ubuntu0.1 [34.7 kB] 2019-12-05T03:47:08.504 INFO:teuthology.orchestra.run.smithi096.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyasn1 all 0.4.2-3 [46.7 kB] 2019-12-05T03:47:08.504 INFO:teuthology.orchestra.run.smithi096.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyasn1-modules all 0.2.1-0.2 [32.8 kB] 2019-12-05T03:47:08.506 INFO:teuthology.orchestra.run.smithi096.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-rsa all 3.4.2-1 [28.9 kB] 2019-12-05T03:47:08.507 INFO:teuthology.orchestra.run.smithi096.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-sqlalchemy all 1.1.11+ds1-1ubuntu1 [682 kB] 2019-12-05T03:47:08.553 INFO:teuthology.orchestra.run.smithi158.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-yaml amd64 3.12-1build2 [115 kB] 2019-12-05T03:47:08.556 INFO:teuthology.orchestra.run.smithi158.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2019-12-05T03:47:08.562 INFO:teuthology.orchestra.run.smithi158.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2019-12-05T03:47:08.565 INFO:teuthology.orchestra.run.smithi158.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2019-12-05T03:47:08.566 INFO:teuthology.orchestra.run.smithi158.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2019-12-05T03:47:08.567 INFO:teuthology.orchestra.run.smithi158.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2019-12-05T03:47:08.570 INFO:teuthology.orchestra.run.smithi158.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2019-12-05T03:47:08.587 INFO:teuthology.orchestra.run.smithi096.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-oauth2client all 4.1.2-3 [61.4 kB] 2019-12-05T03:47:08.589 INFO:teuthology.orchestra.run.smithi096.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2019-12-05T03:47:08.590 INFO:teuthology.orchestra.run.smithi096.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-yaml amd64 3.12-1build2 [115 kB] 2019-12-05T03:47:08.595 INFO:teuthology.orchestra.run.smithi096.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2019-12-05T03:47:08.600 INFO:teuthology.orchestra.run.smithi096.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2019-12-05T03:47:08.602 INFO:teuthology.orchestra.run.smithi096.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2019-12-05T03:47:08.603 INFO:teuthology.orchestra.run.smithi096.stdout:Get:77 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2019-12-05T03:47:08.670 INFO:teuthology.orchestra.run.smithi096.stdout:Get:78 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2019-12-05T03:47:08.677 INFO:teuthology.orchestra.run.smithi096.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2019-12-05T03:47:08.733 INFO:teuthology.orchestra.run.smithi158.stdout:Get:77 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2019-12-05T03:47:08.839 INFO:teuthology.orchestra.run.smithi096.stdout:Get:80 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2019-12-05T03:47:08.860 INFO:teuthology.orchestra.run.smithi158.stdout:Get:78 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 15.0.0-8014-gc529080-1bionic [1,382 kB] 2019-12-05T03:47:08.958 INFO:teuthology.orchestra.run.smithi158.stdout:Get:79 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 15.0.0-8014-gc529080-1bionic [5,943 kB] 2019-12-05T03:47:09.224 INFO:teuthology.orchestra.run.smithi158.stdout:Get:80 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-colorama all 0.3.7-1 [14.9 kB] 2019-12-05T03:47:09.226 INFO:teuthology.orchestra.run.smithi158.stdout:Get:81 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2019-12-05T03:47:09.229 INFO:teuthology.orchestra.run.smithi158.stdout:Get:82 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2019-12-05T03:47:09.351 INFO:teuthology.orchestra.run.smithi096.stdout:Get:81 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-colorama all 0.3.7-1 [14.9 kB] 2019-12-05T03:47:09.352 INFO:teuthology.orchestra.run.smithi096.stdout:Get:82 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2019-12-05T03:47:09.352 INFO:teuthology.orchestra.run.smithi096.stdout:Get:83 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2019-12-05T03:47:09.352 INFO:teuthology.orchestra.run.smithi096.stdout:Get:84 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webencodings all 0.5-2 [10.3 kB] 2019-12-05T03:47:09.352 INFO:teuthology.orchestra.run.smithi096.stdout:Get:85 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-html5lib all 0.999999999-1 [83.6 kB] 2019-12-05T03:47:09.352 INFO:teuthology.orchestra.run.smithi096.stdout:Get:86 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-lxml amd64 4.2.1-1ubuntu0.1 [1,075 kB] 2019-12-05T03:47:09.352 INFO:teuthology.orchestra.run.smithi158.stdout:Get:83 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webencodings all 0.5-2 [10.3 kB] 2019-12-05T03:47:09.353 INFO:teuthology.orchestra.run.smithi158.stdout:Get:84 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-html5lib all 0.999999999-1 [83.6 kB] 2019-12-05T03:47:09.353 INFO:teuthology.orchestra.run.smithi158.stdout:Get:85 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-lxml amd64 4.2.1-1ubuntu0.1 [1,075 kB] 2019-12-05T03:47:09.400 INFO:teuthology.orchestra.run.smithi158.stdout:Get:86 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openid all 2.2.5-6 [97.8 kB] 2019-12-05T03:47:09.405 INFO:teuthology.orchestra.run.smithi158.stdout:Get:87 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastescript all 2.0.2-2 [54.9 kB] 2019-12-05T03:47:09.409 INFO:teuthology.orchestra.run.smithi158.stdout:Get:88 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2019-12-05T03:47:09.410 INFO:teuthology.orchestra.run.smithi158.stdout:Get:89 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2019-12-05T03:47:09.414 INFO:teuthology.orchestra.run.smithi158.stdout:Get:90 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyinotify all 0.9.6-1 [24.6 kB] 2019-12-05T03:47:09.415 INFO:teuthology.orchestra.run.smithi158.stdout:Get:91 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2019-12-05T03:47:09.425 INFO:teuthology.orchestra.run.smithi158.stdout:Get:92 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-scgi amd64 1.13-1.1build1 [18.4 kB] 2019-12-05T03:47:09.427 INFO:teuthology.orchestra.run.smithi158.stdout:Get:93 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-sqlalchemy-ext amd64 1.1.11+ds1-1ubuntu1 [13.4 kB] 2019-12-05T03:47:09.438 INFO:teuthology.orchestra.run.smithi158.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 15.0.0-8014-gc529080-1bionic [22.5 MB] 2019-12-05T03:47:09.511 INFO:teuthology.orchestra.run.smithi096.stdout:Get:87 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openid all 2.2.5-6 [97.8 kB] 2019-12-05T03:47:09.521 INFO:teuthology.orchestra.run.smithi096.stdout:Get:88 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastescript all 2.0.2-2 [54.9 kB] 2019-12-05T03:47:09.521 INFO:teuthology.orchestra.run.smithi096.stdout:Get:89 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2019-12-05T03:47:09.522 INFO:teuthology.orchestra.run.smithi096.stdout:Get:90 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2019-12-05T03:47:09.526 INFO:teuthology.orchestra.run.smithi096.stdout:Get:91 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyinotify all 0.9.6-1 [24.6 kB] 2019-12-05T03:47:09.528 INFO:teuthology.orchestra.run.smithi096.stdout:Get:92 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2019-12-05T03:47:09.539 INFO:teuthology.orchestra.run.smithi096.stdout:Get:93 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-scgi amd64 1.13-1.1build1 [18.4 kB] 2019-12-05T03:47:09.539 INFO:teuthology.orchestra.run.smithi096.stdout:Get:94 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-sqlalchemy-ext amd64 1.1.11+ds1-1ubuntu1 [13.4 kB] 2019-12-05T03:47:09.667 INFO:teuthology.orchestra.run.smithi096.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 15.0.0-8014-gc529080-1bionic [3,804 B] 2019-12-05T03:47:09.667 INFO:teuthology.orchestra.run.smithi096.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 ceph-daemon amd64 15.0.0-8014-gc529080-1bionic [18.9 kB] 2019-12-05T03:47:09.668 INFO:teuthology.orchestra.run.smithi096.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 15.0.0-8014-gc529080-1bionic [506 kB] 2019-12-05T03:47:09.680 INFO:teuthology.orchestra.run.smithi096.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 15.0.0-8014-gc529080-1bionic [1,829 kB] 2019-12-05T03:47:09.797 INFO:teuthology.orchestra.run.smithi096.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 15.0.0-8014-gc529080-1bionic [3,392 kB] 2019-12-05T03:47:09.975 INFO:teuthology.orchestra.run.smithi096.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 15.0.0-8014-gc529080-1bionic [34.1 kB] 2019-12-05T03:47:09.977 INFO:teuthology.orchestra.run.smithi096.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 15.0.0-8014-gc529080-1bionic [7,867 kB] 2019-12-05T03:47:10.406 INFO:teuthology.orchestra.run.smithi096.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 15.0.0-8014-gc529080-1bionic [3,916 B] 2019-12-05T03:47:10.407 INFO:teuthology.orchestra.run.smithi096.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 15.0.0-8014-gc529080-1bionic [13.3 kB] 2019-12-05T03:47:10.407 INFO:teuthology.orchestra.run.smithi096.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-ssh all 15.0.0-8014-gc529080-1bionic [18.2 kB] 2019-12-05T03:47:10.407 INFO:teuthology.orchestra.run.smithi096.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 15.0.0-8014-gc529080-1bionic [36.0 MB] 2019-12-05T03:47:11.268 INFO:teuthology.orchestra.run.smithi158.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 15.0.0-8014-gc529080-1bionic [3,804 B] 2019-12-05T03:47:11.269 INFO:teuthology.orchestra.run.smithi158.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 ceph-daemon amd64 15.0.0-8014-gc529080-1bionic [18.9 kB] 2019-12-05T03:47:11.269 INFO:teuthology.orchestra.run.smithi158.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 15.0.0-8014-gc529080-1bionic [506 kB] 2019-12-05T03:47:11.292 INFO:teuthology.orchestra.run.smithi158.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 15.0.0-8014-gc529080-1bionic [1,829 kB] 2019-12-05T03:47:11.445 INFO:teuthology.orchestra.run.smithi158.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 15.0.0-8014-gc529080-1bionic [3,392 kB] 2019-12-05T03:47:11.728 INFO:teuthology.orchestra.run.smithi158.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 15.0.0-8014-gc529080-1bionic [34.1 kB] 2019-12-05T03:47:11.733 INFO:teuthology.orchestra.run.smithi158.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 15.0.0-8014-gc529080-1bionic [7,867 kB] 2019-12-05T03:47:12.351 INFO:teuthology.orchestra.run.smithi096.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 15.0.0-8014-gc529080-1bionic [323 kB] 2019-12-05T03:47:12.354 INFO:teuthology.orchestra.run.smithi096.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse all 15.0.0-8014-gc529080-1bionic [20.5 kB] 2019-12-05T03:47:12.355 INFO:teuthology.orchestra.run.smithi096.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 15.0.0-8014-gc529080-1bionic [117 kB] 2019-12-05T03:47:12.360 INFO:teuthology.orchestra.run.smithi096.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 cephfs-shell all 15.0.0-8014-gc529080-1bionic [14.7 kB] 2019-12-05T03:47:12.361 INFO:teuthology.orchestra.run.smithi096.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 15.0.0-8014-gc529080-1bionic [17.3 kB] 2019-12-05T03:47:12.361 INFO:teuthology.orchestra.run.smithi096.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 python-ceph amd64 15.0.0-8014-gc529080-1bionic [3,860 B] 2019-12-05T03:47:12.362 INFO:teuthology.orchestra.run.smithi096.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 15.0.0-8014-gc529080-1bionic [5,194 kB] 2019-12-05T03:47:12.475 INFO:teuthology.orchestra.run.smithi158.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 15.0.0-8014-gc529080-1bionic [3,916 B] 2019-12-05T03:47:12.475 INFO:teuthology.orchestra.run.smithi158.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 15.0.0-8014-gc529080-1bionic [13.3 kB] 2019-12-05T03:47:12.476 INFO:teuthology.orchestra.run.smithi158.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-ssh all 15.0.0-8014-gc529080-1bionic [18.2 kB] 2019-12-05T03:47:12.476 INFO:teuthology.orchestra.run.smithi158.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 15.0.0-8014-gc529080-1bionic [36.0 MB] 2019-12-05T03:47:12.621 INFO:teuthology.orchestra.run.smithi096.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 15.0.0-8014-gc529080-1bionic [62.2 kB] 2019-12-05T03:47:13.320 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 139 MB in 7s (20.1 MB/s) 2019-12-05T03:47:13.466 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-uritemplate. 2019-12-05T03:47:13.514 INFO:teuthology.orchestra.run.smithi096.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137175 files and directories currently installed.) 2019-12-05T03:47:13.518 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../000-python-uritemplate_0.6-1ubuntu1_all.deb ... 2019-12-05T03:47:13.569 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-uritemplate (0.6-1ubuntu1) ... 2019-12-05T03:47:13.758 INFO:teuthology.orchestra.run.smithi158.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 15.0.0-8014-gc529080-1bionic [323 kB] 2019-12-05T03:47:13.764 INFO:teuthology.orchestra.run.smithi158.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse all 15.0.0-8014-gc529080-1bionic [20.5 kB] 2019-12-05T03:47:13.765 INFO:teuthology.orchestra.run.smithi158.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 15.0.0-8014-gc529080-1bionic [117 kB] 2019-12-05T03:47:13.769 INFO:teuthology.orchestra.run.smithi158.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 cephfs-shell all 15.0.0-8014-gc529080-1bionic [14.7 kB] 2019-12-05T03:47:13.770 INFO:teuthology.orchestra.run.smithi158.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 15.0.0-8014-gc529080-1bionic [17.3 kB] 2019-12-05T03:47:13.771 INFO:teuthology.orchestra.run.smithi158.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 python-ceph amd64 15.0.0-8014-gc529080-1bionic [3,860 B] 2019-12-05T03:47:13.771 INFO:teuthology.orchestra.run.smithi158.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 15.0.0-8014-gc529080-1bionic [5,194 kB] 2019-12-05T03:47:13.872 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pyparsing. 2019-12-05T03:47:13.884 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../001-python3-pyparsing_2.2.0+dfsg1-2_all.deb ... 2019-12-05T03:47:13.922 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pyparsing (2.2.0+dfsg1-2) ... 2019-12-05T03:47:13.942 INFO:teuthology.orchestra.run.smithi158.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20191204.231200/c5290805033483ba0cec165c06bde07dae5f19ec/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 15.0.0-8014-gc529080-1bionic [62.2 kB] 2019-12-05T03:47:14.233 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pyperclip. 2019-12-05T03:47:14.249 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../002-python3-pyperclip_1.6.0-1_all.deb ... 2019-12-05T03:47:14.291 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pyperclip (1.6.0-1) ... 2019-12-05T03:47:14.619 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cmd2. 2019-12-05T03:47:14.626 INFO:teuthology.orchestra.run.smithi158.stdout:Fetched 139 MB in 8s (16.5 MB/s) 2019-12-05T03:47:14.632 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../003-python3-cmd2_0.7.9-0ubuntu1_all.deb ... 2019-12-05T03:47:14.677 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cmd2 (0.7.9-0ubuntu1) ... 2019-12-05T03:47:14.749 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-uritemplate. 2019-12-05T03:47:14.798 INFO:teuthology.orchestra.run.smithi158.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137175 files and directories currently installed.) 2019-12-05T03:47:14.802 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../000-python-uritemplate_0.6-1ubuntu1_all.deb ... 2019-12-05T03:47:14.856 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-uritemplate (0.6-1ubuntu1) ... 2019-12-05T03:47:15.034 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2019-12-05T03:47:15.050 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../004-liblttng-ust0_2.10.1-1_amd64.deb ... 2019-12-05T03:47:15.135 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2019-12-05T03:47:15.168 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-pyparsing. 2019-12-05T03:47:15.182 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../001-python3-pyparsing_2.2.0+dfsg1-2_all.deb ... 2019-12-05T03:47:15.226 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-pyparsing (2.2.0+dfsg1-2) ... 2019-12-05T03:47:15.486 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../005-librbd1_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:47:15.537 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-pyperclip. 2019-12-05T03:47:15.550 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../002-python3-pyperclip_1.6.0-1_all.deb ... 2019-12-05T03:47:15.588 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-pyperclip (1.6.0-1) ... 2019-12-05T03:47:15.614 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librbd1 (15.0.0-8014-gc529080-1bionic) over (12.2.12-0ubuntu0.18.04.3) ... 2019-12-05T03:47:15.899 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-cmd2. 2019-12-05T03:47:15.913 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../003-python3-cmd2_0.7.9-0ubuntu1_all.deb ... 2019-12-05T03:47:15.957 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-cmd2 (0.7.9-0ubuntu1) ... 2019-12-05T03:47:16.095 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../006-librados2_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:47:16.214 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librados2 (15.0.0-8014-gc529080-1bionic) over (12.2.12-0ubuntu0.18.04.3) ... 2019-12-05T03:47:16.299 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2019-12-05T03:47:16.314 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../004-liblttng-ust0_2.10.1-1_amd64.deb ... 2019-12-05T03:47:16.400 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2019-12-05T03:47:16.760 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../005-librbd1_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:47:16.834 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libcephfs2. 2019-12-05T03:47:16.852 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../007-libcephfs2_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:47:16.888 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking librbd1 (15.0.0-8014-gc529080-1bionic) over (12.2.12-0ubuntu0.18.04.3) ... 2019-12-05T03:47:16.892 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libcephfs2 (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:17.220 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-rados. 2019-12-05T03:47:17.235 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../008-python-rados_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:47:17.278 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-rados (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:17.436 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../006-librados2_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:47:17.564 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking librados2 (15.0.0-8014-gc529080-1bionic) over (12.2.12-0ubuntu0.18.04.3) ... 2019-12-05T03:47:17.577 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-ceph-argparse. 2019-12-05T03:47:17.591 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../009-python-ceph-argparse_15.0.0-8014-gc529080-1bionic_all.deb ... 2019-12-05T03:47:17.635 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-ceph-argparse (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:17.963 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-cephfs. 2019-12-05T03:47:17.976 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../010-python-cephfs_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:47:18.021 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-cephfs (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:18.193 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libcephfs2. 2019-12-05T03:47:18.208 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../007-libcephfs2_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:47:18.251 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libcephfs2 (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:18.298 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-ceph-common. 2019-12-05T03:47:18.311 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../011-python-ceph-common_15.0.0-8014-gc529080-1bionic_all.deb ... 2019-12-05T03:47:18.348 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-ceph-common (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:18.537 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-rados. 2019-12-05T03:47:18.551 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../008-python-rados_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:47:18.596 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-rados (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:18.702 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-prettytable. 2019-12-05T03:47:18.716 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../012-python-prettytable_0.7.2-3_all.deb ... 2019-12-05T03:47:18.760 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-prettytable (0.7.2-3) ... 2019-12-05T03:47:18.904 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-ceph-argparse. 2019-12-05T03:47:18.919 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../009-python-ceph-argparse_15.0.0-8014-gc529080-1bionic_all.deb ... 2019-12-05T03:47:18.963 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-ceph-argparse (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:18.991 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-rbd. 2019-12-05T03:47:19.006 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../013-python-rbd_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:47:19.049 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-rbd (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:19.282 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-cephfs. 2019-12-05T03:47:19.296 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../010-python-cephfs_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:47:19.349 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-cephfs (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:19.402 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librabbitmq4:amd64. 2019-12-05T03:47:19.416 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../014-librabbitmq4_0.8.0-1ubuntu0.18.04.1_amd64.deb ... 2019-12-05T03:47:19.477 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.1) ... 2019-12-05T03:47:19.610 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-ceph-common. 2019-12-05T03:47:19.623 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../011-python-ceph-common_15.0.0-8014-gc529080-1bionic_all.deb ... 2019-12-05T03:47:19.660 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-ceph-common (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:19.813 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librdkafka1:amd64. 2019-12-05T03:47:19.827 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../015-librdkafka1_0.11.3-1build1_amd64.deb ... 2019-12-05T03:47:19.871 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librdkafka1:amd64 (0.11.3-1build1) ... 2019-12-05T03:47:20.005 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-prettytable. 2019-12-05T03:47:20.019 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../012-python-prettytable_0.7.2-3_all.deb ... 2019-12-05T03:47:20.063 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-prettytable (0.7.2-3) ... 2019-12-05T03:47:20.203 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librgw2. 2019-12-05T03:47:20.220 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../016-librgw2_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:47:20.253 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librgw2 (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:20.329 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-rbd. 2019-12-05T03:47:20.343 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../013-python-rbd_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:47:20.387 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-rbd (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:20.808 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package librabbitmq4:amd64. 2019-12-05T03:47:20.820 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../014-librabbitmq4_0.8.0-1ubuntu0.18.04.1_amd64.deb ... 2019-12-05T03:47:20.857 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.1) ... 2019-12-05T03:47:20.880 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-rgw. 2019-12-05T03:47:20.896 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../017-python-rgw_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:47:20.939 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-rgw (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:21.177 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package librdkafka1:amd64. 2019-12-05T03:47:21.191 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../015-librdkafka1_0.11.3-1build1_amd64.deb ... 2019-12-05T03:47:21.241 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2019-12-05T03:47:21.255 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../018-libsnappy1v5_1.1.7-1_amd64.deb ... 2019-12-05T03:47:21.260 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking librdkafka1:amd64 (0.11.3-1build1) ... 2019-12-05T03:47:21.300 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2019-12-05T03:47:21.594 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2019-12-05T03:47:21.608 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../019-libleveldb1v5_1.20-2_amd64.deb ... 2019-12-05T03:47:21.627 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package librgw2. 2019-12-05T03:47:21.640 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../016-librgw2_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:47:21.652 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2019-12-05T03:47:21.677 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking librgw2 (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:22.035 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package liboath0. 2019-12-05T03:47:22.048 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../020-liboath0_2.6.1-1_amd64.deb ... 2019-12-05T03:47:22.085 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking liboath0 (2.6.1-1) ... 2019-12-05T03:47:22.330 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-rgw. 2019-12-05T03:47:22.343 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../017-python-rgw_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:47:22.388 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-rgw (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:22.430 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libradosstriper1. 2019-12-05T03:47:22.445 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../021-libradosstriper1_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:47:22.513 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libradosstriper1 (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:22.724 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2019-12-05T03:47:22.738 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../018-libsnappy1v5_1.1.7-1_amd64.deb ... 2019-12-05T03:47:22.807 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2019-12-05T03:47:22.949 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-common. 2019-12-05T03:47:22.964 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../022-ceph-common_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:47:23.007 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-common (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:23.094 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2019-12-05T03:47:23.109 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../019-libleveldb1v5_1.20-2_amd64.deb ... 2019-12-05T03:47:23.144 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2019-12-05T03:47:23.911 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package liboath0. 2019-12-05T03:47:23.924 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../020-liboath0_2.6.1-1_amd64.deb ... 2019-12-05T03:47:23.961 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking liboath0 (2.6.1-1) ... 2019-12-05T03:47:24.205 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libradosstriper1. 2019-12-05T03:47:24.220 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../021-libradosstriper1_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:47:24.255 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libradosstriper1 (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:24.700 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-common. 2019-12-05T03:47:24.714 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../022-ceph-common_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:47:24.718 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-base. 2019-12-05T03:47:24.733 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../023-ceph-base_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:47:24.767 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-common (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:24.785 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-base (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:25.678 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-bcrypt. 2019-12-05T03:47:25.692 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../024-python-bcrypt_3.1.4-2_amd64.deb ... 2019-12-05T03:47:25.736 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-bcrypt (3.1.4-2) ... 2019-12-05T03:47:26.039 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-cherrypy3. 2019-12-05T03:47:26.052 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../025-python-cherrypy3_8.9.1-2_all.deb ... 2019-12-05T03:47:26.089 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-cherrypy3 (8.9.1-2) ... 2019-12-05T03:47:26.421 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-jwt. 2019-12-05T03:47:26.436 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../026-python-jwt_1.5.3+ds1-1_all.deb ... 2019-12-05T03:47:26.480 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-jwt (1.5.3+ds1-1) ... 2019-12-05T03:47:26.521 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-base. 2019-12-05T03:47:26.534 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../023-ceph-base_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:47:26.572 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-base (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:26.766 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-openssl. 2019-12-05T03:47:26.797 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../027-python-openssl_17.5.0-1ubuntu1_all.deb ... 2019-12-05T03:47:26.825 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-openssl (17.5.0-1ubuntu1) ... 2019-12-05T03:47:27.127 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-logutils. 2019-12-05T03:47:27.144 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../028-python-logutils_0.3.3-5_all.deb ... 2019-12-05T03:47:27.177 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-logutils (0.3.3-5) ... 2019-12-05T03:47:27.480 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-markupsafe. 2019-12-05T03:47:27.493 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../029-python-markupsafe_1.0-1build1_amd64.deb ... 2019-12-05T03:47:27.543 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-markupsafe (1.0-1build1) ... 2019-12-05T03:47:27.558 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-bcrypt. 2019-12-05T03:47:27.574 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../024-python-bcrypt_3.1.4-2_amd64.deb ... 2019-12-05T03:47:27.617 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-bcrypt (3.1.4-2) ... 2019-12-05T03:47:27.838 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-mako. 2019-12-05T03:47:27.852 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../030-python-mako_1.0.7+ds1-1_all.deb ... 2019-12-05T03:47:27.945 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-cherrypy3. 2019-12-05T03:47:27.961 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../025-python-cherrypy3_8.9.1-2_all.deb ... 2019-12-05T03:47:28.003 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-cherrypy3 (8.9.1-2) ... 2019-12-05T03:47:28.246 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-mako (1.0.7+ds1-1) ... 2019-12-05T03:47:28.321 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-jwt. 2019-12-05T03:47:28.336 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../026-python-jwt_1.5.3+ds1-1_all.deb ... 2019-12-05T03:47:28.379 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-jwt (1.5.3+ds1-1) ... 2019-12-05T03:47:28.599 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-simplegeneric. 2019-12-05T03:47:28.612 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../031-python-simplegeneric_0.8.1-1_all.deb ... 2019-12-05T03:47:28.674 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-simplegeneric (0.8.1-1) ... 2019-12-05T03:47:28.724 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-openssl. 2019-12-05T03:47:28.739 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../027-python-openssl_17.5.0-1ubuntu1_all.deb ... 2019-12-05T03:47:28.790 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-openssl (17.5.0-1ubuntu1) ... 2019-12-05T03:47:28.973 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-singledispatch. 2019-12-05T03:47:28.988 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../032-python-singledispatch_3.4.0.3-2_all.deb ... 2019-12-05T03:47:29.031 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-singledispatch (3.4.0.3-2) ... 2019-12-05T03:47:29.077 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-logutils. 2019-12-05T03:47:29.092 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../028-python-logutils_0.3.3-5_all.deb ... 2019-12-05T03:47:29.127 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-logutils (0.3.3-5) ... 2019-12-05T03:47:29.342 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-simplejson. 2019-12-05T03:47:29.358 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../033-python-simplejson_3.13.2-1_amd64.deb ... 2019-12-05T03:47:29.369 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-markupsafe. 2019-12-05T03:47:29.383 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../029-python-markupsafe_1.0-1build1_amd64.deb ... 2019-12-05T03:47:29.400 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-simplejson (3.13.2-1) ... 2019-12-05T03:47:29.419 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-markupsafe (1.0-1build1) ... 2019-12-05T03:47:29.686 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-mako. 2019-12-05T03:47:29.695 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../030-python-mako_1.0.7+ds1-1_all.deb ... 2019-12-05T03:47:29.736 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-mako (1.0.7+ds1-1) ... 2019-12-05T03:47:29.743 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-webob. 2019-12-05T03:47:29.754 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../034-python-webob_1%3a1.7.3-2fakesync1_all.deb ... 2019-12-05T03:47:29.798 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-webob (1:1.7.3-2fakesync1) ... 2019-12-05T03:47:30.084 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-simplegeneric. 2019-12-05T03:47:30.097 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../031-python-simplegeneric_0.8.1-1_all.deb ... 2019-12-05T03:47:30.105 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-bs4. 2019-12-05T03:47:30.119 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../035-python-bs4_4.6.0-1_all.deb ... 2019-12-05T03:47:30.134 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-simplegeneric (0.8.1-1) ... 2019-12-05T03:47:30.163 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-bs4 (4.6.0-1) ... 2019-12-05T03:47:30.451 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-singledispatch. 2019-12-05T03:47:30.466 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../032-python-singledispatch_3.4.0.3-2_all.deb ... 2019-12-05T03:47:30.491 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-waitress. 2019-12-05T03:47:30.507 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../036-python-waitress_1.0.1-1_all.deb ... 2019-12-05T03:47:30.551 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-singledispatch (3.4.0.3-2) ... 2019-12-05T03:47:30.557 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-waitress (1.0.1-1) ... 2019-12-05T03:47:30.839 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-simplejson. 2019-12-05T03:47:30.855 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../033-python-simplejson_3.13.2-1_amd64.deb ... 2019-12-05T03:47:30.860 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-dnspython. 2019-12-05T03:47:30.877 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../037-python-dnspython_1.15.0-1_all.deb ... 2019-12-05T03:47:30.897 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-simplejson (3.13.2-1) ... 2019-12-05T03:47:30.919 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-dnspython (1.15.0-1) ... 2019-12-05T03:47:31.210 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package formencode-i18n. 2019-12-05T03:47:31.224 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../038-formencode-i18n_1.3.0-0ubuntu5_all.deb ... 2019-12-05T03:47:31.267 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-webob. 2019-12-05T03:47:31.277 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking formencode-i18n (1.3.0-0ubuntu5) ... 2019-12-05T03:47:31.281 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../034-python-webob_1%3a1.7.3-2fakesync1_all.deb ... 2019-12-05T03:47:31.325 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-webob (1:1.7.3-2fakesync1) ... 2019-12-05T03:47:31.579 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-formencode. 2019-12-05T03:47:31.593 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../039-python-formencode_1.3.0-0ubuntu5_all.deb ... 2019-12-05T03:47:31.629 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-formencode (1.3.0-0ubuntu5) ... 2019-12-05T03:47:31.677 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-bs4. 2019-12-05T03:47:31.690 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../035-python-bs4_4.6.0-1_all.deb ... 2019-12-05T03:47:31.743 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-bs4 (4.6.0-1) ... 2019-12-05T03:47:31.974 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-tempita. 2019-12-05T03:47:31.989 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../040-python-tempita_0.5.2-2_all.deb ... 2019-12-05T03:47:32.032 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-tempita (0.5.2-2) ... 2019-12-05T03:47:32.104 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-waitress. 2019-12-05T03:47:32.118 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../036-python-waitress_1.0.1-1_all.deb ... 2019-12-05T03:47:32.163 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-waitress (1.0.1-1) ... 2019-12-05T03:47:32.340 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-paste. 2019-12-05T03:47:32.355 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../041-python-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2019-12-05T03:47:32.399 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-paste (2.0.3+dfsg-4ubuntu1) ... 2019-12-05T03:47:32.491 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-dnspython. 2019-12-05T03:47:32.508 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../037-python-dnspython_1.15.0-1_all.deb ... 2019-12-05T03:47:32.575 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-dnspython (1.15.0-1) ... 2019-12-05T03:47:32.718 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2019-12-05T03:47:32.733 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../042-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2019-12-05T03:47:32.776 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2019-12-05T03:47:32.860 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package formencode-i18n. 2019-12-05T03:47:32.873 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../038-formencode-i18n_1.3.0-0ubuntu5_all.deb ... 2019-12-05T03:47:32.918 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking formencode-i18n (1.3.0-0ubuntu5) ... 2019-12-05T03:47:33.087 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-pastedeploy. 2019-12-05T03:47:33.103 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../043-python-pastedeploy_1.5.2-4_all.deb ... 2019-12-05T03:47:33.137 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-pastedeploy (1.5.2-4) ... 2019-12-05T03:47:33.237 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-formencode. 2019-12-05T03:47:33.253 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../039-python-formencode_1.3.0-0ubuntu5_all.deb ... 2019-12-05T03:47:33.295 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-formencode (1.3.0-0ubuntu5) ... 2019-12-05T03:47:33.562 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-webtest. 2019-12-05T03:47:33.576 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../044-python-webtest_2.0.28-1ubuntu1_all.deb ... 2019-12-05T03:47:33.620 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-webtest (2.0.28-1ubuntu1) ... 2019-12-05T03:47:33.666 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-tempita. 2019-12-05T03:47:33.680 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../040-python-tempita_0.5.2-2_all.deb ... 2019-12-05T03:47:33.724 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-tempita (0.5.2-2) ... 2019-12-05T03:47:33.982 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-pecan. 2019-12-05T03:47:33.996 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../045-python-pecan_1.2.1-2_all.deb ... 2019-12-05T03:47:34.041 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-paste. 2019-12-05T03:47:34.043 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-pecan (1.2.1-2) ... 2019-12-05T03:47:34.056 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../041-python-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2019-12-05T03:47:34.108 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-paste (2.0.3+dfsg-4ubuntu1) ... 2019-12-05T03:47:34.395 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2019-12-05T03:47:34.400 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-certifi. 2019-12-05T03:47:34.409 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../042-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2019-12-05T03:47:34.413 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../046-python-certifi_2018.1.18-2_all.deb ... 2019-12-05T03:47:34.453 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2019-12-05T03:47:34.458 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-certifi (2018.1.18-2) ... 2019-12-05T03:47:34.772 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-chardet. 2019-12-05T03:47:34.784 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../047-python-chardet_3.0.4-1_all.deb ... 2019-12-05T03:47:34.789 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-pastedeploy. 2019-12-05T03:47:34.804 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../043-python-pastedeploy_1.5.2-4_all.deb ... 2019-12-05T03:47:34.835 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-chardet (3.0.4-1) ... 2019-12-05T03:47:34.845 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-pastedeploy (1.5.2-4) ... 2019-12-05T03:47:35.163 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-urllib3. 2019-12-05T03:47:35.178 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../048-python-urllib3_1.22-1ubuntu0.18.04.1_all.deb ... 2019-12-05T03:47:35.182 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-webtest. 2019-12-05T03:47:35.196 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../044-python-webtest_2.0.28-1ubuntu1_all.deb ... 2019-12-05T03:47:35.226 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-urllib3 (1.22-1ubuntu0.18.04.1) ... 2019-12-05T03:47:35.240 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-webtest (2.0.28-1ubuntu1) ... 2019-12-05T03:47:35.603 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-pecan. 2019-12-05T03:47:35.605 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-requests. 2019-12-05T03:47:35.620 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../049-python-requests_2.18.4-2ubuntu0.1_all.deb ... 2019-12-05T03:47:35.620 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../045-python-pecan_1.2.1-2_all.deb ... 2019-12-05T03:47:35.664 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-requests (2.18.4-2ubuntu0.1) ... 2019-12-05T03:47:35.671 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-pecan (1.2.1-2) ... 2019-12-05T03:47:35.975 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-werkzeug. 2019-12-05T03:47:35.988 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../050-python-werkzeug_0.14.1+dfsg1-1_all.deb ... 2019-12-05T03:47:36.022 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-certifi. 2019-12-05T03:47:36.036 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../046-python-certifi_2018.1.18-2_all.deb ... 2019-12-05T03:47:36.039 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-werkzeug (0.14.1+dfsg1-1) ... 2019-12-05T03:47:36.079 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-certifi (2018.1.18-2) ... 2019-12-05T03:47:36.400 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr. 2019-12-05T03:47:36.415 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../051-ceph-mgr_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:47:36.416 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-chardet. 2019-12-05T03:47:36.432 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../047-python-chardet_3.0.4-1_all.deb ... 2019-12-05T03:47:36.458 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:36.466 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-chardet (3.0.4-1) ... 2019-12-05T03:47:36.828 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-urllib3. 2019-12-05T03:47:36.841 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../048-python-urllib3_1.22-1ubuntu0.18.04.1_all.deb ... 2019-12-05T03:47:36.901 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-urllib3 (1.22-1ubuntu0.18.04.1) ... 2019-12-05T03:47:36.960 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mon. 2019-12-05T03:47:36.975 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../052-ceph-mon_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:47:37.026 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mon (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:37.254 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-requests. 2019-12-05T03:47:37.268 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../049-python-requests_2.18.4-2ubuntu0.1_all.deb ... 2019-12-05T03:47:37.312 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-requests (2.18.4-2ubuntu0.1) ... 2019-12-05T03:47:37.613 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-werkzeug. 2019-12-05T03:47:37.629 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../050-python-werkzeug_0.14.1+dfsg1-1_all.deb ... 2019-12-05T03:47:37.696 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-werkzeug (0.14.1+dfsg1-1) ... 2019-12-05T03:47:37.952 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-osd. 2019-12-05T03:47:37.967 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../053-ceph-osd_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:47:38.019 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-osd (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:38.050 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mgr. 2019-12-05T03:47:38.067 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../051-ceph-mgr_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:47:38.108 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mgr (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:38.631 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mon. 2019-12-05T03:47:38.642 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../052-ceph-mon_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:47:38.721 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mon (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:39.887 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph. 2019-12-05T03:47:39.902 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../054-ceph_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:47:39.946 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:40.287 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-osd. 2019-12-05T03:47:40.297 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-daemon. 2019-12-05T03:47:40.302 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../053-ceph-osd_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:47:40.310 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../055-ceph-daemon_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:47:40.345 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-osd (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:40.353 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-daemon (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:40.704 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-fuse. 2019-12-05T03:47:40.725 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../056-ceph-fuse_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:47:40.762 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-fuse (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:41.191 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mds. 2019-12-05T03:47:41.205 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../057-ceph-mds_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:47:41.242 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mds (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:41.770 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-repoze.lru. 2019-12-05T03:47:41.785 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../058-python-repoze.lru_0.7-1_all.deb ... 2019-12-05T03:47:41.829 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-repoze.lru (0.7-1) ... 2019-12-05T03:47:42.097 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libjs-underscore. 2019-12-05T03:47:42.112 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../059-libjs-underscore_1.8.3~dfsg-1_all.deb ... 2019-12-05T03:47:42.158 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libjs-underscore (1.8.3~dfsg-1) ... 2019-12-05T03:47:42.208 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph. 2019-12-05T03:47:42.222 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../054-ceph_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:47:42.267 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:42.430 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libjs-sphinxdoc. 2019-12-05T03:47:42.445 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../060-libjs-sphinxdoc_1.6.7-1ubuntu1_all.deb ... 2019-12-05T03:47:42.489 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2019-12-05T03:47:42.664 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-daemon. 2019-12-05T03:47:42.681 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../055-ceph-daemon_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:47:42.728 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-daemon (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:42.819 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-routes. 2019-12-05T03:47:42.833 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../061-python-routes_2.4.1-1_all.deb ... 2019-12-05T03:47:42.869 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-routes (2.4.1-1) ... 2019-12-05T03:47:43.107 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-fuse. 2019-12-05T03:47:43.129 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../056-ceph-fuse_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:47:43.159 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-fuse (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:43.262 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2019-12-05T03:47:43.277 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../062-ceph-mgr-dashboard_15.0.0-8014-gc529080-1bionic_all.deb ... 2019-12-05T03:47:43.323 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-dashboard (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:43.557 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mds. 2019-12-05T03:47:43.573 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../057-ceph-mds_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:47:43.645 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mds (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:44.168 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-repoze.lru. 2019-12-05T03:47:44.183 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../058-python-repoze.lru_0.7-1_all.deb ... 2019-12-05T03:47:44.225 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-repoze.lru (0.7-1) ... 2019-12-05T03:47:44.364 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2019-12-05T03:47:44.381 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../063-ceph-mgr-diskprediction-cloud_15.0.0-8014-gc529080-1bionic_all.deb ... 2019-12-05T03:47:44.422 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:44.481 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libjs-underscore. 2019-12-05T03:47:44.495 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../059-libjs-underscore_1.8.3~dfsg-1_all.deb ... 2019-12-05T03:47:44.550 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libjs-underscore (1.8.3~dfsg-1) ... 2019-12-05T03:47:44.753 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-decorator. 2019-12-05T03:47:44.766 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../064-python-decorator_4.1.2-1_all.deb ... 2019-12-05T03:47:44.813 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-decorator (4.1.2-1) ... 2019-12-05T03:47:44.869 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libjs-sphinxdoc. 2019-12-05T03:47:44.885 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../060-libjs-sphinxdoc_1.6.7-1ubuntu1_all.deb ... 2019-12-05T03:47:44.933 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2019-12-05T03:47:45.136 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-scipy. 2019-12-05T03:47:45.152 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../065-python-scipy_0.19.1-2ubuntu1_amd64.deb ... 2019-12-05T03:47:45.205 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-scipy (0.19.1-2ubuntu1) ... 2019-12-05T03:47:45.297 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-routes. 2019-12-05T03:47:45.311 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../061-python-routes_2.4.1-1_all.deb ... 2019-12-05T03:47:45.357 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-routes (2.4.1-1) ... 2019-12-05T03:47:45.717 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2019-12-05T03:47:45.733 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../062-ceph-mgr-dashboard_15.0.0-8014-gc529080-1bionic_all.deb ... 2019-12-05T03:47:45.782 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mgr-dashboard (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:46.332 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-sklearn-lib. 2019-12-05T03:47:46.346 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../066-python-sklearn-lib_0.19.1-3_amd64.deb ... 2019-12-05T03:47:46.391 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-sklearn-lib (0.19.1-3) ... 2019-12-05T03:47:46.725 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2019-12-05T03:47:46.739 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../063-ceph-mgr-diskprediction-cloud_15.0.0-8014-gc529080-1bionic_all.deb ... 2019-12-05T03:47:46.810 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:46.833 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-joblib. 2019-12-05T03:47:46.849 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../067-python-joblib_0.11-1_all.deb ... 2019-12-05T03:47:46.891 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-joblib (0.11-1) ... 2019-12-05T03:47:47.153 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-decorator. 2019-12-05T03:47:47.166 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../064-python-decorator_4.1.2-1_all.deb ... 2019-12-05T03:47:47.213 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-decorator (4.1.2-1) ... 2019-12-05T03:47:47.269 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-sklearn. 2019-12-05T03:47:47.283 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../068-python-sklearn_0.19.1-3_all.deb ... 2019-12-05T03:47:47.329 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-sklearn (0.19.1-3) ... 2019-12-05T03:47:47.547 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-scipy. 2019-12-05T03:47:47.562 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../065-python-scipy_0.19.1-2ubuntu1_amd64.deb ... 2019-12-05T03:47:47.601 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-scipy (0.19.1-2ubuntu1) ... 2019-12-05T03:47:47.851 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2019-12-05T03:47:47.865 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../069-ceph-mgr-diskprediction-local_15.0.0-8014-gc529080-1bionic_all.deb ... 2019-12-05T03:47:47.905 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-diskprediction-local (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:48.879 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-sklearn-lib. 2019-12-05T03:47:48.896 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../066-python-sklearn-lib_0.19.1-3_amd64.deb ... 2019-12-05T03:47:48.938 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-sklearn-lib (0.19.1-3) ... 2019-12-05T03:47:49.009 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-monotonic. 2019-12-05T03:47:49.020 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../070-python-monotonic_1.1-2_all.deb ... 2019-12-05T03:47:49.073 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-monotonic (1.1-2) ... 2019-12-05T03:47:49.380 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-fasteners. 2019-12-05T03:47:49.397 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../071-python-fasteners_0.12.0-3_all.deb ... 2019-12-05T03:47:49.440 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-fasteners (0.12.0-3) ... 2019-12-05T03:47:49.467 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-joblib. 2019-12-05T03:47:49.484 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../067-python-joblib_0.11-1_all.deb ... 2019-12-05T03:47:49.562 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-joblib (0.11-1) ... 2019-12-05T03:47:49.753 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-httplib2. 2019-12-05T03:47:49.766 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../072-python-httplib2_0.9.2+dfsg-1ubuntu0.1_all.deb ... 2019-12-05T03:47:49.811 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-httplib2 (0.9.2+dfsg-1ubuntu0.1) ... 2019-12-05T03:47:49.951 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-sklearn. 2019-12-05T03:47:49.966 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../068-python-sklearn_0.19.1-3_all.deb ... 2019-12-05T03:47:50.036 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-sklearn (0.19.1-3) ... 2019-12-05T03:47:50.121 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-pyasn1. 2019-12-05T03:47:50.135 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../073-python-pyasn1_0.4.2-3_all.deb ... 2019-12-05T03:47:50.198 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-pyasn1 (0.4.2-3) ... 2019-12-05T03:47:50.537 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-pyasn1-modules. 2019-12-05T03:47:50.554 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../074-python-pyasn1-modules_0.2.1-0.2_all.deb ... 2019-12-05T03:47:50.607 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-pyasn1-modules (0.2.1-0.2) ... 2019-12-05T03:47:50.625 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2019-12-05T03:47:50.640 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../069-ceph-mgr-diskprediction-local_15.0.0-8014-gc529080-1bionic_all.deb ... 2019-12-05T03:47:50.685 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mgr-diskprediction-local (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:50.916 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-rsa. 2019-12-05T03:47:50.933 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../075-python-rsa_3.4.2-1_all.deb ... 2019-12-05T03:47:50.977 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-rsa (3.4.2-1) ... 2019-12-05T03:47:51.308 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-sqlalchemy. 2019-12-05T03:47:51.324 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../076-python-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2019-12-05T03:47:51.367 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2019-12-05T03:47:51.821 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-monotonic. 2019-12-05T03:47:51.830 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../070-python-monotonic_1.1-2_all.deb ... 2019-12-05T03:47:51.844 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-oauth2client. 2019-12-05T03:47:51.859 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../077-python-oauth2client_4.1.2-3_all.deb ... 2019-12-05T03:47:51.884 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-monotonic (1.1-2) ... 2019-12-05T03:47:51.903 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-oauth2client (4.1.2-3) ... 2019-12-05T03:47:52.226 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-fasteners. 2019-12-05T03:47:52.241 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../071-python-fasteners_0.12.0-3_all.deb ... 2019-12-05T03:47:52.284 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-fasteners (0.12.0-3) ... 2019-12-05T03:47:52.285 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-websocket. 2019-12-05T03:47:52.298 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../078-python-websocket_0.44.0-0ubuntu2_all.deb ... 2019-12-05T03:47:52.352 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-websocket (0.44.0-0ubuntu2) ... 2019-12-05T03:47:52.630 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-httplib2. 2019-12-05T03:47:52.646 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../072-python-httplib2_0.9.2+dfsg-1ubuntu0.1_all.deb ... 2019-12-05T03:47:52.695 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-yaml. 2019-12-05T03:47:52.697 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-httplib2 (0.9.2+dfsg-1ubuntu0.1) ... 2019-12-05T03:47:52.712 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../079-python-yaml_3.12-1build2_amd64.deb ... 2019-12-05T03:47:52.760 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-yaml (3.12-1build2) ... 2019-12-05T03:47:53.018 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-pyasn1. 2019-12-05T03:47:53.033 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../073-python-pyasn1_0.4.2-3_all.deb ... 2019-12-05T03:47:53.071 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-pyasn1 (0.4.2-3) ... 2019-12-05T03:47:53.110 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-kubernetes. 2019-12-05T03:47:53.123 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../080-python-kubernetes_2.0.0-2ubuntu1_all.deb ... 2019-12-05T03:47:53.273 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-kubernetes (2.0.0-2ubuntu1) ... 2019-12-05T03:47:53.484 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-pyasn1-modules. 2019-12-05T03:47:53.498 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../074-python-pyasn1-modules_0.2.1-0.2_all.deb ... 2019-12-05T03:47:53.535 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-pyasn1-modules (0.2.1-0.2) ... 2019-12-05T03:47:53.699 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2019-12-05T03:47:53.715 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../081-ceph-mgr-k8sevents_15.0.0-8014-gc529080-1bionic_all.deb ... 2019-12-05T03:47:53.758 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-k8sevents (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:53.875 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-rsa. 2019-12-05T03:47:53.884 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../075-python-rsa_3.4.2-1_all.deb ... 2019-12-05T03:47:53.922 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-rsa (3.4.2-1) ... 2019-12-05T03:47:54.064 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-rook. 2019-12-05T03:47:54.078 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../082-ceph-mgr-rook_15.0.0-8014-gc529080-1bionic_all.deb ... 2019-12-05T03:47:54.128 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-rook (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:54.282 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-sqlalchemy. 2019-12-05T03:47:54.298 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../076-python-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2019-12-05T03:47:54.325 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2019-12-05T03:47:54.441 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-ssh. 2019-12-05T03:47:54.455 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../083-ceph-mgr-ssh_15.0.0-8014-gc529080-1bionic_all.deb ... 2019-12-05T03:47:54.500 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-ssh (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:54.844 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libonig4:amd64. 2019-12-05T03:47:54.855 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../084-libonig4_6.7.0-1_amd64.deb ... 2019-12-05T03:47:54.892 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2019-12-05T03:47:55.178 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-oauth2client. 2019-12-05T03:47:55.194 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../077-python-oauth2client_4.1.2-3_all.deb ... 2019-12-05T03:47:55.233 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-oauth2client (4.1.2-3) ... 2019-12-05T03:47:55.269 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libjq1:amd64. 2019-12-05T03:47:55.278 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../085-libjq1_1.5+dfsg-2_amd64.deb ... 2019-12-05T03:47:55.323 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2019-12-05T03:47:55.598 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package jq. 2019-12-05T03:47:55.613 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../086-jq_1.5+dfsg-2_amd64.deb ... 2019-12-05T03:47:55.614 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-websocket. 2019-12-05T03:47:55.629 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../078-python-websocket_0.44.0-0ubuntu2_all.deb ... 2019-12-05T03:47:55.658 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking jq (1.5+dfsg-2) ... 2019-12-05T03:47:55.674 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-websocket (0.44.0-0ubuntu2) ... 2019-12-05T03:47:55.926 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package socat. 2019-12-05T03:47:55.940 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../087-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2019-12-05T03:47:55.993 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2019-12-05T03:47:56.008 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-yaml. 2019-12-05T03:47:56.022 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../079-python-yaml_3.12-1build2_amd64.deb ... 2019-12-05T03:47:56.068 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-yaml (3.12-1build2) ... 2019-12-05T03:47:56.423 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libxslt1.1:amd64. 2019-12-05T03:47:56.428 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-kubernetes. 2019-12-05T03:47:56.439 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../088-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2019-12-05T03:47:56.442 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../080-python-kubernetes_2.0.0-2ubuntu1_all.deb ... 2019-12-05T03:47:56.482 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2019-12-05T03:47:56.571 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-kubernetes (2.0.0-2ubuntu1) ... 2019-12-05T03:47:56.805 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package xmlstarlet. 2019-12-05T03:47:56.816 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2_amd64.deb ... 2019-12-05T03:47:56.868 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2019-12-05T03:47:57.019 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2019-12-05T03:47:57.036 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../081-ceph-mgr-k8sevents_15.0.0-8014-gc529080-1bionic_all.deb ... 2019-12-05T03:47:57.077 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mgr-k8sevents (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:57.211 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-test. 2019-12-05T03:47:57.230 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../090-ceph-test_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:47:57.269 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-test (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:57.385 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mgr-rook. 2019-12-05T03:47:57.402 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../082-ceph-mgr-rook_15.0.0-8014-gc529080-1bionic_all.deb ... 2019-12-05T03:47:57.469 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mgr-rook (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:57.773 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-mgr-ssh. 2019-12-05T03:47:57.788 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../083-ceph-mgr-ssh_15.0.0-8014-gc529080-1bionic_all.deb ... 2019-12-05T03:47:57.832 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-mgr-ssh (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:47:58.199 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libonig4:amd64. 2019-12-05T03:47:58.213 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../084-libonig4_6.7.0-1_amd64.deb ... 2019-12-05T03:47:58.261 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2019-12-05T03:47:58.650 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libjq1:amd64. 2019-12-05T03:47:58.666 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../085-libjq1_1.5+dfsg-2_amd64.deb ... 2019-12-05T03:47:58.709 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2019-12-05T03:47:59.012 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package jq. 2019-12-05T03:47:59.028 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../086-jq_1.5+dfsg-2_amd64.deb ... 2019-12-05T03:47:59.073 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking jq (1.5+dfsg-2) ... 2019-12-05T03:47:59.341 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package socat. 2019-12-05T03:47:59.356 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../087-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2019-12-05T03:47:59.399 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2019-12-05T03:47:59.846 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libxslt1.1:amd64. 2019-12-05T03:47:59.864 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../088-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2019-12-05T03:47:59.909 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2019-12-05T03:48:00.201 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package xmlstarlet. 2019-12-05T03:48:00.217 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rados. 2019-12-05T03:48:00.217 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2_amd64.deb ... 2019-12-05T03:48:00.232 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../091-python3-rados_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:48:00.261 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2019-12-05T03:48:00.275 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rados (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:00.637 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-ceph-argparse. 2019-12-05T03:48:00.637 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package ceph-test. 2019-12-05T03:48:00.653 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../092-python3-ceph-argparse_15.0.0-8014-gc529080-1bionic_all.deb ... 2019-12-05T03:48:00.653 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../090-ceph-test_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:48:00.696 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-ceph-argparse (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:00.696 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking ceph-test (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:01.021 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cephfs. 2019-12-05T03:48:01.027 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../093-python3-cephfs_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:48:01.075 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cephfs (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:01.413 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-colorama. 2019-12-05T03:48:01.429 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../094-python3-colorama_0.3.7-1_all.deb ... 2019-12-05T03:48:01.471 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-colorama (0.3.7-1) ... 2019-12-05T03:48:01.711 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package cephfs-shell. 2019-12-05T03:48:01.728 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../095-cephfs-shell_15.0.0-8014-gc529080-1bionic_all.deb ... 2019-12-05T03:48:01.771 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking cephfs-shell (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:02.033 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libcephfs-dev. 2019-12-05T03:48:02.046 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../096-libcephfs-dev_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:48:02.086 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libcephfs-dev (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:02.411 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-attr. 2019-12-05T03:48:02.429 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../097-python-attr_17.4.0-2_all.deb ... 2019-12-05T03:48:02.495 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-attr (17.4.0-2) ... 2019-12-05T03:48:02.735 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-ceph. 2019-12-05T03:48:02.749 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../098-python-ceph_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:48:02.795 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-ceph (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:03.123 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-funcsigs. 2019-12-05T03:48:03.136 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../099-python-funcsigs_1.0.2-4_all.deb ... 2019-12-05T03:48:03.181 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2019-12-05T03:48:03.488 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-webencodings. 2019-12-05T03:48:03.501 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-rados. 2019-12-05T03:48:03.506 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../100-python-webencodings_0.5-2_all.deb ... 2019-12-05T03:48:03.515 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../091-python3-rados_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:48:03.547 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-webencodings (0.5-2) ... 2019-12-05T03:48:03.561 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-rados (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:03.860 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-html5lib. 2019-12-05T03:48:03.877 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../101-python-html5lib_0.999999999-1_all.deb ... 2019-12-05T03:48:03.918 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-html5lib (0.999999999-1) ... 2019-12-05T03:48:03.929 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-ceph-argparse. 2019-12-05T03:48:03.945 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../092-python3-ceph-argparse_15.0.0-8014-gc529080-1bionic_all.deb ... 2019-12-05T03:48:03.993 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-ceph-argparse (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:04.277 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-lxml:amd64. 2019-12-05T03:48:04.292 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../102-python-lxml_4.2.1-1ubuntu0.1_amd64.deb ... 2019-12-05T03:48:04.309 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-cephfs. 2019-12-05T03:48:04.325 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../093-python3-cephfs_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:48:04.338 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2019-12-05T03:48:04.373 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-cephfs (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:04.726 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python3-colorama. 2019-12-05T03:48:04.740 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../094-python3-colorama_0.3.7-1_all.deb ... 2019-12-05T03:48:04.788 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python3-colorama (0.3.7-1) ... 2019-12-05T03:48:04.817 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-openid. 2019-12-05T03:48:04.833 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../103-python-openid_2.2.5-6_all.deb ... 2019-12-05T03:48:04.877 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-openid (2.2.5-6) ... 2019-12-05T03:48:05.041 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package cephfs-shell. 2019-12-05T03:48:05.056 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../095-cephfs-shell_15.0.0-8014-gc529080-1bionic_all.deb ... 2019-12-05T03:48:05.095 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking cephfs-shell (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:05.225 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-pastescript. 2019-12-05T03:48:05.240 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../104-python-pastescript_2.0.2-2_all.deb ... 2019-12-05T03:48:05.292 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-pastescript (2.0.2-2) ... 2019-12-05T03:48:05.374 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libcephfs-dev. 2019-12-05T03:48:05.391 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../096-libcephfs-dev_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:48:05.433 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libcephfs-dev (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:05.688 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-pluggy. 2019-12-05T03:48:05.706 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../105-python-pluggy_0.6.0-1_all.deb ... 2019-12-05T03:48:05.746 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-pluggy (0.6.0-1) ... 2019-12-05T03:48:05.805 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-attr. 2019-12-05T03:48:05.821 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../097-python-attr_17.4.0-2_all.deb ... 2019-12-05T03:48:05.861 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-attr (17.4.0-2) ... 2019-12-05T03:48:06.049 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-py. 2019-12-05T03:48:06.066 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../106-python-py_1.5.2-1_all.deb ... 2019-12-05T03:48:06.109 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-py (1.5.2-1) ... 2019-12-05T03:48:06.120 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-ceph. 2019-12-05T03:48:06.140 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../098-python-ceph_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:48:06.201 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-ceph (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:06.448 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-pyinotify. 2019-12-05T03:48:06.460 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../107-python-pyinotify_0.9.6-1_all.deb ... 2019-12-05T03:48:06.497 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-funcsigs. 2019-12-05T03:48:06.503 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-pyinotify (0.9.6-1) ... 2019-12-05T03:48:06.510 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../099-python-funcsigs_1.0.2-4_all.deb ... 2019-12-05T03:48:06.555 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2019-12-05T03:48:06.819 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-pytest. 2019-12-05T03:48:06.839 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../108-python-pytest_3.3.2-2_all.deb ... 2019-12-05T03:48:06.880 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-pytest (3.3.2-2) ... 2019-12-05T03:48:06.901 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-webencodings. 2019-12-05T03:48:06.917 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../100-python-webencodings_0.5-2_all.deb ... 2019-12-05T03:48:06.960 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-webencodings (0.5-2) ... 2019-12-05T03:48:07.253 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-scgi. 2019-12-05T03:48:07.267 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../109-python-scgi_1.13-1.1build1_amd64.deb ... 2019-12-05T03:48:07.305 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-html5lib. 2019-12-05T03:48:07.312 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-scgi (1.13-1.1build1) ... 2019-12-05T03:48:07.318 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../101-python-html5lib_0.999999999-1_all.deb ... 2019-12-05T03:48:07.364 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-html5lib (0.999999999-1) ... 2019-12-05T03:48:07.578 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-sqlalchemy-ext. 2019-12-05T03:48:07.592 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../110-python-sqlalchemy-ext_1.1.11+ds1-1ubuntu1_amd64.deb ... 2019-12-05T03:48:07.636 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-sqlalchemy-ext (1.1.11+ds1-1ubuntu1) ... 2019-12-05T03:48:07.750 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-lxml:amd64. 2019-12-05T03:48:07.765 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../102-python-lxml_4.2.1-1ubuntu0.1_amd64.deb ... 2019-12-05T03:48:07.810 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2019-12-05T03:48:08.020 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package radosgw. 2019-12-05T03:48:08.035 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../111-radosgw_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:48:08.083 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking radosgw (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:08.313 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-openid. 2019-12-05T03:48:08.327 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../103-python-openid_2.2.5-6_all.deb ... 2019-12-05T03:48:08.364 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-openid (2.2.5-6) ... 2019-12-05T03:48:08.735 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-pastescript. 2019-12-05T03:48:08.751 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../104-python-pastescript_2.0.2-2_all.deb ... 2019-12-05T03:48:08.803 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package rbd-fuse. 2019-12-05T03:48:08.804 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-pastescript (2.0.2-2) ... 2019-12-05T03:48:08.813 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../112-rbd-fuse_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:48:08.858 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking rbd-fuse (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:09.161 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-dnspython (1.15.0-1) ... 2019-12-05T03:48:09.179 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-pluggy. 2019-12-05T03:48:09.194 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../105-python-pluggy_0.6.0-1_all.deb ... 2019-12-05T03:48:09.271 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-pluggy (0.6.0-1) ... 2019-12-05T03:48:09.443 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-simplejson (3.13.2-1) ... 2019-12-05T03:48:09.573 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-py. 2019-12-05T03:48:09.587 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../106-python-py_1.5.2-1_all.deb ... 2019-12-05T03:48:09.631 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-py (1.5.2-1) ... 2019-12-05T03:48:09.658 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-repoze.lru (0.7-1) ... 2019-12-05T03:48:09.864 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librdkafka1:amd64 (0.11.3-1build1) ... 2019-12-05T03:48:09.993 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2019-12-05T03:48:10.121 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-pyinotify. 2019-12-05T03:48:10.136 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../107-python-pyinotify_0.9.6-1_all.deb ... 2019-12-05T03:48:10.188 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-pyinotify (0.9.6-1) ... 2019-12-05T03:48:10.487 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-openid (2.2.5-6) ... 2019-12-05T03:48:10.539 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-pytest. 2019-12-05T03:48:10.559 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../108-python-pytest_3.3.2-2_all.deb ... 2019-12-05T03:48:10.600 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-pytest (3.3.2-2) ... 2019-12-05T03:48:10.721 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-prettytable (0.7.2-3) ... 2019-12-05T03:48:10.919 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-urllib3 (1.22-1ubuntu0.18.04.1) ... 2019-12-05T03:48:10.984 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-scgi. 2019-12-05T03:48:10.998 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../109-python-scgi_1.13-1.1build1_amd64.deb ... 2019-12-05T03:48:11.043 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-scgi (1.13-1.1build1) ... 2019-12-05T03:48:11.159 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-yaml (3.12-1build2) ... 2019-12-05T03:48:11.319 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package python-sqlalchemy-ext. 2019-12-05T03:48:11.334 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../110-python-sqlalchemy-ext_1.1.11+ds1-1ubuntu1_amd64.deb ... 2019-12-05T03:48:11.378 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking python-sqlalchemy-ext (1.1.11+ds1-1ubuntu1) ... 2019-12-05T03:48:11.388 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-simplegeneric (0.8.1-1) ... 2019-12-05T03:48:11.575 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-chardet (3.0.4-1) ... 2019-12-05T03:48:11.745 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package radosgw. 2019-12-05T03:48:11.759 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../111-radosgw_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:48:11.821 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking radosgw (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:11.879 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-attr (17.4.0-2) ... 2019-12-05T03:48:12.065 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libjs-underscore (1.8.3~dfsg-1) ... 2019-12-05T03:48:12.192 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-openssl (17.5.0-1ubuntu1) ... 2019-12-05T03:48:12.397 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-ceph-argparse (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:12.553 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package rbd-fuse. 2019-12-05T03:48:12.572 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../112-rbd-fuse_15.0.0-8014-gc529080-1bionic_amd64.deb ... 2019-12-05T03:48:12.607 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking rbd-fuse (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:12.703 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2019-12-05T03:48:12.832 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-pyasn1 (0.4.2-3) ... 2019-12-05T03:48:12.974 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-dnspython (1.15.0-1) ... 2019-12-05T03:48:13.068 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-py (1.5.2-1) ... 2019-12-05T03:48:13.265 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-simplejson (3.13.2-1) ... 2019-12-05T03:48:13.292 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-monotonic (1.1-2) ... 2019-12-05T03:48:13.494 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-joblib (0.11-1) ... 2019-12-05T03:48:13.502 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-repoze.lru (0.7-1) ... 2019-12-05T03:48:13.699 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up librdkafka1:amd64 (0.11.3-1build1) ... 2019-12-05T03:48:13.750 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2019-12-05T03:48:13.862 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2019-12-05T03:48:13.879 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-pluggy (0.6.0-1) ... 2019-12-05T03:48:14.074 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-certifi (2018.1.18-2) ... 2019-12-05T03:48:14.276 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-colorama (0.3.7-1) ... 2019-12-05T03:48:14.382 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-openid (2.2.5-6) ... 2019-12-05T03:48:14.589 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pyparsing (2.2.0+dfsg1-2) ... 2019-12-05T03:48:14.619 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-prettytable (0.7.2-3) ... 2019-12-05T03:48:14.867 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-urllib3 (1.22-1ubuntu0.18.04.1) ... 2019-12-05T03:48:14.900 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up formencode-i18n (1.3.0-0ubuntu5) ... 2019-12-05T03:48:15.048 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2019-12-05T03:48:15.098 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-yaml (3.12-1build2) ... 2019-12-05T03:48:15.176 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-webob (1:1.7.3-2fakesync1) ... 2019-12-05T03:48:15.327 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-simplegeneric (0.8.1-1) ... 2019-12-05T03:48:15.407 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-ceph-argparse (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:15.534 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-waitress (1.0.1-1) ... 2019-12-05T03:48:15.539 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-chardet (3.0.4-1) ... 2019-12-05T03:48:15.811 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-attr (17.4.0-2) ... 2019-12-05T03:48:15.884 INFO:teuthology.orchestra.run.smithi096.stdout:update-alternatives: using /usr/bin/waitress-serve-python2 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2019-12-05T03:48:16.039 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libjs-underscore (1.8.3~dfsg-1) ... 2019-12-05T03:48:16.078 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-pyasn1-modules (0.2.1-0.2) ... 2019-12-05T03:48:16.163 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-openssl (17.5.0-1ubuntu1) ... 2019-12-05T03:48:16.317 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-fasteners (0.12.0-3) ... 2019-12-05T03:48:16.415 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-ceph-argparse (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:16.530 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-jwt (1.5.3+ds1-1) ... 2019-12-05T03:48:16.737 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2019-12-05T03:48:16.742 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-markupsafe (1.0-1build1) ... 2019-12-05T03:48:16.866 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-pyasn1 (0.4.2-3) ... 2019-12-05T03:48:16.956 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-werkzeug (0.14.1+dfsg1-1) ... 2019-12-05T03:48:17.117 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-py (1.5.2-1) ... 2019-12-05T03:48:17.219 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-pyinotify (0.9.6-1) ... 2019-12-05T03:48:17.340 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-monotonic (1.1-2) ... 2019-12-05T03:48:17.432 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-scgi (1.13-1.1build1) ... 2019-12-05T03:48:17.568 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-joblib (0.11-1) ... 2019-12-05T03:48:17.629 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-websocket (0.44.0-0ubuntu2) ... 2019-12-05T03:48:17.718 INFO:teuthology.orchestra.run.smithi096.stdout:update-alternatives: using /usr/bin/python2-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2019-12-05T03:48:17.833 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2019-12-05T03:48:17.887 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2019-12-05T03:48:17.995 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-pluggy (0.6.0-1) ... 2019-12-05T03:48:18.020 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-httplib2 (0.9.2+dfsg-1ubuntu0.1) ... 2019-12-05T03:48:18.199 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-certifi (2018.1.18-2) ... 2019-12-05T03:48:18.224 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2019-12-05T03:48:18.361 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-ceph-common (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:18.387 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-colorama (0.3.7-1) ... 2019-12-05T03:48:18.499 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-bs4 (4.6.0-1) ... 2019-12-05T03:48:18.700 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-pyparsing (2.2.0+dfsg1-2) ... 2019-12-05T03:48:18.733 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-mako (1.0.7+ds1-1) ... 2019-12-05T03:48:18.935 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-sklearn-lib (0.19.1-3) ... 2019-12-05T03:48:18.993 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up formencode-i18n (1.3.0-0ubuntu5) ... 2019-12-05T03:48:19.061 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2019-12-05T03:48:19.116 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2019-12-05T03:48:19.190 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2019-12-05T03:48:19.246 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-webob (1:1.7.3-2fakesync1) ... 2019-12-05T03:48:19.483 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-sqlalchemy-ext (1.1.11+ds1-1ubuntu1) ... 2019-12-05T03:48:19.491 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-ceph-argparse (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:19.617 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-daemon (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:19.620 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-waitress (1.0.1-1) ... 2019-12-05T03:48:19.988 INFO:teuthology.orchestra.run.smithi158.stdout:update-alternatives: using /usr/bin/waitress-serve-python2 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2019-12-05T03:48:20.200 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-pyasn1-modules (0.2.1-0.2) ... 2019-12-05T03:48:20.287 INFO:teuthology.orchestra.run.smithi096.stdout:Adding system user cephdaemon....done 2019-12-05T03:48:20.436 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-fasteners (0.12.0-3) ... 2019-12-05T03:48:20.449 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-funcsigs (1.0.2-4) ... 2019-12-05T03:48:20.657 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-jwt (1.5.3+ds1-1) ... 2019-12-05T03:48:20.670 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-requests (2.18.4-2ubuntu0.1) ... 2019-12-05T03:48:20.862 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-markupsafe (1.0-1build1) ... 2019-12-05T03:48:20.916 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-uritemplate (0.6-1ubuntu1) ... 2019-12-05T03:48:21.067 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-werkzeug (0.14.1+dfsg1-1) ... 2019-12-05T03:48:21.109 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-decorator (4.1.2-1) ... 2019-12-05T03:48:21.302 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up liboath0 (2.6.1-1) ... 2019-12-05T03:48:21.328 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-pyinotify (0.9.6-1) ... 2019-12-05T03:48:21.478 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-singledispatch (3.4.0.3-2) ... 2019-12-05T03:48:21.556 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-scgi (1.13-1.1build1) ... 2019-12-05T03:48:21.671 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.1) ... 2019-12-05T03:48:21.741 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-websocket (0.44.0-0ubuntu2) ... 2019-12-05T03:48:21.797 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2019-12-05T03:48:21.821 INFO:teuthology.orchestra.run.smithi158.stdout:update-alternatives: using /usr/bin/python2-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2019-12-05T03:48:21.923 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-tempita (0.5.2-2) ... 2019-12-05T03:48:21.977 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2019-12-05T03:48:22.124 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2019-12-05T03:48:22.130 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-httplib2 (0.9.2+dfsg-1ubuntu0.1) ... 2019-12-05T03:48:22.261 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-webencodings (0.5-2) ... 2019-12-05T03:48:22.334 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2019-12-05T03:48:22.453 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-cherrypy3 (8.9.1-2) ... 2019-12-05T03:48:22.463 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-ceph-common (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:22.626 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-bs4 (4.6.0-1) ... 2019-12-05T03:48:22.713 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-bcrypt (3.1.4-2) ... 2019-12-05T03:48:22.887 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-mako (1.0.7+ds1-1) ... 2019-12-05T03:48:22.909 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-logutils (0.3.3-5) ... 2019-12-05T03:48:23.111 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-sklearn-lib (0.19.1-3) ... 2019-12-05T03:48:23.134 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pyperclip (1.6.0-1) ... 2019-12-05T03:48:23.238 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2019-12-05T03:48:23.372 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2019-12-05T03:48:23.461 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-routes (2.4.1-1) ... 2019-12-05T03:48:23.607 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-sqlalchemy-ext (1.1.11+ds1-1ubuntu1) ... 2019-12-05T03:48:23.666 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-formencode (1.3.0-0ubuntu5) ... 2019-12-05T03:48:23.743 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-daemon (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:23.917 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up jq (1.5+dfsg-2) ... 2019-12-05T03:48:24.063 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-scipy (0.19.1-2ubuntu1) ... 2019-12-05T03:48:24.443 INFO:teuthology.orchestra.run.smithi158.stdout:Adding system user cephdaemon....done 2019-12-05T03:48:24.636 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-funcsigs (1.0.2-4) ... 2019-12-05T03:48:24.831 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-requests (2.18.4-2ubuntu0.1) ... 2019-12-05T03:48:25.043 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-uritemplate (0.6-1ubuntu1) ... 2019-12-05T03:48:25.103 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-rsa (3.4.2-1) ... 2019-12-05T03:48:25.309 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cmd2 (0.7.9-0ubuntu1) ... 2019-12-05T03:48:25.602 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-paste (2.0.3+dfsg-4ubuntu1) ... 2019-12-05T03:48:25.658 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-decorator (4.1.2-1) ... 2019-12-05T03:48:25.851 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up liboath0 (2.6.1-1) ... 2019-12-05T03:48:25.890 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-pytest (3.3.2-2) ... 2019-12-05T03:48:26.036 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-singledispatch (3.4.0.3-2) ... 2019-12-05T03:48:26.141 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-oauth2client (4.1.2-3) ... 2019-12-05T03:48:26.254 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.1) ... 2019-12-05T03:48:26.344 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2019-12-05T03:48:26.380 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2019-12-05T03:48:26.444 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up xmlstarlet (1.6.1-2) ... 2019-12-05T03:48:26.523 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-tempita (0.5.2-2) ... 2019-12-05T03:48:26.562 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librados2 (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:26.688 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libcephfs2 (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:26.757 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2019-12-05T03:48:26.814 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-sklearn (0.19.1-3) ... 2019-12-05T03:48:26.886 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-webencodings (0.5-2) ... 2019-12-05T03:48:27.087 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-cherrypy3 (8.9.1-2) ... 2019-12-05T03:48:27.373 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-bcrypt (3.1.4-2) ... 2019-12-05T03:48:27.487 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libcephfs-dev (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:27.568 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-logutils (0.3.3-5) ... 2019-12-05T03:48:27.614 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rados (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:27.740 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-kubernetes (2.0.0-2ubuntu1) ... 2019-12-05T03:48:27.805 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-pyperclip (1.6.0-1) ... 2019-12-05T03:48:28.122 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-routes (2.4.1-1) ... 2019-12-05T03:48:28.234 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-html5lib (0.999999999-1) ... 2019-12-05T03:48:28.352 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-formencode (1.3.0-0ubuntu5) ... 2019-12-05T03:48:28.454 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-rados (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:28.585 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-cephfs (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:28.600 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up jq (1.5+dfsg-2) ... 2019-12-05T03:48:28.742 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-scipy (0.19.1-2ubuntu1) ... 2019-12-05T03:48:28.878 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libradosstriper1 (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:29.016 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cephfs (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:29.280 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librgw2 (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:29.399 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-rgw (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:29.500 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-pastedeploy (1.5.2-4) ... 2019-12-05T03:48:29.677 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-fuse (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:29.753 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-rsa (3.4.2-1) ... 2019-12-05T03:48:29.884 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2019-12-05T03:48:29.884 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2019-12-05T03:48:29.971 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-cmd2 (0.7.9-0ubuntu1) ... 2019-12-05T03:48:30.137 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librbd1 (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:30.263 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up cephfs-shell (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:30.280 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-paste (2.0.3+dfsg-4ubuntu1) ... 2019-12-05T03:48:30.388 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-pastescript (2.0.2-2) ... 2019-12-05T03:48:30.571 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-pytest (3.3.2-2) ... 2019-12-05T03:48:30.607 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-rbd (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:30.716 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-common (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:30.824 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-oauth2client (4.1.2-3) ... 2019-12-05T03:48:31.042 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2019-12-05T03:48:31.168 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up xmlstarlet (1.6.1-2) ... 2019-12-05T03:48:31.170 INFO:teuthology.orchestra.run.smithi096.stdout:Adding group ceph....done 2019-12-05T03:48:31.320 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up librados2 (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:31.446 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libcephfs2 (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:31.549 INFO:teuthology.orchestra.run.smithi096.stdout:Adding system user ceph....done 2019-12-05T03:48:31.573 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-sklearn (0.19.1-3) ... 2019-12-05T03:48:31.735 INFO:teuthology.orchestra.run.smithi096.stdout:Setting system user ceph properties....done 2019-12-05T03:48:31.882 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2019-12-05T03:48:32.104 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2019-12-05T03:48:32.320 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libcephfs-dev (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:32.385 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up radosgw (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:32.446 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-rados (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:32.572 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-kubernetes (2.0.0-2ubuntu1) ... 2019-12-05T03:48:32.625 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2019-12-05T03:48:32.626 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2019-12-05T03:48:33.070 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up rbd-fuse (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:33.118 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-html5lib (0.999999999-1) ... 2019-12-05T03:48:33.221 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-ceph (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:33.348 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-webtest (2.0.28-1ubuntu1) ... 2019-12-05T03:48:33.354 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-rados (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:33.481 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-cephfs (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:33.566 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-test (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:33.672 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-base (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:33.762 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libradosstriper1 (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:33.934 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python3-cephfs (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:33.981 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2019-12-05T03:48:34.227 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up librgw2 (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:34.277 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-pecan (1.2.1-2) ... 2019-12-05T03:48:34.350 INFO:teuthology.orchestra.run.smithi096.stdout:update-alternatives: using /usr/bin/python2-pecan to provide /usr/bin/pecan (pecan) in auto mode 2019-12-05T03:48:34.374 INFO:teuthology.orchestra.run.smithi096.stdout:update-alternatives: using /usr/bin/python2-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2019-12-05T03:48:34.378 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-rgw (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:34.504 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-pastedeploy (1.5.2-4) ... 2019-12-05T03:48:34.563 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-osd (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:34.697 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-fuse (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:34.916 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2019-12-05T03:48:34.917 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2019-12-05T03:48:35.190 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up librbd1 (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:35.340 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up cephfs-shell (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:35.484 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-pastescript (2.0.2-2) ... 2019-12-05T03:48:35.631 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2019-12-05T03:48:35.632 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2019-12-05T03:48:35.705 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-rbd (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:35.828 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-common (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:35.932 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mds (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:36.142 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2019-12-05T03:48:36.143 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2019-12-05T03:48:36.336 INFO:teuthology.orchestra.run.smithi158.stdout:Adding group ceph....done 2019-12-05T03:48:36.418 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mon (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:36.608 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2019-12-05T03:48:36.608 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2019-12-05T03:48:36.753 INFO:teuthology.orchestra.run.smithi158.stdout:Adding system user ceph....done 2019-12-05T03:48:36.885 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:36.979 INFO:teuthology.orchestra.run.smithi158.stdout:Setting system user ceph properties....done 2019-12-05T03:48:37.086 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2019-12-05T03:48:37.086 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2019-12-05T03:48:37.138 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2019-12-05T03:48:37.362 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2019-12-05T03:48:37.378 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-diskprediction-local (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:37.538 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-diskprediction-cloud (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:37.619 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up radosgw (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:37.680 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-rook (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:37.824 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:37.872 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2019-12-05T03:48:37.873 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2019-12-05T03:48:37.941 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-k8sevents (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:38.042 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-ssh (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:38.160 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-dashboard (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:38.230 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up rbd-fuse (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:38.278 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for libc-bin (2.27-3ubuntu1) ... 2019-12-05T03:48:38.330 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-ceph (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:38.406 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for systemd (237-3ubuntu10.31) ... 2019-12-05T03:48:38.456 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-webtest (2.0.28-1ubuntu1) ... 2019-12-05T03:48:38.606 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2019-12-05T03:48:38.649 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-test (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:38.775 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-base (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:39.132 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2019-12-05T03:48:39.410 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up python-pecan (1.2.1-2) ... 2019-12-05T03:48:39.510 INFO:teuthology.orchestra.run.smithi158.stdout:update-alternatives: using /usr/bin/python2-pecan to provide /usr/bin/pecan (pecan) in auto mode 2019-12-05T03:48:39.540 INFO:teuthology.orchestra.run.smithi158.stdout:update-alternatives: using /usr/bin/python2-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2019-12-05T03:48:39.738 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-osd (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:40.033 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2019-12-05T03:48:40.160 INFO:teuthology.orchestra.run.smithi096.stdout:ureadahead will be reprofiled on next reboot 2019-12-05T03:48:40.259 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2019-12-05T03:48:40.259 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2019-12-05T03:48:40.521 INFO:teuthology.orchestra.run.smithi096.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2019-12-05T03:48:40.523 INFO:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev 2019-12-05T03:48:40.557 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mds (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:40.608 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2019-12-05T03:48:40.779 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2019-12-05T03:48:40.779 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2019-12-05T03:48:40.859 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2019-12-05T03:48:40.860 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2019-12-05T03:48:41.024 INFO:teuthology.orchestra.run.smithi096.stdout:The following additional packages will be installed: 2019-12-05T03:48:41.025 INFO:teuthology.orchestra.run.smithi096.stdout: libbison-dev libfl-dev libfl2 libssl1.1 zlib1g-dev 2019-12-05T03:48:41.027 INFO:teuthology.orchestra.run.smithi096.stdout:Suggested packages: 2019-12-05T03:48:41.027 INFO:teuthology.orchestra.run.smithi096.stdout: bison-doc flex-doc libssl-doc 2019-12-05T03:48:41.053 INFO:teuthology.orchestra.run.smithi096.stdout:The following NEW packages will be installed: 2019-12-05T03:48:41.054 INFO:teuthology.orchestra.run.smithi096.stdout: bison flex libbison-dev libelf-dev libfl-dev libfl2 libssl-dev zlib1g-dev 2019-12-05T03:48:41.056 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages will be upgraded: 2019-12-05T03:48:41.056 INFO:teuthology.orchestra.run.smithi096.stdout: libssl1.1 2019-12-05T03:48:41.067 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mon (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:41.238 INFO:teuthology.orchestra.run.smithi096.stdout:1 upgraded, 8 newly installed, 0 to remove and 51 not upgraded. 2019-12-05T03:48:41.238 INFO:teuthology.orchestra.run.smithi096.stdout:Need to get 4,037 kB of archives. 2019-12-05T03:48:41.238 INFO:teuthology.orchestra.run.smithi096.stdout:After this operation, 11.6 MB of additional disk space will be used. 2019-12-05T03:48:41.239 INFO:teuthology.orchestra.run.smithi096.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic/main amd64 flex amd64 2.6.4-6 [316 kB] 2019-12-05T03:48:41.290 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2019-12-05T03:48:41.290 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2019-12-05T03:48:41.569 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mgr (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:41.707 INFO:teuthology.orchestra.run.smithi096.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libssl1.1 amd64 1.1.1-1ubuntu2.1~18.04.5 [1,300 kB] 2019-12-05T03:48:41.794 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2019-12-05T03:48:41.794 INFO:teuthology.orchestra.run.smithi158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2019-12-05T03:48:41.907 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 libbison-dev amd64 2:3.0.4.dfsg-1build1 [339 kB] 2019-12-05T03:48:41.934 INFO:teuthology.orchestra.run.smithi096.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/main amd64 bison amd64 2:3.0.4.dfsg-1build1 [266 kB] 2019-12-05T03:48:41.952 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 zlib1g-dev amd64 1:1.2.11.dfsg-0ubuntu2 [176 kB] 2019-12-05T03:48:41.960 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libelf-dev amd64 0.170-0.4ubuntu0.1 [57.3 kB] 2019-12-05T03:48:41.963 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl2 amd64 2.6.4-6 [11.4 kB] 2019-12-05T03:48:41.964 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl-dev amd64 2.6.4-6 [6,320 B] 2019-12-05T03:48:41.964 INFO:teuthology.orchestra.run.smithi096.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libssl-dev amd64 1.1.1-1ubuntu2.1~18.04.5 [1,566 kB] 2019-12-05T03:48:42.103 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mgr-diskprediction-local (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:42.229 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mgr-diskprediction-cloud (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:42.349 INFO:teuthology.orchestra.run.smithi096.stdout:Preconfiguring packages ... 2019-12-05T03:48:42.355 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mgr-rook (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:42.473 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:42.486 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 4,037 kB in 1s (4,246 kB/s) 2019-12-05T03:48:42.615 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mgr-k8sevents (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:42.639 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package flex. 2019-12-05T03:48:42.691 INFO:teuthology.orchestra.run.smithi096.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143715 files and directories currently installed.) 2019-12-05T03:48:42.695 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../0-flex_2.6.4-6_amd64.deb ... 2019-12-05T03:48:42.737 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking flex (2.6.4-6) ... 2019-12-05T03:48:42.741 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mgr-ssh (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:42.884 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up ceph-mgr-dashboard (15.0.0-8014-gc529080-1bionic) ... 2019-12-05T03:48:43.036 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for libc-bin (2.27-3ubuntu1) ... 2019-12-05T03:48:43.180 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for systemd (237-3ubuntu10.31) ... 2019-12-05T03:48:43.259 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../1-libssl1.1_1.1.1-1ubuntu2.1~18.04.5_amd64.deb ... 2019-12-05T03:48:43.381 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2019-12-05T03:48:43.410 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libssl1.1:amd64 (1.1.1-1ubuntu2.1~18.04.5) over (1.1.1-1ubuntu2.1~18.04.4) ... 2019-12-05T03:48:43.806 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libbison-dev:amd64. 2019-12-05T03:48:43.821 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../2-libbison-dev_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2019-12-05T03:48:43.865 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2019-12-05T03:48:44.209 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package bison. 2019-12-05T03:48:44.223 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../3-bison_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2019-12-05T03:48:44.271 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking bison (2:3.0.4.dfsg-1build1) ... 2019-12-05T03:48:44.562 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package zlib1g-dev:amd64. 2019-12-05T03:48:44.576 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../4-zlib1g-dev_1%3a1.2.11.dfsg-0ubuntu2_amd64.deb ... 2019-12-05T03:48:44.612 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2019-12-05T03:48:44.766 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2019-12-05T03:48:44.808 INFO:teuthology.orchestra.run.smithi158.stdout:ureadahead will be reprofiled on next reboot 2019-12-05T03:48:44.915 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libelf-dev:amd64. 2019-12-05T03:48:44.929 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../5-libelf-dev_0.170-0.4ubuntu0.1_amd64.deb ... 2019-12-05T03:48:44.974 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2019-12-05T03:48:45.175 INFO:teuthology.orchestra.run.smithi158.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2019-12-05T03:48:45.177 INFO:teuthology.orchestra.run.smithi158:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev 2019-12-05T03:48:45.283 INFO:teuthology.orchestra.run.smithi158.stdout:Reading package lists... 2019-12-05T03:48:45.486 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libfl2:amd64. 2019-12-05T03:48:45.502 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../6-libfl2_2.6.4-6_amd64.deb ... 2019-12-05T03:48:45.531 INFO:teuthology.orchestra.run.smithi158.stdout:Building dependency tree... 2019-12-05T03:48:45.532 INFO:teuthology.orchestra.run.smithi158.stdout:Reading state information... 2019-12-05T03:48:45.536 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libfl2:amd64 (2.6.4-6) ... 2019-12-05T03:48:45.706 INFO:teuthology.orchestra.run.smithi158.stdout:The following additional packages will be installed: 2019-12-05T03:48:45.707 INFO:teuthology.orchestra.run.smithi158.stdout: libbison-dev libfl-dev libfl2 libssl1.1 zlib1g-dev 2019-12-05T03:48:45.708 INFO:teuthology.orchestra.run.smithi158.stdout:Suggested packages: 2019-12-05T03:48:45.709 INFO:teuthology.orchestra.run.smithi158.stdout: bison-doc flex-doc libssl-doc 2019-12-05T03:48:45.733 INFO:teuthology.orchestra.run.smithi158.stdout:The following NEW packages will be installed: 2019-12-05T03:48:45.735 INFO:teuthology.orchestra.run.smithi158.stdout: bison flex libbison-dev libelf-dev libfl-dev libfl2 libssl-dev zlib1g-dev 2019-12-05T03:48:45.737 INFO:teuthology.orchestra.run.smithi158.stdout:The following packages will be upgraded: 2019-12-05T03:48:45.737 INFO:teuthology.orchestra.run.smithi158.stdout: libssl1.1 2019-12-05T03:48:45.747 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libfl-dev:amd64. 2019-12-05T03:48:45.764 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../7-libfl-dev_2.6.4-6_amd64.deb ... 2019-12-05T03:48:45.797 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libfl-dev:amd64 (2.6.4-6) ... 2019-12-05T03:48:45.918 INFO:teuthology.orchestra.run.smithi158.stdout:1 upgraded, 8 newly installed, 0 to remove and 51 not upgraded. 2019-12-05T03:48:45.918 INFO:teuthology.orchestra.run.smithi158.stdout:Need to get 4,037 kB of archives. 2019-12-05T03:48:45.918 INFO:teuthology.orchestra.run.smithi158.stdout:After this operation, 11.6 MB of additional disk space will be used. 2019-12-05T03:48:45.918 INFO:teuthology.orchestra.run.smithi158.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic/main amd64 flex amd64 2.6.4-6 [316 kB] 2019-12-05T03:48:46.033 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libssl-dev:amd64. 2019-12-05T03:48:46.050 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../8-libssl-dev_1.1.1-1ubuntu2.1~18.04.5_amd64.deb ... 2019-12-05T03:48:46.092 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.5) ... 2019-12-05T03:48:46.371 INFO:teuthology.orchestra.run.smithi158.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libssl1.1 amd64 1.1.1-1ubuntu2.1~18.04.5 [1,300 kB] 2019-12-05T03:48:46.559 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up flex (2.6.4-6) ... 2019-12-05T03:48:46.581 INFO:teuthology.orchestra.run.smithi158.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 libbison-dev amd64 2:3.0.4.dfsg-1build1 [339 kB] 2019-12-05T03:48:46.609 INFO:teuthology.orchestra.run.smithi158.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/main amd64 bison amd64 2:3.0.4.dfsg-1build1 [266 kB] 2019-12-05T03:48:46.625 INFO:teuthology.orchestra.run.smithi158.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 zlib1g-dev amd64 1:1.2.11.dfsg-0ubuntu2 [176 kB] 2019-12-05T03:48:46.634 INFO:teuthology.orchestra.run.smithi158.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libelf-dev amd64 0.170-0.4ubuntu0.1 [57.3 kB] 2019-12-05T03:48:46.636 INFO:teuthology.orchestra.run.smithi158.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl2 amd64 2.6.4-6 [11.4 kB] 2019-12-05T03:48:46.637 INFO:teuthology.orchestra.run.smithi158.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl-dev amd64 2.6.4-6 [6,320 B] 2019-12-05T03:48:46.637 INFO:teuthology.orchestra.run.smithi158.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libssl-dev amd64 1.1.1-1ubuntu2.1~18.04.5 [1,566 kB] 2019-12-05T03:48:46.655 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libssl1.1:amd64 (1.1.1-1ubuntu2.1~18.04.5) ... 2019-12-05T03:48:46.931 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2019-12-05T03:48:47.031 INFO:teuthology.orchestra.run.smithi158.stdout:Preconfiguring packages ... 2019-12-05T03:48:47.032 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libfl2:amd64 (2.6.4-6) ... 2019-12-05T03:48:47.144 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up bison (2:3.0.4.dfsg-1build1) ... 2019-12-05T03:48:47.265 INFO:teuthology.orchestra.run.smithi158.stdout:Fetched 4,037 kB in 1s (4,206 kB/s) 2019-12-05T03:48:47.265 INFO:teuthology.orchestra.run.smithi096.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2019-12-05T03:48:47.296 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2019-12-05T03:48:47.297 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package flex. 2019-12-05T03:48:47.351 INFO:teuthology.orchestra.run.smithi158.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143715 files and directories currently installed.) 2019-12-05T03:48:47.353 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../0-flex_2.6.4-6_amd64.deb ... 2019-12-05T03:48:47.395 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking flex (2.6.4-6) ... 2019-12-05T03:48:47.422 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.5) ... 2019-12-05T03:48:47.548 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2019-12-05T03:48:47.674 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libfl-dev:amd64 (2.6.4-6) ... 2019-12-05T03:48:47.800 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2019-12-05T03:48:47.918 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../1-libssl1.1_1.1.1-1ubuntu2.1~18.04.5_amd64.deb ... 2019-12-05T03:48:48.078 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libssl1.1:amd64 (1.1.1-1ubuntu2.1~18.04.5) over (1.1.1-1ubuntu2.1~18.04.4) ... 2019-12-05T03:48:48.507 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libbison-dev:amd64. 2019-12-05T03:48:48.523 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../2-libbison-dev_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2019-12-05T03:48:48.557 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2019-12-05T03:48:48.927 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package bison. 2019-12-05T03:48:48.941 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../3-bison_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2019-12-05T03:48:48.990 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking bison (2:3.0.4.dfsg-1build1) ... 2019-12-05T03:48:49.331 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package zlib1g-dev:amd64. 2019-12-05T03:48:49.346 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../4-zlib1g-dev_1%3a1.2.11.dfsg-0ubuntu2_amd64.deb ... 2019-12-05T03:48:49.389 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2019-12-05T03:48:49.445 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for install-info (6.5.0.dfsg.1-2) ... 2019-12-05T03:48:49.667 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libelf-dev:amd64. 2019-12-05T03:48:49.681 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../5-libelf-dev_0.170-0.4ubuntu0.1_amd64.deb ... 2019-12-05T03:48:49.717 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2019-12-05T03:48:49.754 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for libc-bin (2.27-3ubuntu1) ... 2019-12-05T03:48:50.088 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libfl2:amd64. 2019-12-05T03:48:50.103 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../6-libfl2_2.6.4-6_amd64.deb ... 2019-12-05T03:48:50.146 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libfl2:amd64 (2.6.4-6) ... 2019-12-05T03:48:50.213 INFO:teuthology.orchestra.run.smithi096.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2019-12-05T03:48:50.215 DEBUG:teuthology.parallel:result is None 2019-12-05T03:48:50.432 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libfl-dev:amd64. 2019-12-05T03:48:50.446 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../7-libfl-dev_2.6.4-6_amd64.deb ... 2019-12-05T03:48:50.490 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libfl-dev:amd64 (2.6.4-6) ... 2019-12-05T03:48:50.861 INFO:teuthology.orchestra.run.smithi158.stdout:Selecting previously unselected package libssl-dev:amd64. 2019-12-05T03:48:50.877 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing to unpack .../8-libssl-dev_1.1.1-1ubuntu2.1~18.04.5_amd64.deb ... 2019-12-05T03:48:51.012 INFO:teuthology.orchestra.run.smithi158.stdout:Unpacking libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.5) ... 2019-12-05T03:48:51.516 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up flex (2.6.4-6) ... 2019-12-05T03:48:51.642 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libssl1.1:amd64 (1.1.1-1ubuntu2.1~18.04.5) ... 2019-12-05T03:48:51.952 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2019-12-05T03:48:52.089 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libfl2:amd64 (2.6.4-6) ... 2019-12-05T03:48:52.213 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up bison (2:3.0.4.dfsg-1build1) ... 2019-12-05T03:48:52.302 INFO:teuthology.orchestra.run.smithi158.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2019-12-05T03:48:52.365 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2019-12-05T03:48:52.516 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.5) ... 2019-12-05T03:48:52.642 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2019-12-05T03:48:52.768 INFO:teuthology.orchestra.run.smithi158.stdout:Setting up libfl-dev:amd64 (2.6.4-6) ... 2019-12-05T03:48:52.912 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2019-12-05T03:48:54.565 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for install-info (6.5.0.dfsg.1-2) ... 2019-12-05T03:48:54.899 INFO:teuthology.orchestra.run.smithi158.stdout:Processing triggers for libc-bin (2.27-3ubuntu1) ... 2019-12-05T03:48:55.405 INFO:teuthology.orchestra.run.smithi158.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2019-12-05T03:48:55.419 DEBUG:teuthology.parallel:result is None 2019-12-05T03:48:55.420 INFO:teuthology.orchestra.run.smithi158:> sudo lsb_release -is 2019-12-05T03:48:55.466 INFO:teuthology.orchestra.run.smithi158.stdout:Ubuntu 2019-12-05T03:48:55.473 DEBUG:teuthology.misc:System to be installed: Ubuntu 2019-12-05T03:48:55.473 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=c5290805033483ba0cec165c06bde07dae5f19ec 2019-12-05T03:48:55.642 INFO:teuthology.orchestra.run.smithi158:> dpkg-query -W -f '${Version}' ceph 2019-12-05T03:48:55.667 INFO:teuthology.orchestra.run.smithi158.stdout:15.0.0-8014-gc529080-1bionic 2019-12-05T03:48:55.668 INFO:teuthology.packaging:The installed version of ceph is 15.0.0-8014-gc529080-1bionic 2019-12-05T03:48:55.668 INFO:teuthology.task.install:The correct ceph version 15.0.0-8014-gc529080-1bionic is installed. 2019-12-05T03:48:55.668 INFO:teuthology.orchestra.run.smithi096:> sudo lsb_release -is 2019-12-05T03:48:55.716 INFO:teuthology.orchestra.run.smithi096.stdout:Ubuntu 2019-12-05T03:48:55.721 DEBUG:teuthology.misc:System to be installed: Ubuntu 2019-12-05T03:48:55.721 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=c5290805033483ba0cec165c06bde07dae5f19ec 2019-12-05T03:48:55.880 INFO:teuthology.orchestra.run.smithi096:> dpkg-query -W -f '${Version}' ceph 2019-12-05T03:48:55.907 INFO:teuthology.orchestra.run.smithi096.stdout:15.0.0-8014-gc529080-1bionic 2019-12-05T03:48:55.907 INFO:teuthology.packaging:The installed version of ceph is 15.0.0-8014-gc529080-1bionic 2019-12-05T03:48:55.907 INFO:teuthology.task.install:The correct ceph version 15.0.0-8014-gc529080-1bionic is installed. 2019-12-05T03:48:55.908 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2019-12-05T03:48:55.908 INFO:teuthology.orchestra.run.smithi158:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2019-12-05T03:48:55.925 INFO:teuthology.orchestra.run.smithi096:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2019-12-05T03:48:55.973 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2019-12-05T03:48:55.973 INFO:teuthology.orchestra.run.smithi158:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2019-12-05T03:48:55.990 INFO:teuthology.orchestra.run.smithi158:> sudo chmod a=rx -- /usr/bin/daemon-helper 2019-12-05T03:48:56.069 INFO:teuthology.orchestra.run.smithi096:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2019-12-05T03:48:56.086 INFO:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/daemon-helper 2019-12-05T03:48:56.164 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2019-12-05T03:48:56.164 INFO:teuthology.orchestra.run.smithi158:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2019-12-05T03:48:56.214 INFO:teuthology.orchestra.run.smithi158:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2019-12-05T03:48:56.293 INFO:teuthology.orchestra.run.smithi096:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2019-12-05T03:48:56.343 INFO:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2019-12-05T03:48:56.422 INFO:teuthology.run_tasks:Running task ceph... 2019-12-05T03:48:56.488 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2019-12-05T03:48:56.488 INFO:teuthology.orchestra.run.smithi096:> sudo chmod 777 /var/log/ceph 2019-12-05T03:48:56.491 INFO:teuthology.orchestra.run.smithi158:> sudo chmod 777 /var/log/ceph 2019-12-05T03:48:56.506 INFO:tasks.ceph:Disabling ceph logrotate... 2019-12-05T03:48:56.507 INFO:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/logrotate.d/ceph 2019-12-05T03:48:56.573 INFO:teuthology.orchestra.run.smithi158:> sudo rm -f -- /etc/logrotate.d/ceph 2019-12-05T03:48:56.589 INFO:tasks.ceph:Creating extra log directories... 2019-12-05T03:48:56.589 INFO:teuthology.orchestra.run.smithi096:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2019-12-05T03:48:56.655 INFO:teuthology.orchestra.run.smithi158:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2019-12-05T03:48:56.672 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2019-12-05T03:48:56.672 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2019-12-05T03:48:56.672 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2019-12-05T03:48:56.672 INFO:teuthology.orchestra.run.smithi158:> cat > /home/ubuntu/cephtest/logrotate.ceph-test.conf 2019-12-05T03:48:56.781 INFO:teuthology.orchestra.run.smithi158:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2019-12-05T03:48:56.880 INFO:teuthology.orchestra.run.smithi096:> cat > /home/ubuntu/cephtest/logrotate.ceph-test.conf 2019-12-05T03:48:56.930 INFO:teuthology.orchestra.run.smithi096:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2019-12-05T03:48:57.030 INFO:tasks.ceph:Creating ceph cluster ceph... 2019-12-05T03:48:57.030 INFO:tasks.ceph:config {'mon_bind_addrvec': True, 'block_journal': None, 'fs': 'xfs', 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'skip_mgr_daemons': False, 'cpu_profile': set([]), 'mkfs_options': None, 'tmpfs_journal': None, 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mount_options': None, 'conf': {'mds': {'mds debug frag': True, 'mds bal split bits': 3, 'mds bal split size': 100, 'debug mds': 20, 'mds bal merge size': 5, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds op complaint time': 180, 'mds debug scatterstat': True, 'osd op complaint time': 180, 'mds verify scatter': True}, 'client': {'debug ms': 1, 'pid file': '', 'debug client': 20, 'client mount timeout': 600}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon op complaint time': 120, 'debug ms': 1}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'debug journal': 20, 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'osd objectstore': 'bluestore', 'mon osd backfillfull_ratio': 0.85, 'osd failsafe full ratio': 0.95, 'bluestore block size': 96636764160, 'debug filestore': 20, 'debug rocksdb': 10, 'mon osd nearfull ratio': 0.8, 'osd op complaint time': 180, 'bluestore fsck on mount': True}}} 2019-12-05T03:48:57.031 INFO:tasks.ceph:ctx.config {'kernel': {'sha1': 'distro', 'kdb': True}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'sha1': 'distro', 'kdb': True}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel']}, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'sha1': 'c5290805033483ba0cec165c06bde07dae5f19ec'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_pool_perm']}}], 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20191204.231200/qa', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.15252', 'owner': 'scheduled_pdonnell@teuthology', 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'targets': {'smithi158.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtEbi8zc4omcg1bgs39gnWDwRiLlw9145gx0um5lO4JDDggjQqw4fonlxI/ZHONZY69I8i88ZQhwB0iCFfXHhMUa9fo+/qn1igpNukX22F875tev/J30Ni4yRlEwhPY959fCdhEaZDUZ4BcKqKIdMEFYotwbtUmsa/ccvWWO8MLnEgze6umSRLiRE6NlLsCSV7aDBHaKNh9oFz5uU7vMoJ+16KrVPoBV3NCX53KgRCz0vLchAWPlc1VKWqAORQ/3/fp1IyeBIuaSLXt065e8F8Tdouj6SBVVZo4IptqR5UccXxhAyEt9Kk0vIVY3nOx7VzoG0fJoHBmKQLos53qke3', 'smithi096.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtBqicTTT4YxiTXqRGu/s0S3KPGVxX8B5vw/U8kRxP3JScc+/6kZPL/7dqZ+0tkAAdkHwRprmvuH+vOpwphkBxvqDR8NGkhTS60uQlc4d1FobOm+JUW22T9UCXCp8TJqcFwto6x9EzX9B4vgQCIPqjYGIVetpF88QyeWmJ0Nsv4onDtv5ailZPXNrzMKqQGttPjYz74bNJnnoHmDuRjv/q7H3MBX8dfjQhxggOcXkzluEnTF53kcny6qsHhVpsJWzrII1bvlQVenNGtGU/X1ShDFT1LWpRCWhrvLC6gKa5niqqh8UK+9KVyJgDGCR+E9BAT+B/PhkQ3P+G2JInoq8F'}, 'job_id': '4567504', 'tube': 'smithi', 'suite_branch': 'wip-pdonnell-testing-20191204.231200', 'priority': 75, 'os_version': '18.04', 'first_in_suite': False, 'branch': 'wip-pdonnell-testing-20191204.231200', 'suite': 'fs', 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'email': 'pdonnell@redhat.com', 'archive_path': '/home/teuthworker/archive/pdonnell-2019-12-05_02:12:53-fs-wip-pdonnell-testing-20191204.231200-distro-basic-smithi/4567504', 'description': 'fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-ec-root.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{ubuntu_latest.yaml} tasks/pool-perm.yaml}', 'nuke-on-error': True, 'repo': 'git://git.ceph.com/ceph-ci.git', 'last_in_suite': False, 'machine_type': 'smithi', 'teuthology_branch': 'master', 'sha1': 'c5290805033483ba0cec165c06bde07dae5f19ec', 'name': 'pdonnell-2019-12-05_02:12:53-fs-wip-pdonnell-testing-20191204.231200-distro-basic-smithi', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.1'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.2', 'client.3']], 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'overrides': {'ceph': {'cephfs_ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'conf': {'mds': {'mds debug frag': True, 'mds bal split bits': 3, 'mds bal split size': 100, 'debug mds': 20, 'mds bal merge size': 5, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds op complaint time': 180, 'mds debug scatterstat': True, 'osd op complaint time': 180, 'mds verify scatter': True}, 'client': {'debug ms': 1, 'pid file': '', 'debug client': 20, 'client mount timeout': 600}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon op complaint time': 120, 'debug ms': 1}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'debug journal': 20, 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'osd objectstore': 'bluestore', 'mon osd backfillfull_ratio': 0.85, 'osd failsafe full ratio': 0.95, 'bluestore block size': 96636764160, 'debug filestore': 20, 'debug rocksdb': 10, 'mon osd nearfull ratio': 0.8, 'osd op complaint time': 180, 'bluestore fsck on mount': True}}, 'fs': 'xfs', 'sha1': 'c5290805033483ba0cec165c06bde07dae5f19ec'}, 'ceph-deploy': {'fs': 'xfs', 'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'mon osd full ratio': 0.9, 'mon osd backfillfull_ratio': 0.85, 'bluestore fsck on mount': True, 'mon osd nearfull ratio': 0.8, 'debug bluestore': 20, 'debug bluefs': 20, 'osd objectstore': 'bluestore', 'bluestore block size': 96636764160, 'debug rocksdb': 10, 'osd failsafe full ratio': 0.95}}}, 'install': {'ceph': {'sha1': 'c5290805033483ba0cec165c06bde07dae5f19ec'}}, 'admin_socket': {'branch': 'wip-pdonnell-testing-20191204.231200'}, 'thrashosds': {'bdev_inject_crash_probability': 0.5, 'bdev_inject_crash': 2}, 'workunit': {'sha1': 'c5290805033483ba0cec165c06bde07dae5f19ec', 'branch': 'wip-pdonnell-testing-20191204.231200'}}, 'os_type': 'ubuntu', 'suite_sha1': 'c5290805033483ba0cec165c06bde07dae5f19ec'} 2019-12-05T03:48:57.031 INFO:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2019-12-05T03:48:57.098 INFO:teuthology.orchestra.run.smithi158:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2019-12-05T03:48:57.108 INFO:teuthology.orchestra.run.smithi096:> sudo install -d -m0777 -- /var/run/ceph 2019-12-05T03:48:57.177 INFO:teuthology.orchestra.run.smithi158:> sudo install -d -m0777 -- /var/run/ceph 2019-12-05T03:48:57.292 DEBUG:teuthology.orchestra.remote:smithi158:/scratch_devs is 72B 2019-12-05T03:48:57.313 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-12-05T03:48:57.313 INFO:teuthology.orchestra.run.smithi158:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2019-12-05T03:48:57.322 INFO:teuthology.orchestra.run.smithi158.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-1 2019-12-05T03:48:57.322 INFO:teuthology.orchestra.run.smithi158.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-05T03:48:57.322 INFO:teuthology.orchestra.run.smithi158.stdout:Device: 6h/6d Inode: 450 Links: 1 2019-12-05T03:48:57.322 INFO:teuthology.orchestra.run.smithi158.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-05T03:48:57.322 INFO:teuthology.orchestra.run.smithi158.stdout:Access: 2019-12-05 03:46:22.751597922 +0000 2019-12-05T03:48:57.323 INFO:teuthology.orchestra.run.smithi158.stdout:Modify: 2019-12-05 03:46:22.647649926 +0000 2019-12-05T03:48:57.323 INFO:teuthology.orchestra.run.smithi158.stdout:Change: 2019-12-05 03:46:22.647649926 +0000 2019-12-05T03:48:57.323 INFO:teuthology.orchestra.run.smithi158.stdout: Birth: - 2019-12-05T03:48:57.332 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records in 2019-12-05T03:48:57.332 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records out 2019-12-05T03:48:57.332 INFO:teuthology.orchestra.run.smithi158.stderr:512 bytes copied, 0.000329462 s, 1.6 MB/s 2019-12-05T03:48:57.336 INFO:teuthology.orchestra.run.smithi158:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2019-12-05T03:48:57.407 INFO:teuthology.orchestra.run.smithi158.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2019-12-05T03:48:57.407 INFO:teuthology.orchestra.run.smithi158.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-05T03:48:57.407 INFO:teuthology.orchestra.run.smithi158.stdout:Device: 6h/6d Inode: 456 Links: 1 2019-12-05T03:48:57.407 INFO:teuthology.orchestra.run.smithi158.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-05T03:48:57.407 INFO:teuthology.orchestra.run.smithi158.stdout:Access: 2019-12-05 03:46:23.011467915 +0000 2019-12-05T03:48:57.408 INFO:teuthology.orchestra.run.smithi158.stdout:Modify: 2019-12-05 03:46:22.895525918 +0000 2019-12-05T03:48:57.408 INFO:teuthology.orchestra.run.smithi158.stdout:Change: 2019-12-05 03:46:22.895525918 +0000 2019-12-05T03:48:57.408 INFO:teuthology.orchestra.run.smithi158.stdout: Birth: - 2019-12-05T03:48:57.417 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records in 2019-12-05T03:48:57.417 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records out 2019-12-05T03:48:57.417 INFO:teuthology.orchestra.run.smithi158.stderr:512 bytes copied, 0.000368004 s, 1.4 MB/s 2019-12-05T03:48:57.422 INFO:teuthology.orchestra.run.smithi158:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2019-12-05T03:48:57.493 INFO:teuthology.orchestra.run.smithi158.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-3 2019-12-05T03:48:57.494 INFO:teuthology.orchestra.run.smithi158.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-05T03:48:57.494 INFO:teuthology.orchestra.run.smithi158.stdout:Device: 6h/6d Inode: 462 Links: 1 2019-12-05T03:48:57.494 INFO:teuthology.orchestra.run.smithi158.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-05T03:48:57.494 INFO:teuthology.orchestra.run.smithi158.stdout:Access: 2019-12-05 03:46:23.247349909 +0000 2019-12-05T03:48:57.494 INFO:teuthology.orchestra.run.smithi158.stdout:Modify: 2019-12-05 03:46:23.139403912 +0000 2019-12-05T03:48:57.494 INFO:teuthology.orchestra.run.smithi158.stdout:Change: 2019-12-05 03:46:23.139403912 +0000 2019-12-05T03:48:57.494 INFO:teuthology.orchestra.run.smithi158.stdout: Birth: - 2019-12-05T03:48:57.502 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records in 2019-12-05T03:48:57.502 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records out 2019-12-05T03:48:57.503 INFO:teuthology.orchestra.run.smithi158.stderr:512 bytes copied, 0.000397451 s, 1.3 MB/s 2019-12-05T03:48:57.507 INFO:teuthology.orchestra.run.smithi158:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2019-12-05T03:48:57.578 INFO:teuthology.orchestra.run.smithi158.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-4 2019-12-05T03:48:57.578 INFO:teuthology.orchestra.run.smithi158.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-05T03:48:57.578 INFO:teuthology.orchestra.run.smithi158.stdout:Device: 6h/6d Inode: 468 Links: 1 2019-12-05T03:48:57.578 INFO:teuthology.orchestra.run.smithi158.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-05T03:48:57.579 INFO:teuthology.orchestra.run.smithi158.stdout:Access: 2019-12-05 03:46:23.391277905 +0000 2019-12-05T03:48:57.579 INFO:teuthology.orchestra.run.smithi158.stdout:Modify: 2019-12-05 03:46:23.387279904 +0000 2019-12-05T03:48:57.579 INFO:teuthology.orchestra.run.smithi158.stdout:Change: 2019-12-05 03:46:23.387279904 +0000 2019-12-05T03:48:57.579 INFO:teuthology.orchestra.run.smithi158.stdout: Birth: - 2019-12-05T03:48:57.588 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records in 2019-12-05T03:48:57.588 INFO:teuthology.orchestra.run.smithi158.stderr:1+0 records out 2019-12-05T03:48:57.588 INFO:teuthology.orchestra.run.smithi158.stderr:512 bytes copied, 0.00040091 s, 1.3 MB/s 2019-12-05T03:48:57.592 INFO:tasks.ceph:fs option selected, checking for scratch devs 2019-12-05T03:48:57.592 INFO:tasks.ceph:found devs: ['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-12-05T03:48:57.592 WARNING:teuthology.misc:Entering get_wwn_id_map, a deprecated function that will be removed 2019-12-05T03:48:57.593 INFO:tasks.ceph:dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-12-05T03:48:57.602 DEBUG:teuthology.orchestra.remote:smithi096:/scratch_devs is 72B 2019-12-05T03:48:57.614 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-12-05T03:48:57.614 INFO:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2019-12-05T03:48:57.622 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-1 2019-12-05T03:48:57.622 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-05T03:48:57.622 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 6h/6d Inode: 431 Links: 1 2019-12-05T03:48:57.623 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-05T03:48:57.623 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2019-12-05 03:46:32.182094833 +0000 2019-12-05T03:48:57.623 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2019-12-05 03:46:32.066152835 +0000 2019-12-05T03:48:57.623 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2019-12-05 03:46:32.066152835 +0000 2019-12-05T03:48:57.623 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2019-12-05T03:48:57.630 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2019-12-05T03:48:57.630 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2019-12-05T03:48:57.630 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000379621 s, 1.3 MB/s 2019-12-05T03:48:57.635 INFO:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2019-12-05T03:48:57.706 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2019-12-05T03:48:57.707 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-05T03:48:57.707 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 6h/6d Inode: 437 Links: 1 2019-12-05T03:48:57.707 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-05T03:48:57.707 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2019-12-05 03:46:32.481944826 +0000 2019-12-05T03:48:57.707 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2019-12-05 03:46:32.306032830 +0000 2019-12-05T03:48:57.707 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2019-12-05 03:46:32.306032830 +0000 2019-12-05T03:48:57.707 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2019-12-05T03:48:57.715 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2019-12-05T03:48:57.716 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2019-12-05T03:48:57.716 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000347537 s, 1.5 MB/s 2019-12-05T03:48:57.718 INFO:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2019-12-05T03:48:57.791 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-3 2019-12-05T03:48:57.791 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-05T03:48:57.791 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 6h/6d Inode: 443 Links: 1 2019-12-05T03:48:57.791 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-05T03:48:57.792 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2019-12-05 03:46:32.697836821 +0000 2019-12-05T03:48:57.792 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2019-12-05 03:46:32.601884823 +0000 2019-12-05T03:48:57.792 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2019-12-05 03:46:32.601884823 +0000 2019-12-05T03:48:57.792 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2019-12-05T03:48:57.801 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2019-12-05T03:48:57.801 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2019-12-05T03:48:57.801 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000391293 s, 1.3 MB/s 2019-12-05T03:48:57.805 INFO:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2019-12-05T03:48:57.876 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-4 2019-12-05T03:48:57.876 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-05T03:48:57.876 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 6h/6d Inode: 449 Links: 1 2019-12-05T03:48:57.876 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-05T03:48:57.877 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2019-12-05 03:48:29.945067047 +0000 2019-12-05T03:48:57.877 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2019-12-05 03:46:32.817776819 +0000 2019-12-05T03:48:57.877 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2019-12-05 03:46:32.817776819 +0000 2019-12-05T03:48:57.877 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2019-12-05T03:48:57.885 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2019-12-05T03:48:57.885 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2019-12-05T03:48:57.885 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000281242 s, 1.8 MB/s 2019-12-05T03:48:57.889 INFO:tasks.ceph:fs option selected, checking for scratch devs 2019-12-05T03:48:57.889 INFO:tasks.ceph:found devs: ['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-12-05T03:48:57.890 WARNING:teuthology.misc:Entering get_wwn_id_map, a deprecated function that will be removed 2019-12-05T03:48:57.890 INFO:tasks.ceph:dev map: {'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-12-05T03:48:57.890 INFO:tasks.ceph:Generating config... 2019-12-05T03:48:57.891 INFO:tasks.ceph:[mds] mds debug frag = True 2019-12-05T03:48:57.892 INFO:tasks.ceph:[mds] mds bal split bits = 3 2019-12-05T03:48:57.892 INFO:tasks.ceph:[mds] mds bal split size = 100 2019-12-05T03:48:57.892 INFO:tasks.ceph:[mds] debug mds = 20 2019-12-05T03:48:57.892 INFO:tasks.ceph:[mds] mds bal merge size = 5 2019-12-05T03:48:57.892 INFO:tasks.ceph:[mds] debug ms = 1 2019-12-05T03:48:57.892 INFO:tasks.ceph:[mds] mds bal frag = True 2019-12-05T03:48:57.892 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2019-12-05T03:48:57.893 INFO:tasks.ceph:[mds] mds op complaint time = 180 2019-12-05T03:48:57.893 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2019-12-05T03:48:57.893 INFO:tasks.ceph:[mds] osd op complaint time = 180 2019-12-05T03:48:57.893 INFO:tasks.ceph:[mds] mds verify scatter = True 2019-12-05T03:48:57.893 INFO:tasks.ceph:[client] debug ms = 1 2019-12-05T03:48:57.893 INFO:tasks.ceph:[client] pid file = 2019-12-05T03:48:57.894 INFO:tasks.ceph:[client] debug client = 20 2019-12-05T03:48:57.894 INFO:tasks.ceph:[client] client mount timeout = 600 2019-12-05T03:48:57.894 INFO:tasks.ceph:[mon] debug mon = 20 2019-12-05T03:48:57.894 INFO:tasks.ceph:[mon] debug paxos = 20 2019-12-05T03:48:57.894 INFO:tasks.ceph:[mon] mon op complaint time = 120 2019-12-05T03:48:57.894 INFO:tasks.ceph:[mon] debug ms = 1 2019-12-05T03:48:57.894 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2019-12-05T03:48:57.894 INFO:tasks.ceph:[osd] debug ms = 1 2019-12-05T03:48:57.895 INFO:tasks.ceph:[osd] debug journal = 20 2019-12-05T03:48:57.895 INFO:tasks.ceph:[osd] debug osd = 25 2019-12-05T03:48:57.895 INFO:tasks.ceph:[osd] debug bluestore = 20 2019-12-05T03:48:57.895 INFO:tasks.ceph:[osd] debug bluefs = 20 2019-12-05T03:48:57.895 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2019-12-05T03:48:57.895 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2019-12-05T03:48:57.895 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2019-12-05T03:48:57.895 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2019-12-05T03:48:57.896 INFO:tasks.ceph:[osd] debug filestore = 20 2019-12-05T03:48:57.896 INFO:tasks.ceph:[osd] debug rocksdb = 10 2019-12-05T03:48:57.896 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2019-12-05T03:48:57.896 INFO:tasks.ceph:[osd] osd op complaint time = 180 2019-12-05T03:48:57.896 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2019-12-05T03:48:57.896 INFO:tasks.ceph:Setting up mon.a... 2019-12-05T03:48:57.897 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2019-12-05T03:48:57.931 INFO:teuthology.orchestra.run.smithi158.stdout:creating /etc/ceph/ceph.keyring 2019-12-05T03:48:57.933 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2019-12-05T03:48:58.032 INFO:teuthology.orchestra.run.smithi158:> sudo chmod 0644 /etc/ceph/ceph.keyring 2019-12-05T03:48:58.110 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.158'), ('mon.c', '[v2:172.21.15.96:3301,v1:172.21.15.96:6790]'), ('mon.b', '172.21.15.96')] 2019-12-05T03:48:58.111 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.158 --addv c '[v2:172.21.15.96:3301,v1:172.21.15.96:6790]' --add b 172.21.15.96 --print /home/ubuntu/cephtest/ceph.monmap 2019-12-05T03:48:58.208 INFO:teuthology.orchestra.run.smithi158.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2019-12-05T03:48:58.209 INFO:teuthology.orchestra.run.smithi158.stdout:monmaptool: generated fsid a91186ae-f496-4de1-918d-820c55ff1feb 2019-12-05T03:48:58.209 INFO:teuthology.orchestra.run.smithi158.stdout:epoch 0 2019-12-05T03:48:58.209 INFO:teuthology.orchestra.run.smithi158.stdout:fsid a91186ae-f496-4de1-918d-820c55ff1feb 2019-12-05T03:48:58.209 INFO:teuthology.orchestra.run.smithi158.stdout:last_changed 2019-12-05T03:48:58.208378+0000 2019-12-05T03:48:58.209 INFO:teuthology.orchestra.run.smithi158.stdout:created 2019-12-05T03:48:58.208378+0000 2019-12-05T03:48:58.209 INFO:teuthology.orchestra.run.smithi158.stdout:min_mon_release 0 (unknown) 2019-12-05T03:48:58.210 INFO:teuthology.orchestra.run.smithi158.stdout:0: [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] mon.a 2019-12-05T03:48:58.210 INFO:teuthology.orchestra.run.smithi158.stdout:1: [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] mon.b 2019-12-05T03:48:58.210 INFO:teuthology.orchestra.run.smithi158.stdout:2: [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] mon.c 2019-12-05T03:48:58.210 INFO:teuthology.orchestra.run.smithi158.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2019-12-05T03:48:58.211 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID a91186ae-f496-4de1-918d-820c55ff1feb... 2019-12-05T03:48:58.212 INFO:teuthology.orchestra.run.smithi096:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo python -c 'import shutil, sys; shutil.copyfileobj(sys.stdin, file(sys.argv[1], "wb"))' /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf 2019-12-05T03:48:58.216 INFO:teuthology.orchestra.run.smithi158:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo python -c 'import shutil, sys; shutil.copyfileobj(sys.stdin, file(sys.argv[1], "wb"))' /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf 2019-12-05T03:48:58.339 INFO:tasks.ceph:Creating admin key on mon.a... 2019-12-05T03:48:58.339 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2019-12-05T03:48:58.378 INFO:tasks.ceph:Copying monmap to all nodes... 2019-12-05T03:48:58.451 DEBUG:teuthology.orchestra.remote:smithi158:/etc/ceph/ceph.keyring is 206B 2019-12-05T03:48:58.473 DEBUG:teuthology.orchestra.remote:smithi158:/home/ubuntu/cephtest/ceph.monmap is 379B 2019-12-05T03:48:58.491 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi158.front.sepia.ceph.com 2019-12-05T03:48:58.491 INFO:teuthology.orchestra.run.smithi158:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2019-12-05T03:48:58.550 INFO:teuthology.orchestra.run.smithi158:> cat > /home/ubuntu/cephtest/ceph.monmap 2019-12-05T03:48:58.661 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi096.front.sepia.ceph.com 2019-12-05T03:48:58.661 INFO:teuthology.orchestra.run.smithi096:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2019-12-05T03:48:58.720 INFO:teuthology.orchestra.run.smithi096:> cat > /home/ubuntu/cephtest/ceph.monmap 2019-12-05T03:48:58.829 INFO:tasks.ceph:Setting up mon nodes... 2019-12-05T03:48:58.830 INFO:tasks.ceph:Setting up mgr nodes... 2019-12-05T03:48:58.830 INFO:teuthology.orchestra.run.smithi158:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2019-12-05T03:48:58.872 INFO:teuthology.orchestra.run.smithi158.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2019-12-05T03:48:58.874 INFO:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2019-12-05T03:48:58.919 INFO:teuthology.orchestra.run.smithi096.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2019-12-05T03:48:58.922 INFO:tasks.ceph:Setting up mds nodes... 2019-12-05T03:48:58.922 INFO:teuthology.orchestra.run.smithi158:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2019-12-05T03:48:58.975 INFO:teuthology.orchestra.run.smithi158.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2019-12-05T03:48:58.977 INFO:teuthology.orchestra.run.smithi158:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2019-12-05T03:48:59.058 INFO:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2019-12-05T03:48:59.098 INFO:teuthology.orchestra.run.smithi096.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2019-12-05T03:48:59.100 INFO:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2019-12-05T03:48:59.181 INFO:tasks.ceph_client:Setting up client nodes... 2019-12-05T03:48:59.181 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2019-12-05T03:48:59.216 INFO:teuthology.orchestra.run.smithi158.stdout:creating /etc/ceph/ceph.client.0.keyring 2019-12-05T03:48:59.228 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2019-12-05T03:48:59.326 INFO:teuthology.orchestra.run.smithi158.stdout:creating /etc/ceph/ceph.client.1.keyring 2019-12-05T03:48:59.339 INFO:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2019-12-05T03:48:59.373 INFO:teuthology.orchestra.run.smithi096.stdout:creating /etc/ceph/ceph.client.2.keyring 2019-12-05T03:48:59.384 INFO:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2019-12-05T03:48:59.485 INFO:teuthology.orchestra.run.smithi096.stdout:creating /etc/ceph/ceph.client.3.keyring 2019-12-05T03:48:59.495 INFO:tasks.ceph:Running mkfs on osd nodes... 2019-12-05T03:48:59.495 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi158.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi096.front.sepia.ceph.com'): {'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'}} 2019-12-05T03:48:59.495 INFO:teuthology.orchestra.run.smithi158:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2019-12-05T03:48:59.512 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-12-05T03:48:59.512 INFO:tasks.ceph:{} 2019-12-05T03:48:59.512 INFO:tasks.ceph:osd.0 2019-12-05T03:48:59.512 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi158.front.sepia.ceph.com 2019-12-05T03:48:59.513 INFO:teuthology.orchestra.run.smithi158:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2019-12-05T03:49:00.084 INFO:teuthology.orchestra.run.smithi158.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2019-12-05T03:49:00.084 INFO:teuthology.orchestra.run.smithi158.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-05T03:49:00.085 INFO:teuthology.orchestra.run.smithi158.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2019-12-05T03:49:00.085 INFO:teuthology.orchestra.run.smithi158.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-05T03:49:00.085 INFO:teuthology.orchestra.run.smithi158.stdout: = sunit=0 swidth=0 blks 2019-12-05T03:49:00.085 INFO:teuthology.orchestra.run.smithi158.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-05T03:49:00.085 INFO:teuthology.orchestra.run.smithi158.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-05T03:49:00.085 INFO:teuthology.orchestra.run.smithi158.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-05T03:49:00.085 INFO:teuthology.orchestra.run.smithi158.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-05T03:49:00.086 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi158.front.sepia.ceph.com -o noatime 2019-12-05T03:49:00.087 INFO:teuthology.orchestra.run.smithi158:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0 2019-12-05T03:49:00.169 INFO:teuthology.orchestra.run.smithi158:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2019-12-05T03:49:00.181 INFO:teuthology.orchestra.run.smithi158.stderr:sudo: /sbin/restorecon: command not found 2019-12-05T03:49:00.181 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-05T03:49:00.182 INFO:teuthology.orchestra.run.smithi158:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2019-12-05T03:49:00.261 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-12-05T03:49:00.261 INFO:tasks.ceph:{} 2019-12-05T03:49:00.262 INFO:tasks.ceph:osd.1 2019-12-05T03:49:00.262 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi158.front.sepia.ceph.com 2019-12-05T03:49:00.262 INFO:teuthology.orchestra.run.smithi158:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2019-12-05T03:49:00.813 INFO:teuthology.orchestra.run.smithi158.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2019-12-05T03:49:00.814 INFO:teuthology.orchestra.run.smithi158.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-05T03:49:00.814 INFO:teuthology.orchestra.run.smithi158.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2019-12-05T03:49:00.814 INFO:teuthology.orchestra.run.smithi158.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-05T03:49:00.814 INFO:teuthology.orchestra.run.smithi158.stdout: = sunit=0 swidth=0 blks 2019-12-05T03:49:00.814 INFO:teuthology.orchestra.run.smithi158.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-05T03:49:00.814 INFO:teuthology.orchestra.run.smithi158.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-05T03:49:00.814 INFO:teuthology.orchestra.run.smithi158.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-05T03:49:00.815 INFO:teuthology.orchestra.run.smithi158.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-05T03:49:00.815 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi158.front.sepia.ceph.com -o noatime 2019-12-05T03:49:00.816 INFO:teuthology.orchestra.run.smithi158:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2019-12-05T03:49:00.840 INFO:teuthology.orchestra.run.smithi158:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2019-12-05T03:49:00.917 INFO:teuthology.orchestra.run.smithi158.stderr:sudo: /sbin/restorecon: command not found 2019-12-05T03:49:00.918 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-05T03:49:00.918 INFO:teuthology.orchestra.run.smithi158:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2019-12-05T03:49:01.001 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-12-05T03:49:01.001 INFO:tasks.ceph:{} 2019-12-05T03:49:01.001 INFO:tasks.ceph:osd.2 2019-12-05T03:49:01.001 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi158.front.sepia.ceph.com 2019-12-05T03:49:01.001 INFO:teuthology.orchestra.run.smithi158:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2019-12-05T03:49:01.567 INFO:teuthology.orchestra.run.smithi158.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2019-12-05T03:49:01.567 INFO:teuthology.orchestra.run.smithi158.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-05T03:49:01.567 INFO:teuthology.orchestra.run.smithi158.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2019-12-05T03:49:01.567 INFO:teuthology.orchestra.run.smithi158.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-05T03:49:01.567 INFO:teuthology.orchestra.run.smithi158.stdout: = sunit=0 swidth=0 blks 2019-12-05T03:49:01.567 INFO:teuthology.orchestra.run.smithi158.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-05T03:49:01.568 INFO:teuthology.orchestra.run.smithi158.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-05T03:49:01.568 INFO:teuthology.orchestra.run.smithi158.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-05T03:49:01.568 INFO:teuthology.orchestra.run.smithi158.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-05T03:49:01.569 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi158.front.sepia.ceph.com -o noatime 2019-12-05T03:49:01.569 INFO:teuthology.orchestra.run.smithi158:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2019-12-05T03:49:01.615 INFO:teuthology.orchestra.run.smithi158:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2019-12-05T03:49:01.692 INFO:teuthology.orchestra.run.smithi158.stderr:sudo: /sbin/restorecon: command not found 2019-12-05T03:49:01.692 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-05T03:49:01.692 INFO:teuthology.orchestra.run.smithi158:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2019-12-05T03:49:01.771 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-12-05T03:49:01.771 INFO:tasks.ceph:{} 2019-12-05T03:49:01.771 INFO:tasks.ceph:osd.3 2019-12-05T03:49:01.772 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi158.front.sepia.ceph.com 2019-12-05T03:49:01.772 INFO:teuthology.orchestra.run.smithi158:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2019-12-05T03:49:02.321 INFO:teuthology.orchestra.run.smithi158.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2019-12-05T03:49:02.321 INFO:teuthology.orchestra.run.smithi158.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-05T03:49:02.321 INFO:teuthology.orchestra.run.smithi158.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2019-12-05T03:49:02.322 INFO:teuthology.orchestra.run.smithi158.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-05T03:49:02.322 INFO:teuthology.orchestra.run.smithi158.stdout: = sunit=0 swidth=0 blks 2019-12-05T03:49:02.322 INFO:teuthology.orchestra.run.smithi158.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-05T03:49:02.322 INFO:teuthology.orchestra.run.smithi158.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-05T03:49:02.322 INFO:teuthology.orchestra.run.smithi158.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-05T03:49:02.322 INFO:teuthology.orchestra.run.smithi158.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-05T03:49:02.323 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi158.front.sepia.ceph.com -o noatime 2019-12-05T03:49:02.323 INFO:teuthology.orchestra.run.smithi158:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2019-12-05T03:49:02.390 INFO:teuthology.orchestra.run.smithi158:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2019-12-05T03:49:02.400 INFO:teuthology.orchestra.run.smithi158.stderr:sudo: /sbin/restorecon: command not found 2019-12-05T03:49:02.401 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-05T03:49:02.401 INFO:teuthology.orchestra.run.smithi158:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-05T03:49:02.508 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:02.503+0000 7f5189704d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2019-12-05T03:49:02.510 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:02.507+0000 7f5189704d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2019-12-05T03:49:02.511 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:02.507+0000 7f5189704d80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2019-12-05T03:49:02.511 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:02.507+0000 7f5189704d80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2019-12-05T03:49:02.511 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:02.507+0000 7f5189704d80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2019-12-05T03:49:02.515 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:02.511+0000 7f5189704d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2019-12-05T03:49:04.977 INFO:teuthology.orchestra.run.smithi158:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2019-12-05T03:49:05.058 INFO:teuthology.orchestra.run.smithi158:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-05T03:49:05.161 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:05.159+0000 7f8c88068d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2019-12-05T03:49:05.161 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:05.159+0000 7f8c88068d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2019-12-05T03:49:05.161 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:05.159+0000 7f8c88068d80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2019-12-05T03:49:05.161 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:05.159+0000 7f8c88068d80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2019-12-05T03:49:05.161 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:05.159+0000 7f8c88068d80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2019-12-05T03:49:05.162 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:05.159+0000 7f8c88068d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2019-12-05T03:49:07.627 INFO:teuthology.orchestra.run.smithi158:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2019-12-05T03:49:07.708 INFO:teuthology.orchestra.run.smithi158:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-05T03:49:07.812 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:07.807+0000 7f7eb2e06d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2019-12-05T03:49:07.812 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:07.807+0000 7f7eb2e06d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2019-12-05T03:49:07.812 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:07.807+0000 7f7eb2e06d80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2019-12-05T03:49:07.812 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:07.807+0000 7f7eb2e06d80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2019-12-05T03:49:07.812 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:07.807+0000 7f7eb2e06d80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2019-12-05T03:49:07.813 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:07.811+0000 7f7eb2e06d80 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2019-12-05T03:49:10.267 INFO:teuthology.orchestra.run.smithi158:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2019-12-05T03:49:10.350 INFO:teuthology.orchestra.run.smithi158:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-05T03:49:10.457 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:10.455+0000 7f6a954a1d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2019-12-05T03:49:10.457 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:10.455+0000 7f6a954a1d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2019-12-05T03:49:10.457 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:10.455+0000 7f6a954a1d80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2019-12-05T03:49:10.457 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:10.455+0000 7f6a954a1d80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2019-12-05T03:49:10.457 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:10.455+0000 7f6a954a1d80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2019-12-05T03:49:10.458 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:10.455+0000 7f6a954a1d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2019-12-05T03:49:12.926 INFO:teuthology.orchestra.run.smithi158:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2019-12-05T03:49:13.006 INFO:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2019-12-05T03:49:13.024 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-12-05T03:49:13.024 INFO:tasks.ceph:{} 2019-12-05T03:49:13.024 INFO:tasks.ceph:osd.4 2019-12-05T03:49:13.024 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi096.front.sepia.ceph.com 2019-12-05T03:49:13.024 INFO:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2019-12-05T03:49:13.583 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2019-12-05T03:49:13.583 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-05T03:49:13.583 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2019-12-05T03:49:13.583 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-05T03:49:13.583 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2019-12-05T03:49:13.584 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-05T03:49:13.584 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-05T03:49:13.584 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-05T03:49:13.584 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-05T03:49:13.585 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2019-12-05T03:49:13.585 INFO:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4 2019-12-05T03:49:13.676 INFO:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2019-12-05T03:49:13.689 INFO:teuthology.orchestra.run.smithi096.stderr:sudo: /sbin/restorecon: command not found 2019-12-05T03:49:13.690 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-05T03:49:13.690 INFO:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2019-12-05T03:49:13.770 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-12-05T03:49:13.770 INFO:tasks.ceph:{} 2019-12-05T03:49:13.770 INFO:tasks.ceph:osd.5 2019-12-05T03:49:13.770 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi096.front.sepia.ceph.com 2019-12-05T03:49:13.770 INFO:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2019-12-05T03:49:14.318 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2019-12-05T03:49:14.319 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-05T03:49:14.319 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2019-12-05T03:49:14.319 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-05T03:49:14.319 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2019-12-05T03:49:14.320 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-05T03:49:14.320 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-05T03:49:14.320 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-05T03:49:14.320 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-05T03:49:14.321 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2019-12-05T03:49:14.321 INFO:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-5 2019-12-05T03:49:14.345 INFO:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2019-12-05T03:49:14.421 INFO:teuthology.orchestra.run.smithi096.stderr:sudo: /sbin/restorecon: command not found 2019-12-05T03:49:14.422 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-05T03:49:14.422 INFO:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2019-12-05T03:49:14.500 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-12-05T03:49:14.501 INFO:tasks.ceph:{} 2019-12-05T03:49:14.501 INFO:tasks.ceph:osd.6 2019-12-05T03:49:14.501 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi096.front.sepia.ceph.com 2019-12-05T03:49:14.501 INFO:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2019-12-05T03:49:15.061 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2019-12-05T03:49:15.061 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-05T03:49:15.061 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2019-12-05T03:49:15.062 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-05T03:49:15.062 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2019-12-05T03:49:15.062 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-05T03:49:15.062 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-05T03:49:15.062 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-05T03:49:15.063 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-05T03:49:15.064 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2019-12-05T03:49:15.064 INFO:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2019-12-05T03:49:15.113 INFO:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2019-12-05T03:49:15.126 INFO:teuthology.orchestra.run.smithi096.stderr:sudo: /sbin/restorecon: command not found 2019-12-05T03:49:15.127 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-05T03:49:15.127 INFO:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2019-12-05T03:49:15.216 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-12-05T03:49:15.217 INFO:tasks.ceph:{} 2019-12-05T03:49:15.217 INFO:tasks.ceph:osd.7 2019-12-05T03:49:15.217 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi096.front.sepia.ceph.com 2019-12-05T03:49:15.217 INFO:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2019-12-05T03:49:15.796 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2019-12-05T03:49:15.796 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-05T03:49:15.796 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2019-12-05T03:49:15.796 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-05T03:49:15.796 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2019-12-05T03:49:15.797 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-05T03:49:15.797 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-05T03:49:15.797 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-05T03:49:15.797 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-05T03:49:15.798 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2019-12-05T03:49:15.798 INFO:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-7 2019-12-05T03:49:15.870 INFO:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2019-12-05T03:49:15.885 INFO:teuthology.orchestra.run.smithi096.stderr:sudo: /sbin/restorecon: command not found 2019-12-05T03:49:15.885 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-05T03:49:15.885 INFO:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-05T03:49:15.996 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:15.997+0000 7f66d114fd80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2019-12-05T03:49:15.997 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:15.997+0000 7f66d114fd80 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2019-12-05T03:49:15.997 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:15.997+0000 7f66d114fd80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2019-12-05T03:49:15.998 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:15.997+0000 7f66d114fd80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2019-12-05T03:49:15.998 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:15.997+0000 7f66d114fd80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2019-12-05T03:49:16.002 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:16.001+0000 7f66d114fd80 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2019-12-05T03:49:18.455 INFO:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2019-12-05T03:49:18.472 INFO:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-05T03:49:18.575 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:18.573+0000 7f9baf7ffd80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2019-12-05T03:49:18.575 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:18.573+0000 7f9baf7ffd80 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2019-12-05T03:49:18.575 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:18.573+0000 7f9baf7ffd80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2019-12-05T03:49:18.576 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:18.573+0000 7f9baf7ffd80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2019-12-05T03:49:18.576 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:18.573+0000 7f9baf7ffd80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2019-12-05T03:49:18.576 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:18.577+0000 7f9baf7ffd80 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2019-12-05T03:49:21.022 INFO:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2019-12-05T03:49:21.102 INFO:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-05T03:49:21.205 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:21.205+0000 7f79b8d45d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2019-12-05T03:49:21.205 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:21.205+0000 7f79b8d45d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2019-12-05T03:49:21.205 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:21.205+0000 7f79b8d45d80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2019-12-05T03:49:21.206 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:21.205+0000 7f79b8d45d80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2019-12-05T03:49:21.206 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:21.205+0000 7f79b8d45d80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2019-12-05T03:49:21.206 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:21.205+0000 7f79b8d45d80 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2019-12-05T03:49:23.645 INFO:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2019-12-05T03:49:23.725 INFO:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-05T03:49:23.828 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:23.829+0000 7fc5dfe96d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2019-12-05T03:49:23.829 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:23.829+0000 7fc5dfe96d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2019-12-05T03:49:23.829 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:23.829+0000 7fc5dfe96d80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2019-12-05T03:49:23.829 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:23.829+0000 7fc5dfe96d80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2019-12-05T03:49:23.829 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:23.829+0000 7fc5dfe96d80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2019-12-05T03:49:23.829 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:23.829+0000 7fc5dfe96d80 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2019-12-05T03:49:26.294 INFO:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2019-12-05T03:49:26.375 INFO:tasks.ceph:Reading keys from all nodes... 2019-12-05T03:49:26.375 INFO:teuthology.orchestra.run.smithi158:> mktemp 2019-12-05T03:49:26.382 INFO:teuthology.orchestra.run.smithi158.stdout:/tmp/tmp.2RqxA72Alp 2019-12-05T03:49:26.383 INFO:teuthology.orchestra.run.smithi158:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.2RqxA72Alp 2019-12-05T03:49:26.465 INFO:teuthology.orchestra.run.smithi158:> sudo chmod 0666 /tmp/tmp.2RqxA72Alp 2019-12-05T03:49:26.615 DEBUG:teuthology.orchestra.remote:smithi158:/tmp/tmp.2RqxA72Alp is 56B 2019-12-05T03:49:26.627 INFO:teuthology.orchestra.run.smithi158:> rm -fr /tmp/tmp.2RqxA72Alp 2019-12-05T03:49:27.548 INFO:teuthology.orchestra.run.smithi158:> mktemp 2019-12-05T03:49:27.549 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:49:27.552 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:49:27.555 INFO:teuthology.orchestra.run.smithi158.stdout:/tmp/tmp.aE0t5jDgJV 2019-12-05T03:49:27.556 INFO:teuthology.orchestra.run.smithi158:> sudo cp /var/lib/ceph/mds/ceph-a/keyring /tmp/tmp.aE0t5jDgJV 2019-12-05T03:49:27.658 INFO:teuthology.orchestra.run.smithi158:> sudo chmod 0666 /tmp/tmp.aE0t5jDgJV 2019-12-05T03:49:27.821 DEBUG:teuthology.orchestra.remote:smithi158:/tmp/tmp.aE0t5jDgJV is 56B 2019-12-05T03:49:27.873 INFO:teuthology.orchestra.run.smithi158:> rm -fr /tmp/tmp.aE0t5jDgJV 2019-12-05T03:49:27.881 INFO:teuthology.orchestra.run.smithi158:> mktemp 2019-12-05T03:49:27.952 INFO:teuthology.orchestra.run.smithi158.stdout:/tmp/tmp.FfmEQ7nCDV 2019-12-05T03:49:27.953 INFO:teuthology.orchestra.run.smithi158:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.FfmEQ7nCDV 2019-12-05T03:49:28.033 INFO:teuthology.orchestra.run.smithi158:> sudo chmod 0666 /tmp/tmp.FfmEQ7nCDV 2019-12-05T03:49:28.186 DEBUG:teuthology.orchestra.remote:smithi158:/tmp/tmp.FfmEQ7nCDV is 56B 2019-12-05T03:49:28.239 INFO:teuthology.orchestra.run.smithi158:> rm -fr /tmp/tmp.FfmEQ7nCDV 2019-12-05T03:49:28.246 INFO:teuthology.orchestra.run.smithi158:> mktemp 2019-12-05T03:49:28.318 INFO:teuthology.orchestra.run.smithi158.stdout:/tmp/tmp.pcC4g45nxx 2019-12-05T03:49:28.318 INFO:teuthology.orchestra.run.smithi158:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.pcC4g45nxx 2019-12-05T03:49:28.399 INFO:teuthology.orchestra.run.smithi158:> sudo chmod 0666 /tmp/tmp.pcC4g45nxx 2019-12-05T03:49:28.556 DEBUG:teuthology.orchestra.remote:smithi158:/tmp/tmp.pcC4g45nxx is 56B 2019-12-05T03:49:28.567 INFO:teuthology.orchestra.run.smithi158:> rm -fr /tmp/tmp.pcC4g45nxx 2019-12-05T03:49:28.577 INFO:teuthology.orchestra.run.smithi158:> mktemp 2019-12-05T03:49:28.647 INFO:teuthology.orchestra.run.smithi158.stdout:/tmp/tmp.iP5llx8We1 2019-12-05T03:49:28.647 INFO:teuthology.orchestra.run.smithi158:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.iP5llx8We1 2019-12-05T03:49:28.726 INFO:teuthology.orchestra.run.smithi158:> sudo chmod 0666 /tmp/tmp.iP5llx8We1 2019-12-05T03:49:28.877 DEBUG:teuthology.orchestra.remote:smithi158:/tmp/tmp.iP5llx8We1 is 56B 2019-12-05T03:49:28.889 INFO:teuthology.orchestra.run.smithi158:> rm -fr /tmp/tmp.iP5llx8We1 2019-12-05T03:49:28.896 INFO:teuthology.orchestra.run.smithi158:> mktemp 2019-12-05T03:49:28.969 INFO:teuthology.orchestra.run.smithi158.stdout:/tmp/tmp.MSHCarxBrD 2019-12-05T03:49:28.969 INFO:teuthology.orchestra.run.smithi158:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.MSHCarxBrD 2019-12-05T03:49:29.048 INFO:teuthology.orchestra.run.smithi158:> sudo chmod 0666 /tmp/tmp.MSHCarxBrD 2019-12-05T03:49:29.199 DEBUG:teuthology.orchestra.remote:smithi158:/tmp/tmp.MSHCarxBrD is 56B 2019-12-05T03:49:29.220 INFO:teuthology.orchestra.run.smithi158:> rm -fr /tmp/tmp.MSHCarxBrD 2019-12-05T03:49:29.227 INFO:teuthology.orchestra.run.smithi096:> mktemp 2019-12-05T03:49:29.235 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.1VFenpg3oj 2019-12-05T03:49:29.235 INFO:teuthology.orchestra.run.smithi096:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.1VFenpg3oj 2019-12-05T03:49:29.315 INFO:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.1VFenpg3oj 2019-12-05T03:49:29.468 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.1VFenpg3oj is 56B 2019-12-05T03:49:29.479 INFO:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.1VFenpg3oj 2019-12-05T03:49:29.486 INFO:teuthology.orchestra.run.smithi096:> mktemp 2019-12-05T03:49:29.569 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.LJOpL58Qv7 2019-12-05T03:49:29.570 INFO:teuthology.orchestra.run.smithi096:> sudo cp /var/lib/ceph/mds/ceph-b/keyring /tmp/tmp.LJOpL58Qv7 2019-12-05T03:49:29.632 INFO:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.LJOpL58Qv7 2019-12-05T03:49:29.789 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.LJOpL58Qv7 is 56B 2019-12-05T03:49:29.800 INFO:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.LJOpL58Qv7 2019-12-05T03:49:29.807 INFO:teuthology.orchestra.run.smithi096:> mktemp 2019-12-05T03:49:29.877 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.XVYrqYHd1q 2019-12-05T03:49:29.877 INFO:teuthology.orchestra.run.smithi096:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.XVYrqYHd1q 2019-12-05T03:49:29.956 INFO:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.XVYrqYHd1q 2019-12-05T03:49:30.113 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.XVYrqYHd1q is 56B 2019-12-05T03:49:30.124 INFO:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.XVYrqYHd1q 2019-12-05T03:49:30.131 INFO:teuthology.orchestra.run.smithi096:> mktemp 2019-12-05T03:49:30.201 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.SD4FVs4MID 2019-12-05T03:49:30.201 INFO:teuthology.orchestra.run.smithi096:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.SD4FVs4MID 2019-12-05T03:49:30.280 INFO:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.SD4FVs4MID 2019-12-05T03:49:30.430 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.SD4FVs4MID is 56B 2019-12-05T03:49:30.441 INFO:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.SD4FVs4MID 2019-12-05T03:49:30.448 INFO:teuthology.orchestra.run.smithi096:> mktemp 2019-12-05T03:49:30.521 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.lkGJtyvJjE 2019-12-05T03:49:30.522 INFO:teuthology.orchestra.run.smithi096:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.lkGJtyvJjE 2019-12-05T03:49:30.603 INFO:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.lkGJtyvJjE 2019-12-05T03:49:30.757 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.lkGJtyvJjE is 56B 2019-12-05T03:49:30.808 INFO:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.lkGJtyvJjE 2019-12-05T03:49:30.815 INFO:teuthology.orchestra.run.smithi096:> mktemp 2019-12-05T03:49:30.886 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.Q5i4BpoRwb 2019-12-05T03:49:30.886 INFO:teuthology.orchestra.run.smithi096:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.Q5i4BpoRwb 2019-12-05T03:49:30.968 INFO:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.Q5i4BpoRwb 2019-12-05T03:49:31.119 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.Q5i4BpoRwb is 56B 2019-12-05T03:49:31.130 INFO:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.Q5i4BpoRwb 2019-12-05T03:49:31.147 DEBUG:teuthology.orchestra.remote:smithi158:/etc/ceph/ceph.client.0.keyring is 59B 2019-12-05T03:49:31.167 DEBUG:teuthology.orchestra.remote:smithi158:/etc/ceph/ceph.client.1.keyring is 59B 2019-12-05T03:49:31.188 DEBUG:teuthology.orchestra.remote:smithi096:/etc/ceph/ceph.client.2.keyring is 59B 2019-12-05T03:49:31.208 DEBUG:teuthology.orchestra.remote:smithi096:/etc/ceph/ceph.client.3.keyring is 59B 2019-12-05T03:49:31.219 INFO:tasks.ceph:Adding keys to all mons... 2019-12-05T03:49:31.219 INFO:teuthology.orchestra.run.smithi096:> sudo tee -a /etc/ceph/ceph.keyring 2019-12-05T03:49:31.222 INFO:teuthology.orchestra.run.smithi158:> sudo tee -a /etc/ceph/ceph.keyring 2019-12-05T03:49:31.264 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr.y] 2019-12-05T03:49:31.264 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAqfuhdjEH5MxAA033BbVQh6fXn/TAcllODbQ== 2019-12-05T03:49:31.264 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.a] 2019-12-05T03:49:31.264 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAqfuhdOuUWOhAAoINSdxLi+c9akvDm9oJUWg== 2019-12-05T03:49:31.264 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.0] 2019-12-05T03:49:31.264 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAufuhddWxFHhAAbBwVGRlTYaQITsRya6euig== 2019-12-05T03:49:31.265 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.1] 2019-12-05T03:49:31.265 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAxfuhdVoOOCRAAocisawAV9hfkZmvhGUgexA== 2019-12-05T03:49:31.265 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.2] 2019-12-05T03:49:31.265 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAzfuhd/+haMBAApP7Fbn8Ne56AXjF/QUlYTQ== 2019-12-05T03:49:31.265 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.3] 2019-12-05T03:49:31.265 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQA2fuhdkc8tGxAAxRpqQvx8dg/Jf1/K/NAP+Q== 2019-12-05T03:49:31.265 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr.x] 2019-12-05T03:49:31.266 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAqfuhdizfeNhAA5Q4kkpEPSZ1C/Yak1ZAN2Q== 2019-12-05T03:49:31.266 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.b] 2019-12-05T03:49:31.266 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQArfuhdPD3pBRAAX9g/5tufJZr7PJYvyLWsKg== 2019-12-05T03:49:31.266 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.4] 2019-12-05T03:49:31.266 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQA7fuhdF855OxAAdUIf+MQAoMcnQyp6LW005g== 2019-12-05T03:49:31.266 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.5] 2019-12-05T03:49:31.266 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQA+fuhdQYpaIhAA2AG4bBEBZ8HCyJ/K3ekMXw== 2019-12-05T03:49:31.267 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.6] 2019-12-05T03:49:31.267 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBBfuhdPnREDBAAVzDpx6Lod7yojRiF1kDC2A== 2019-12-05T03:49:31.267 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.7] 2019-12-05T03:49:31.267 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBDfuhd8zt1MRAApdsqSze/na0dmD2Otn/SoQ== 2019-12-05T03:49:31.267 INFO:teuthology.orchestra.run.smithi096.stdout:[client.0] 2019-12-05T03:49:31.267 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQArfuhdz0LcDBAACZcU6mxbAU8zR0OFiUJRCQ== 2019-12-05T03:49:31.267 INFO:teuthology.orchestra.run.smithi096.stdout:[client.1] 2019-12-05T03:49:31.268 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQArfuhdw3V3ExAAjBQoBr2WI4VgWJQr76zqGA== 2019-12-05T03:49:31.268 INFO:teuthology.orchestra.run.smithi096.stdout:[client.2] 2019-12-05T03:49:31.268 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQArfuhdDDxJFhAAwyalbbARbe3jGAfdfxKZ1A== 2019-12-05T03:49:31.268 INFO:teuthology.orchestra.run.smithi096.stdout:[client.3] 2019-12-05T03:49:31.268 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQArfuhd4lLZHBAARKHJdQL/oNV2TDCfFy+8iQ== 2019-12-05T03:49:31.270 INFO:teuthology.orchestra.run.smithi158.stdout:[mgr.y] 2019-12-05T03:49:31.270 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQAqfuhdjEH5MxAA033BbVQh6fXn/TAcllODbQ== 2019-12-05T03:49:31.270 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.a] 2019-12-05T03:49:31.270 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQAqfuhdOuUWOhAAoINSdxLi+c9akvDm9oJUWg== 2019-12-05T03:49:31.270 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.0] 2019-12-05T03:49:31.270 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQAufuhddWxFHhAAbBwVGRlTYaQITsRya6euig== 2019-12-05T03:49:31.271 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.1] 2019-12-05T03:49:31.271 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQAxfuhdVoOOCRAAocisawAV9hfkZmvhGUgexA== 2019-12-05T03:49:31.271 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.2] 2019-12-05T03:49:31.271 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQAzfuhd/+haMBAApP7Fbn8Ne56AXjF/QUlYTQ== 2019-12-05T03:49:31.271 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.3] 2019-12-05T03:49:31.271 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQA2fuhdkc8tGxAAxRpqQvx8dg/Jf1/K/NAP+Q== 2019-12-05T03:49:31.272 INFO:teuthology.orchestra.run.smithi158.stdout:[mgr.x] 2019-12-05T03:49:31.272 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQAqfuhdizfeNhAA5Q4kkpEPSZ1C/Yak1ZAN2Q== 2019-12-05T03:49:31.272 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.b] 2019-12-05T03:49:31.272 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQArfuhdPD3pBRAAX9g/5tufJZr7PJYvyLWsKg== 2019-12-05T03:49:31.272 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.4] 2019-12-05T03:49:31.272 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQA7fuhdF855OxAAdUIf+MQAoMcnQyp6LW005g== 2019-12-05T03:49:31.272 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.5] 2019-12-05T03:49:31.272 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQA+fuhdQYpaIhAA2AG4bBEBZ8HCyJ/K3ekMXw== 2019-12-05T03:49:31.273 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.6] 2019-12-05T03:49:31.273 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQBBfuhdPnREDBAAVzDpx6Lod7yojRiF1kDC2A== 2019-12-05T03:49:31.273 INFO:teuthology.orchestra.run.smithi158.stdout:[osd.7] 2019-12-05T03:49:31.273 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQBDfuhd8zt1MRAApdsqSze/na0dmD2Otn/SoQ== 2019-12-05T03:49:31.273 INFO:teuthology.orchestra.run.smithi158.stdout:[client.0] 2019-12-05T03:49:31.273 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQArfuhdz0LcDBAACZcU6mxbAU8zR0OFiUJRCQ== 2019-12-05T03:49:31.273 INFO:teuthology.orchestra.run.smithi158.stdout:[client.1] 2019-12-05T03:49:31.274 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQArfuhdw3V3ExAAjBQoBr2WI4VgWJQr76zqGA== 2019-12-05T03:49:31.274 INFO:teuthology.orchestra.run.smithi158.stdout:[client.2] 2019-12-05T03:49:31.274 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQArfuhdDDxJFhAAwyalbbARbe3jGAfdfxKZ1A== 2019-12-05T03:49:31.274 INFO:teuthology.orchestra.run.smithi158.stdout:[client.3] 2019-12-05T03:49:31.274 INFO:teuthology.orchestra.run.smithi158.stdout: key = AQArfuhd4lLZHBAARKHJdQL/oNV2TDCfFy+8iQ== 2019-12-05T03:49:31.275 INFO:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-12-05T03:49:31.342 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-12-05T03:49:31.384 INFO:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2019-12-05T03:49:31.453 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2019-12-05T03:49:31.499 INFO:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-05T03:49:31.503 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-05T03:49:31.612 INFO:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-05T03:49:31.615 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-05T03:49:31.723 INFO:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-05T03:49:31.727 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-05T03:49:31.833 INFO:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-05T03:49:31.836 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-05T03:49:31.944 INFO:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-12-05T03:49:31.948 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-12-05T03:49:32.055 INFO:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2019-12-05T03:49:32.058 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2019-12-05T03:49:32.167 INFO:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-05T03:49:32.171 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-05T03:49:32.277 INFO:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-05T03:49:32.280 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-05T03:49:32.387 INFO:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-05T03:49:32.391 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-05T03:49:32.497 INFO:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-05T03:49:32.500 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-05T03:49:32.606 INFO:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-05T03:49:32.610 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-05T03:49:32.723 INFO:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-05T03:49:32.727 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-05T03:49:32.845 INFO:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-05T03:49:32.871 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-05T03:49:32.961 INFO:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-05T03:49:32.974 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-05T03:49:33.084 INFO:tasks.ceph:Running mkfs on mon nodes... 2019-12-05T03:49:33.084 INFO:teuthology.orchestra.run.smithi158:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2019-12-05T03:49:33.165 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-12-05T03:49:33.305 INFO:teuthology.orchestra.run.smithi158:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2019-12-05T03:49:33.322 INFO:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2019-12-05T03:49:33.339 INFO:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-12-05T03:49:33.482 INFO:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2019-12-05T03:49:33.497 INFO:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2019-12-05T03:49:33.577 INFO:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-12-05T03:49:33.700 INFO:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2019-12-05T03:49:33.714 INFO:teuthology.orchestra.run.smithi096:> rm -- /home/ubuntu/cephtest/ceph.monmap 2019-12-05T03:49:33.781 INFO:teuthology.orchestra.run.smithi158:> rm -- /home/ubuntu/cephtest/ceph.monmap 2019-12-05T03:49:33.788 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2019-12-05T03:49:33.789 INFO:tasks.ceph.mon.a:Restarting daemon 2019-12-05T03:49:33.789 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2019-12-05T03:49:33.855 INFO:tasks.ceph.mon.a:Started 2019-12-05T03:49:33.855 INFO:tasks.ceph.mon.b:Restarting daemon 2019-12-05T03:49:33.855 INFO:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2019-12-05T03:49:33.859 INFO:tasks.ceph.mon.b:Started 2019-12-05T03:49:33.859 INFO:tasks.ceph.mon.c:Restarting daemon 2019-12-05T03:49:33.859 INFO:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2019-12-05T03:49:33.862 INFO:tasks.ceph.mon.c:Started 2019-12-05T03:49:33.862 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2019-12-05T03:49:33.862 INFO:tasks.ceph.mgr.y:Restarting daemon 2019-12-05T03:49:33.863 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2019-12-05T03:49:33.866 INFO:tasks.ceph.mgr.y:Started 2019-12-05T03:49:33.866 INFO:tasks.ceph.mgr.x:Restarting daemon 2019-12-05T03:49:33.866 INFO:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2019-12-05T03:49:33.869 INFO:tasks.ceph.mgr.x:Started 2019-12-05T03:49:33.870 INFO:tasks.ceph:Setting crush tunables to default 2019-12-05T03:49:33.870 INFO:teuthology.orchestra.run.smithi158:> sudo ceph --cluster ceph osd crush tunables default 2019-12-05T03:49:39.217 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:33.963+0000 7f8826c43700 1 Processor -- start 2019-12-05T03:49:39.218 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:33.963+0000 7f8826c43700 1 -- start start 2019-12-05T03:49:39.218 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:33.967+0000 7f8826c43700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8820059d60 0x7f882005a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:39.218 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:33.967+0000 7f8826c43700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88200993a0 con 0x7f88200b6f10 2019-12-05T03:49:39.218 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:33.967+0000 7f8826c43700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8820097ea0 con 0x7f88200969b0 2019-12-05T03:49:39.218 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:33.967+0000 7f8826c43700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8820098220 con 0x7f8820059d60 2019-12-05T03:49:39.218 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:33.967+0000 7f88249df700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f88200969b0 0x7f8820059560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:47666/0 (socket says 172.21.15.158:47666) 2019-12-05T03:49:39.218 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:33.967+0000 7f88249df700 1 -- 172.21.15.158:0/3834533995 learned_addr learned my addr 172.21.15.158:0/3834533995 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:49:39.219 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:33.967+0000 7f88259e1700 1 --2- 172.21.15.158:0/3834533995 >> v2:172.21.15.96:3300/0 conn(0x7f8820059d60 0x7f882005a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:39.219 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:33.967+0000 7f88259e1700 1 -- 172.21.15.158:0/3834533995 >> v2:172.21.15.96:3300/0 conn(0x7f8820059d60 msgr2=0x7f882005a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2019-12-05T03:49:39.219 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:33.967+0000 7f88259e1700 1 -- 172.21.15.158:0/3834533995 >> v2:172.21.15.96:3300/0 conn(0x7f8820059d60 msgr2=0x7f882005a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2019-12-05T03:49:39.219 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:33.967+0000 7f88259e1700 1 --2- 172.21.15.158:0/3834533995 >> v2:172.21.15.96:3300/0 conn(0x7f8820059d60 0x7f882005a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2019-12-05T03:49:39.219 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:33.967+0000 7f88259e1700 1 --2- 172.21.15.158:0/3834533995 >> v2:172.21.15.96:3300/0 conn(0x7f8820059d60 0x7f882005a190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2019-12-05T03:49:39.219 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:34.171+0000 7f88259e1700 1 --2- 172.21.15.158:0/3834533995 >> v2:172.21.15.96:3300/0 conn(0x7f8820059d60 0x7f882005a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:39.219 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:34.171+0000 7f88259e1700 1 -- 172.21.15.158:0/3834533995 >> v2:172.21.15.96:3300/0 conn(0x7f8820059d60 msgr2=0x7f882005a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2019-12-05T03:49:39.220 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:34.171+0000 7f88259e1700 1 -- 172.21.15.158:0/3834533995 >> v2:172.21.15.96:3300/0 conn(0x7f8820059d60 msgr2=0x7f882005a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2019-12-05T03:49:39.220 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:34.171+0000 7f88259e1700 1 --2- 172.21.15.158:0/3834533995 >> v2:172.21.15.96:3300/0 conn(0x7f8820059d60 0x7f882005a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2019-12-05T03:49:39.220 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:34.171+0000 7f88259e1700 1 --2- 172.21.15.158:0/3834533995 >> v2:172.21.15.96:3300/0 conn(0x7f8820059d60 0x7f882005a190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2019-12-05T03:49:39.220 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:34.575+0000 7f88259e1700 1 --2- 172.21.15.158:0/3834533995 >> v2:172.21.15.96:3300/0 conn(0x7f8820059d60 0x7f882005a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:39.220 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:34.575+0000 7f88259e1700 1 -- 172.21.15.158:0/3834533995 >> v2:172.21.15.96:3300/0 conn(0x7f8820059d60 msgr2=0x7f882005a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2019-12-05T03:49:39.220 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:34.575+0000 7f88259e1700 1 -- 172.21.15.158:0/3834533995 >> v2:172.21.15.96:3300/0 conn(0x7f8820059d60 msgr2=0x7f882005a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2019-12-05T03:49:39.220 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:34.575+0000 7f88259e1700 1 --2- 172.21.15.158:0/3834533995 >> v2:172.21.15.96:3300/0 conn(0x7f8820059d60 0x7f882005a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2019-12-05T03:49:39.221 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:34.575+0000 7f88259e1700 1 --2- 172.21.15.158:0/3834533995 >> v2:172.21.15.96:3300/0 conn(0x7f8820059d60 0x7f882005a190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2019-12-05T03:49:39.221 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:35.379+0000 7f88259e1700 1 --2- 172.21.15.158:0/3834533995 >> v2:172.21.15.96:3300/0 conn(0x7f8820059d60 0x7f882005a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:39.221 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:35.379+0000 7f88259e1700 1 -- 172.21.15.158:0/3834533995 >> v2:172.21.15.96:3300/0 conn(0x7f8820059d60 msgr2=0x7f882005a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2019-12-05T03:49:39.221 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:35.379+0000 7f88259e1700 1 -- 172.21.15.158:0/3834533995 >> v2:172.21.15.96:3300/0 conn(0x7f8820059d60 msgr2=0x7f882005a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2019-12-05T03:49:39.221 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:35.379+0000 7f88259e1700 1 --2- 172.21.15.158:0/3834533995 >> v2:172.21.15.96:3300/0 conn(0x7f8820059d60 0x7f882005a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2019-12-05T03:49:39.221 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:35.379+0000 7f88259e1700 1 --2- 172.21.15.158:0/3834533995 >> v2:172.21.15.96:3300/0 conn(0x7f8820059d60 0x7f882005a190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2019-12-05T03:49:39.221 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:36.983+0000 7f88259e1700 1 --2- 172.21.15.158:0/3834533995 >> v2:172.21.15.96:3300/0 conn(0x7f8820059d60 0x7f882005a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:39.222 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:36.983+0000 7f88259e1700 1 -- 172.21.15.158:0/3834533995 >> v2:172.21.15.96:3300/0 conn(0x7f8820059d60 msgr2=0x7f882005a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2019-12-05T03:49:39.222 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:36.983+0000 7f88259e1700 1 -- 172.21.15.158:0/3834533995 >> v2:172.21.15.96:3300/0 conn(0x7f8820059d60 msgr2=0x7f882005a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2019-12-05T03:49:39.222 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:36.983+0000 7f88259e1700 1 --2- 172.21.15.158:0/3834533995 >> v2:172.21.15.96:3300/0 conn(0x7f8820059d60 0x7f882005a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2019-12-05T03:49:39.222 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:36.983+0000 7f88259e1700 1 --2- 172.21.15.158:0/3834533995 >> v2:172.21.15.96:3300/0 conn(0x7f8820059d60 0x7f882005a190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2019-12-05T03:49:39.222 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.207+0000 7f881ffff700 1 -- 172.21.15.158:0/3834533995 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1187328859 0 0) 0x7f88200993a0 con 0x7f88200b6f10 2019-12-05T03:49:39.222 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.207+0000 7f881ffff700 1 -- 172.21.15.158:0/3834533995 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88080030b0 con 0x7f88200b6f10 2019-12-05T03:49:39.222 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.211+0000 7f881ffff700 1 -- 172.21.15.158:0/3834533995 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 317557361 0 0) 0x7f8820097ea0 con 0x7f88200969b0 2019-12-05T03:49:39.223 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.211+0000 7f881ffff700 1 -- 172.21.15.158:0/3834533995 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88200993a0 con 0x7f88200969b0 2019-12-05T03:49:39.223 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.211+0000 7f881ffff700 1 -- 172.21.15.158:0/3834533995 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3005966660 0 0) 0x7f88200993a0 con 0x7f88200969b0 2019-12-05T03:49:39.223 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.211+0000 7f881ffff700 1 -- 172.21.15.158:0/3834533995 >> v2:172.21.15.96:3300/0 conn(0x7f8820059d60 msgr2=0x7f882005a190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2019-12-05T03:49:39.223 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.211+0000 7f881ffff700 1 --2- 172.21.15.158:0/3834533995 >> v2:172.21.15.96:3300/0 conn(0x7f8820059d60 0x7f882005a190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:49:39.223 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.211+0000 7f881ffff700 1 -- 172.21.15.158:0/3834533995 >> v1:172.21.15.96:6789/0 conn(0x7f88200b6f10 legacy=0x7f88200988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:39.223 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.211+0000 7f881ffff700 1 -- 172.21.15.158:0/3834533995 --> v1:172.21.15.158:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f882007e8b0 con 0x7f88200969b0 2019-12-05T03:49:39.223 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.211+0000 7f881ffff700 1 -- 172.21.15.158:0/3834533995 <== mon.1 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 828730332 0 0) 0x7f8814001730 con 0x7f88200969b0 2019-12-05T03:49:39.224 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.211+0000 7f881ffff700 1 -- 172.21.15.158:0/3834533995 >> v1:172.21.15.158:6789/0 conn(0x7f88200969b0 legacy=0x7f8820059560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:39.224 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.211+0000 7f881ffff700 1 --2- 172.21.15.158:0/3834533995 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8808003990 0x7f8808003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:39.224 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.211+0000 7f881ffff700 1 --2- 172.21.15.158:0/3834533995 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88080044c0 0x7f8808004970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:39.224 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.211+0000 7f881ffff700 1 --2- 172.21.15.158:0/3834533995 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8808004fd0 0x7f880800b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:39.224 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.211+0000 7f881ffff700 1 -- 172.21.15.158:0/3834533995 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8820098220 con 0x7f88080044c0 2019-12-05T03:49:39.224 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.211+0000 7f881ffff700 1 -- 172.21.15.158:0/3834533995 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880800bed0 con 0x7f8808003990 2019-12-05T03:49:39.224 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.211+0000 7f881ffff700 1 -- 172.21.15.158:0/3834533995 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f880800c110 con 0x7f8808004fd0 2019-12-05T03:49:39.225 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.211+0000 7f88251e0700 1 --2- 172.21.15.158:0/3834533995 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8808003990 0x7f8808003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:39.225 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.211+0000 7f88259e1700 1 --2- 172.21.15.158:0/3834533995 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8808004fd0 0x7f880800b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:39.225 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.211+0000 7f88249df700 1 --2- 172.21.15.158:0/3834533995 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88080044c0 0x7f8808004970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:39.229 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.211+0000 7f88251e0700 1 -- 172.21.15.158:0/3834533995 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8808004fd0 msgr2=0x7f880800b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:49:39.229 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.211+0000 7f88251e0700 1 --2- 172.21.15.158:0/3834533995 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8808004fd0 0x7f880800b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:49:39.229 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.211+0000 7f88251e0700 1 -- 172.21.15.158:0/3834533995 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88080044c0 msgr2=0x7f8808004970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:49:39.229 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.211+0000 7f88251e0700 1 --2- 172.21.15.158:0/3834533995 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88080044c0 0x7f8808004970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:49:39.229 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.211+0000 7f88259e1700 1 -- 172.21.15.158:0/3834533995 reap_dead start 2019-12-05T03:49:39.230 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.211+0000 7f88251e0700 1 -- 172.21.15.158:0/3834533995 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880800c410 con 0x7f8808003990 2019-12-05T03:49:39.230 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.211+0000 7f88251e0700 1 --2- 172.21.15.158:0/3834533995 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8808003990 0x7f8808003de0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8818001380 tx=0x7f881800c250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:39.230 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.211+0000 7f88251e0700 1 --2- 172.21.15.158:0/3834533995 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8808003990 0x7f8808003de0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8818001380 tx=0x7f881800c250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:39.230 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.211+0000 7f88251e0700 1 --2- 172.21.15.158:0/3834533995 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8808003990 0x7f8808003de0 secure :-1 s=READY pgs=7 cs=0 l=1 rx=0x7f8818001380 tx=0x7f881800c250).ready entity=mon.1 client_cookie=3a7e879e27fa0e9e server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:39.230 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.211+0000 7f88251e0700 1 --2- 172.21.15.158:0/3834533995 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8808003990 0x7f8808003de0 secure :-1 s=THROTTLE_DONE pgs=7 cs=0 l=1 rx=0x7f8818001380 tx=0x7f881800c250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:39.230 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.211+0000 7f881ffff700 1 -- 172.21.15.158:0/3834533995 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f881800c740 con 0x7f8808003990 2019-12-05T03:49:39.231 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.211+0000 7f88251e0700 1 --2- 172.21.15.158:0/3834533995 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8808003990 0x7f8808003de0 secure :-1 s=THROTTLE_DONE pgs=7 cs=0 l=1 rx=0x7f8818001380 tx=0x7f881800c250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:39.231 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.211+0000 7f88251e0700 1 --2- 172.21.15.158:0/3834533995 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8808003990 0x7f8808003de0 secure :-1 s=THROTTLE_DONE pgs=7 cs=0 l=1 rx=0x7f8818001380 tx=0x7f881800c250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:39.231 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.211+0000 7f881ffff700 1 -- 172.21.15.158:0/3834533995 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8818010c00 con 0x7f8808003990 2019-12-05T03:49:39.231 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.211+0000 7f881ffff700 1 -- 172.21.15.158:0/3834533995 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f881800cd20 con 0x7f8808003990 2019-12-05T03:49:39.231 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.211+0000 7f8826c43700 1 -- 172.21.15.158:0/3834533995 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8808003990 msgr2=0x7f8808003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:39.231 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.211+0000 7f8826c43700 1 --2- 172.21.15.158:0/3834533995 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8808003990 0x7f8808003de0 secure :-1 s=READY pgs=7 cs=0 l=1 rx=0x7f8818001380 tx=0x7f881800c250).stop 2019-12-05T03:49:39.231 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.215+0000 7f8826c43700 1 -- 172.21.15.158:0/3834533995 shutdown_connections 2019-12-05T03:49:39.232 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.215+0000 7f8826c43700 1 --2- 172.21.15.158:0/3834533995 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8808003990 0x7f8808003de0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:39.232 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.215+0000 7f8826c43700 1 -- 172.21.15.158:0/3834533995 shutdown_connections 2019-12-05T03:49:39.232 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.215+0000 7f8826c43700 1 -- 172.21.15.158:0/3834533995 wait complete. 2019-12-05T03:49:39.232 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.215+0000 7f8826c43700 1 -- 172.21.15.158:0/3834533995 >> 172.21.15.158:0/3834533995 conn(0x7f882005e360 msgr2=0x7f88200b7360 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:49:39.232 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.219+0000 7f8826c43700 1 Processor -- start 2019-12-05T03:49:39.232 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.219+0000 7f8826c43700 1 -- start start 2019-12-05T03:49:39.232 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.219+0000 7f8826c43700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f882013e280 0x7f8820065360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:39.233 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.219+0000 7f8826c43700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f88200b4a80 0x7f88200b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:39.233 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.219+0000 7f8826c43700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f882013e800 con 0x7f882013d370 2019-12-05T03:49:39.233 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.219+0000 7f8826c43700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88200b4540 con 0x7f88200b4a80 2019-12-05T03:49:39.233 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.219+0000 7f8826c43700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88200b47e0 con 0x7f882013e280 2019-12-05T03:49:39.233 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.219+0000 7f88251e0700 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f882013d370 0x7f8820064b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.158:42846/0 (socket says 172.21.15.158:42846) 2019-12-05T03:49:39.233 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.219+0000 7f88251e0700 1 -- 172.21.15.158:0/1535322730 learned_addr learned my addr 172.21.15.158:0/1535322730 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:49:39.234 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.219+0000 7f88259e1700 1 --2- 172.21.15.158:0/1535322730 >> v2:172.21.15.158:3300/0 conn(0x7f88200b4a80 0x7f88200b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:39.234 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.223+0000 7f88249df700 1 --2- 172.21.15.158:0/1535322730 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f882013e280 0x7f8820065360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:39.234 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.223+0000 7f88259e1700 1 -- 172.21.15.158:0/1535322730 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f882013e280 msgr2=0x7f8820065360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:39.234 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.223+0000 7f88259e1700 1 --2- 172.21.15.158:0/1535322730 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f882013e280 0x7f8820065360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:39.234 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.223+0000 7f88259e1700 1 -- 172.21.15.158:0/1535322730 >> v1:172.21.15.96:6789/0 conn(0x7f882013d370 legacy=0x7f8820064b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:39.234 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.223+0000 7f88259e1700 1 -- 172.21.15.158:0/1535322730 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8820063900 con 0x7f88200b4a80 2019-12-05T03:49:39.234 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.223+0000 7f88259e1700 1 --2- 172.21.15.158:0/1535322730 >> v2:172.21.15.158:3300/0 conn(0x7f88200b4a80 0x7f88200b4eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8818001490 tx=0x7f8810054880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:39.235 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.223+0000 7f88259e1700 1 --2- 172.21.15.158:0/1535322730 >> v2:172.21.15.158:3300/0 conn(0x7f88200b4a80 0x7f88200b4eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8818001490 tx=0x7f8810054880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:39.235 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.223+0000 7f88259e1700 1 --2- 172.21.15.158:0/1535322730 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f88200b4a80 0x7f88200b4eb0 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7f8818001490 tx=0x7f8810054880).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:39.235 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.223+0000 7f88259e1700 1 --2- 172.21.15.158:0/1535322730 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f88200b4a80 0x7f88200b4eb0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f8818001490 tx=0x7f8810054880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:39.235 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.223+0000 7f88259e1700 1 --2- 172.21.15.158:0/1535322730 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f88200b4a80 0x7f88200b4eb0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f8818001490 tx=0x7f8810054880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:39.235 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.223+0000 7f88259e1700 1 --2- 172.21.15.158:0/1535322730 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f88200b4a80 0x7f88200b4eb0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f8818001490 tx=0x7f8810054880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:39.235 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.223+0000 7f881dffb700 1 -- 172.21.15.158:0/1535322730 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8810005930 con 0x7f88200b4a80 2019-12-05T03:49:39.235 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.223+0000 7f881dffb700 1 -- 172.21.15.158:0/1535322730 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8810007160 con 0x7f88200b4a80 2019-12-05T03:49:39.236 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.223+0000 7f8826c43700 1 -- 172.21.15.158:0/1535322730 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8820061070 con 0x7f88200b4a80 2019-12-05T03:49:39.236 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.223+0000 7f881dffb700 1 -- 172.21.15.158:0/1535322730 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88100060c0 con 0x7f88200b4a80 2019-12-05T03:49:39.236 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.223+0000 7f8826c43700 1 -- 172.21.15.158:0/1535322730 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88200b5620 con 0x7f88200b4a80 2019-12-05T03:49:39.236 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.223+0000 7f88259e1700 1 --2- 172.21.15.158:0/1535322730 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f88200b4a80 0x7f88200b4eb0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f8818001490 tx=0x7f8810054880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:39.236 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.223+0000 7f881dffb700 1 -- 172.21.15.158:0/1535322730 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 1) v1 ==== 349+0+0 (secure 0 0 0) 0x7f8810009520 con 0x7f88200b4a80 2019-12-05T03:49:39.236 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.223+0000 7f88259e1700 1 --2- 172.21.15.158:0/1535322730 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f88200b4a80 0x7f88200b4eb0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f8818001490 tx=0x7f8810054880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:39.236 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.223+0000 7f881dffb700 1 -- 172.21.15.158:0/1535322730 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f8810009830 con 0x7f88200b4a80 2019-12-05T03:49:39.244 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.243+0000 7f8826c43700 1 -- 172.21.15.158:0/1535322730 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88200554d0 con 0x7f88200b4a80 2019-12-05T03:49:39.248 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.247+0000 7f88259e1700 1 --2- 172.21.15.158:0/1535322730 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f88200b4a80 0x7f88200b4eb0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f8818001490 tx=0x7f8810054880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:39.248 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.247+0000 7f881dffb700 1 -- 172.21.15.158:0/1535322730 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66539 (secure 0 0 0) 0x7f88100069a0 con 0x7f88200b4a80 2019-12-05T03:49:39.362 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.359+0000 7f8826c43700 1 -- 172.21.15.158:0/1535322730 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"profile": "default", "prefix": "osd crush tunables"} v 0) v1 -- 0x7f88200b3ce0 con 0x7f88200b4a80 2019-12-05T03:49:39.369 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.367+0000 7f88259e1700 1 --2- 172.21.15.158:0/1535322730 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f88200b4a80 0x7f88200b4eb0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f8818001490 tx=0x7f8810054880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:39.369 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.367+0000 7f881dffb700 1 -- 172.21.15.158:0/1535322730 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"profile": "default", "prefix": "osd crush tunables"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f8810006bc0 con 0x7f88200b4a80 2019-12-05T03:49:39.369 INFO:teuthology.orchestra.run.smithi158.stderr:adjusted tunables profile to default 2019-12-05T03:49:39.371 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.367+0000 7f8826c43700 1 -- 172.21.15.158:0/1535322730 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f88200b4a80 msgr2=0x7f88200b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:39.371 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.367+0000 7f8826c43700 1 --2- 172.21.15.158:0/1535322730 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f88200b4a80 0x7f88200b4eb0 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7f8818001490 tx=0x7f8810054880).stop 2019-12-05T03:49:39.371 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.367+0000 7f8826c43700 1 -- 172.21.15.158:0/1535322730 shutdown_connections 2019-12-05T03:49:39.372 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.367+0000 7f8826c43700 1 --2- 172.21.15.158:0/1535322730 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f88200b4a80 0x7f88200b4eb0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:39.372 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.367+0000 7f8826c43700 1 --2- 172.21.15.158:0/1535322730 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f882013e280 0x7f8820065360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:39.372 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.367+0000 7f8826c43700 1 -- 172.21.15.158:0/1535322730 shutdown_connections 2019-12-05T03:49:39.372 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.367+0000 7f8826c43700 1 -- 172.21.15.158:0/1535322730 wait complete. 2019-12-05T03:49:39.372 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:39.367+0000 7f8826c43700 1 -- 172.21.15.158:0/1535322730 >> 172.21.15.158:0/1535322730 conn(0x7f88200984c0 msgr2=0x7f8820132660 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:49:39.381 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2019-12-05T03:49:39.382 INFO:teuthology.orchestra.run.smithi158:> mktemp 2019-12-05T03:49:39.387 INFO:teuthology.orchestra.run.smithi158.stdout:/tmp/tmp.BGfMwXuskB 2019-12-05T03:49:39.388 INFO:teuthology.orchestra.run.smithi158:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.BGfMwXuskB 2019-12-05T03:49:39.468 INFO:teuthology.orchestra.run.smithi158:> sudo chmod 0666 /tmp/tmp.BGfMwXuskB 2019-12-05T03:49:39.619 DEBUG:teuthology.orchestra.remote:smithi158:/tmp/tmp.BGfMwXuskB is 37B 2019-12-05T03:49:39.630 INFO:teuthology.orchestra.run.smithi158:> rm -fr /tmp/tmp.BGfMwXuskB 2019-12-05T03:49:39.637 INFO:teuthology.orchestra.run.smithi158:> mktemp 2019-12-05T03:49:39.707 INFO:teuthology.orchestra.run.smithi158.stdout:/tmp/tmp.Chbc595dpl 2019-12-05T03:49:39.707 INFO:teuthology.orchestra.run.smithi158:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.Chbc595dpl 2019-12-05T03:49:39.787 INFO:teuthology.orchestra.run.smithi158:> sudo chmod 0666 /tmp/tmp.Chbc595dpl 2019-12-05T03:49:39.937 DEBUG:teuthology.orchestra.remote:smithi158:/tmp/tmp.Chbc595dpl is 37B 2019-12-05T03:49:39.947 INFO:teuthology.orchestra.run.smithi158:> rm -fr /tmp/tmp.Chbc595dpl 2019-12-05T03:49:39.954 INFO:teuthology.orchestra.run.smithi158:> mktemp 2019-12-05T03:49:40.024 INFO:teuthology.orchestra.run.smithi158.stdout:/tmp/tmp.DwRqkczUdm 2019-12-05T03:49:40.024 INFO:teuthology.orchestra.run.smithi158:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.DwRqkczUdm 2019-12-05T03:49:40.104 INFO:teuthology.orchestra.run.smithi158:> sudo chmod 0666 /tmp/tmp.DwRqkczUdm 2019-12-05T03:49:40.254 DEBUG:teuthology.orchestra.remote:smithi158:/tmp/tmp.DwRqkczUdm is 37B 2019-12-05T03:49:40.267 INFO:teuthology.orchestra.run.smithi158:> rm -fr /tmp/tmp.DwRqkczUdm 2019-12-05T03:49:40.274 INFO:teuthology.orchestra.run.smithi158:> mktemp 2019-12-05T03:49:40.344 INFO:teuthology.orchestra.run.smithi158.stdout:/tmp/tmp.uiRaSEoI2t 2019-12-05T03:49:40.344 INFO:teuthology.orchestra.run.smithi158:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.uiRaSEoI2t 2019-12-05T03:49:40.424 INFO:teuthology.orchestra.run.smithi158:> sudo chmod 0666 /tmp/tmp.uiRaSEoI2t 2019-12-05T03:49:40.576 DEBUG:teuthology.orchestra.remote:smithi158:/tmp/tmp.uiRaSEoI2t is 37B 2019-12-05T03:49:40.586 INFO:teuthology.orchestra.run.smithi158:> rm -fr /tmp/tmp.uiRaSEoI2t 2019-12-05T03:49:40.593 INFO:teuthology.orchestra.run.smithi096:> mktemp 2019-12-05T03:49:40.600 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.hWBwetc4zW 2019-12-05T03:49:40.601 INFO:teuthology.orchestra.run.smithi096:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.hWBwetc4zW 2019-12-05T03:49:40.680 INFO:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.hWBwetc4zW 2019-12-05T03:49:40.830 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.hWBwetc4zW is 37B 2019-12-05T03:49:40.879 INFO:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.hWBwetc4zW 2019-12-05T03:49:40.885 INFO:teuthology.orchestra.run.smithi096:> mktemp 2019-12-05T03:49:40.956 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.NFGKLDltAl 2019-12-05T03:49:40.957 INFO:teuthology.orchestra.run.smithi096:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.NFGKLDltAl 2019-12-05T03:49:41.037 INFO:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.NFGKLDltAl 2019-12-05T03:49:41.187 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.NFGKLDltAl is 37B 2019-12-05T03:49:41.197 INFO:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.NFGKLDltAl 2019-12-05T03:49:41.204 INFO:teuthology.orchestra.run.smithi096:> mktemp 2019-12-05T03:49:41.274 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.4M008uOwxZ 2019-12-05T03:49:41.274 INFO:teuthology.orchestra.run.smithi096:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.4M008uOwxZ 2019-12-05T03:49:41.355 INFO:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.4M008uOwxZ 2019-12-05T03:49:41.503 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.4M008uOwxZ is 37B 2019-12-05T03:49:41.551 INFO:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.4M008uOwxZ 2019-12-05T03:49:41.559 INFO:teuthology.orchestra.run.smithi096:> mktemp 2019-12-05T03:49:41.631 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.0NJOuzbN1e 2019-12-05T03:49:41.631 INFO:teuthology.orchestra.run.smithi096:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.0NJOuzbN1e 2019-12-05T03:49:41.711 INFO:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.0NJOuzbN1e 2019-12-05T03:49:41.863 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.0NJOuzbN1e is 37B 2019-12-05T03:49:41.874 INFO:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.0NJOuzbN1e 2019-12-05T03:49:41.882 INFO:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd new 782c4258-e28c-4a11-9d54-3c9c7a36fba6 0 2019-12-05T03:49:42.066 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.057+0000 7fbe1a870700 1 Processor -- start 2019-12-05T03:49:42.066 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.057+0000 7fbe1a870700 1 -- start start 2019-12-05T03:49:42.067 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.061+0000 7fbe1a870700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fbe140b6f20 0x7fbe140988e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:42.067 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.061+0000 7fbe1a870700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbe14098e30 0x7fbe141550d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:42.067 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.061+0000 7fbe1a870700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe14155e20 con 0x7fbe140969c0 2019-12-05T03:49:42.067 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.061+0000 7fbe1a870700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe14098230 con 0x7fbe140b6f20 2019-12-05T03:49:42.067 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.061+0000 7fbe1a870700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe140993b0 con 0x7fbe14098e30 2019-12-05T03:49:42.067 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.061+0000 7fbe13fff700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbe14098e30 0x7fbe141550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:42.068 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.061+0000 7fbe1960e700 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fbe140969c0 0x7fbe14155620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:51064/0 (socket says 172.21.15.96:51064) 2019-12-05T03:49:42.068 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.061+0000 7fbe1960e700 1 -- 172.21.15.96:0/2363594881 learned_addr learned my addr 172.21.15.96:0/2363594881 (peer_addr_for_me v1:172.21.15.96:0/0) 2019-12-05T03:49:42.068 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.061+0000 7fbe13fff700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbe14098e30 0x7fbe141550d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:37572/0 (socket says 172.21.15.96:37572) 2019-12-05T03:49:42.068 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.061+0000 7fbe18e0d700 1 --2- 172.21.15.96:0/2363594881 >> v2:172.21.15.158:3300/0 conn(0x7fbe140b6f20 0x7fbe140988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:42.072 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.061+0000 7fbe137fe700 1 -- 172.21.15.96:0/2363594881 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 82757410 0 0) 0x7fbe14155e20 con 0x7fbe140969c0 2019-12-05T03:49:42.072 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.061+0000 7fbe13fff700 1 -- 172.21.15.96:0/2363594881 >> v2:172.21.15.158:3300/0 conn(0x7fbe140b6f20 msgr2=0x7fbe140988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:49:42.072 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.061+0000 7fbe13fff700 1 --2- 172.21.15.96:0/2363594881 >> v2:172.21.15.158:3300/0 conn(0x7fbe140b6f20 0x7fbe140988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:49:42.072 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.061+0000 7fbe13fff700 1 -- 172.21.15.96:0/2363594881 >> v1:172.21.15.96:6789/0 conn(0x7fbe140969c0 legacy=0x7fbe14155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:42.073 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.061+0000 7fbe13fff700 1 -- 172.21.15.96:0/2363594881 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe14097eb0 con 0x7fbe14098e30 2019-12-05T03:49:42.073 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.061+0000 7fbe13fff700 1 --2- 172.21.15.96:0/2363594881 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbe14098e30 0x7fbe141550d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbe08008790 tx=0x7fbe0800fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.073 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.061+0000 7fbe13fff700 1 --2- 172.21.15.96:0/2363594881 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbe14098e30 0x7fbe141550d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbe08008790 tx=0x7fbe0800fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.073 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.061+0000 7fbe13fff700 1 --2- 172.21.15.96:0/2363594881 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbe14098e30 0x7fbe141550d0 secure :-1 s=READY pgs=7 cs=0 l=1 rx=0x7fbe08008790 tx=0x7fbe0800fc70).ready entity=mon.2 client_cookie=895f5a3b00be9e82 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:42.073 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.061+0000 7fbe13fff700 1 --2- 172.21.15.96:0/2363594881 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbe14098e30 0x7fbe141550d0 secure :-1 s=THROTTLE_DONE pgs=7 cs=0 l=1 rx=0x7fbe08008790 tx=0x7fbe0800fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.073 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.061+0000 7fbe137fe700 1 -- 172.21.15.96:0/2363594881 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe080112b0 con 0x7fbe14098e30 2019-12-05T03:49:42.074 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.061+0000 7fbe13fff700 1 --2- 172.21.15.96:0/2363594881 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbe14098e30 0x7fbe141550d0 secure :-1 s=THROTTLE_DONE pgs=7 cs=0 l=1 rx=0x7fbe08008790 tx=0x7fbe0800fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.074 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.061+0000 7fbe13fff700 1 --2- 172.21.15.96:0/2363594881 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbe14098e30 0x7fbe141550d0 secure :-1 s=THROTTLE_DONE pgs=7 cs=0 l=1 rx=0x7fbe08008790 tx=0x7fbe0800fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.074 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.061+0000 7fbe137fe700 1 -- 172.21.15.96:0/2363594881 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe08008ad0 con 0x7fbe14098e30 2019-12-05T03:49:42.074 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.061+0000 7fbe137fe700 1 -- 172.21.15.96:0/2363594881 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe08011890 con 0x7fbe14098e30 2019-12-05T03:49:42.075 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.061+0000 7fbe1a870700 1 -- 172.21.15.96:0/2363594881 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbe14098e30 msgr2=0x7fbe141550d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:42.075 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.061+0000 7fbe1a870700 1 --2- 172.21.15.96:0/2363594881 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbe14098e30 0x7fbe141550d0 secure :-1 s=READY pgs=7 cs=0 l=1 rx=0x7fbe08008790 tx=0x7fbe0800fc70).stop 2019-12-05T03:49:42.075 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.061+0000 7fbe1a870700 1 -- 172.21.15.96:0/2363594881 shutdown_connections 2019-12-05T03:49:42.075 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.061+0000 7fbe1a870700 1 --2- 172.21.15.96:0/2363594881 >> v2:172.21.15.158:3300/0 conn(0x7fbe140b6f20 0x7fbe140988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:49:42.075 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.061+0000 7fbe1a870700 1 --2- 172.21.15.96:0/2363594881 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbe14098e30 0x7fbe141550d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:42.076 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.061+0000 7fbe1a870700 1 -- 172.21.15.96:0/2363594881 shutdown_connections 2019-12-05T03:49:42.076 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.061+0000 7fbe1a870700 1 -- 172.21.15.96:0/2363594881 wait complete. 2019-12-05T03:49:42.076 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.061+0000 7fbe1a870700 1 -- 172.21.15.96:0/2363594881 >> 172.21.15.96:0/2363594881 conn(0x7fbe1405e370 msgr2=0x7fbe140b7370 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:49:42.076 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.065+0000 7fbe1a870700 1 Processor -- start 2019-12-05T03:49:42.076 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.065+0000 7fbe1a870700 1 -- start start 2019-12-05T03:49:42.081 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.069+0000 7fbe1a870700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbe140b66a0 0x7fbe1409bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:42.081 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.069+0000 7fbe1a870700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fbe1413c970 0x7fbe141400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:42.081 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.069+0000 7fbe1a870700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe1407ad40 con 0x7fbe140650b0 2019-12-05T03:49:42.081 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.069+0000 7fbe1a870700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe140b4b00 con 0x7fbe1413c970 2019-12-05T03:49:42.081 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.069+0000 7fbe1a870700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe140b4da0 con 0x7fbe140b66a0 2019-12-05T03:49:42.082 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.069+0000 7fbe18e0d700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbe140b66a0 0x7fbe1409bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:42.082 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.069+0000 7fbe18e0d700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbe140b66a0 0x7fbe1409bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:37576/0 (socket says 172.21.15.96:37576) 2019-12-05T03:49:42.082 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.069+0000 7fbe18e0d700 1 -- 172.21.15.96:0/2186270877 learned_addr learned my addr 172.21.15.96:0/2186270877 (peer_addr_for_me v2:172.21.15.96:0/0) 2019-12-05T03:49:42.082 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.069+0000 7fbe1960e700 1 --2- 172.21.15.96:0/2186270877 >> v2:172.21.15.158:3300/0 conn(0x7fbe1413c970 0x7fbe141400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:42.082 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.069+0000 7fbe18e0d700 1 -- 172.21.15.96:0/2186270877 >> v2:172.21.15.158:3300/0 conn(0x7fbe1413c970 msgr2=0x7fbe141400b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:42.082 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.069+0000 7fbe18e0d700 1 --2- 172.21.15.96:0/2186270877 >> v2:172.21.15.158:3300/0 conn(0x7fbe1413c970 0x7fbe141400b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:42.083 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.069+0000 7fbe18e0d700 1 -- 172.21.15.96:0/2186270877 >> v1:172.21.15.158:6789/0 conn(0x7fbe140650b0 legacy=0x7fbe1407a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:42.083 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.069+0000 7fbe18e0d700 1 -- 172.21.15.96:0/2186270877 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe140654e0 con 0x7fbe140b66a0 2019-12-05T03:49:42.083 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.069+0000 7fbe18e0d700 1 --2- 172.21.15.96:0/2186270877 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbe140b66a0 0x7fbe1409bc50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbe040075a0 tx=0x7fbe040109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.083 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.069+0000 7fbe18e0d700 1 --2- 172.21.15.96:0/2186270877 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbe140b66a0 0x7fbe1409bc50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbe040075a0 tx=0x7fbe040109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.083 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.069+0000 7fbe18e0d700 1 --2- 172.21.15.96:0/2186270877 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbe140b66a0 0x7fbe1409bc50 secure :-1 s=READY pgs=8 cs=0 l=1 rx=0x7fbe040075a0 tx=0x7fbe040109f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:42.083 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.069+0000 7fbe18e0d700 1 --2- 172.21.15.96:0/2186270877 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbe140b66a0 0x7fbe1409bc50 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7fbe040075a0 tx=0x7fbe040109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.083 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.069+0000 7fbe117fa700 1 -- 172.21.15.96:0/2186270877 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe04005930 con 0x7fbe140b66a0 2019-12-05T03:49:42.084 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.069+0000 7fbe18e0d700 1 --2- 172.21.15.96:0/2186270877 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbe140b66a0 0x7fbe1409bc50 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7fbe040075a0 tx=0x7fbe040109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.084 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.069+0000 7fbe18e0d700 1 --2- 172.21.15.96:0/2186270877 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbe140b66a0 0x7fbe1409bc50 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7fbe040075a0 tx=0x7fbe040109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.084 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.069+0000 7fbe117fa700 1 -- 172.21.15.96:0/2186270877 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe04007160 con 0x7fbe140b66a0 2019-12-05T03:49:42.084 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.069+0000 7fbe1a870700 1 -- 172.21.15.96:0/2186270877 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe1413cda0 con 0x7fbe140b66a0 2019-12-05T03:49:42.084 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.069+0000 7fbe117fa700 1 -- 172.21.15.96:0/2186270877 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe040060c0 con 0x7fbe140b66a0 2019-12-05T03:49:42.084 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.069+0000 7fbe1a870700 1 -- 172.21.15.96:0/2186270877 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe14140600 con 0x7fbe140b66a0 2019-12-05T03:49:42.085 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.069+0000 7fbe18e0d700 1 --2- 172.21.15.96:0/2186270877 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbe140b66a0 0x7fbe1409bc50 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7fbe040075a0 tx=0x7fbe040109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.085 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.069+0000 7fbe18e0d700 1 --2- 172.21.15.96:0/2186270877 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbe140b66a0 0x7fbe1409bc50 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7fbe040075a0 tx=0x7fbe040109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.085 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.069+0000 7fbe117fa700 1 -- 172.21.15.96:0/2186270877 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 2) v1 ==== 22500+0+0 (secure 0 0 0) 0x7fbe04007a20 con 0x7fbe140b66a0 2019-12-05T03:49:42.085 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.069+0000 7fbe117fa700 1 -- 172.21.15.96:0/2186270877 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7fbe04029a50 con 0x7fbe140b66a0 2019-12-05T03:49:42.085 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.077+0000 7fbe1a870700 1 -- 172.21.15.96:0/2186270877 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe140b4900 con 0x7fbe140b66a0 2019-12-05T03:49:42.085 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.081+0000 7fbe18e0d700 1 --2- 172.21.15.96:0/2186270877 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbe140b66a0 0x7fbe1409bc50 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7fbe040075a0 tx=0x7fbe040109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.085 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.081+0000 7fbe117fa700 1 -- 172.21.15.96:0/2186270877 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66539 (secure 0 0 0) 0x7fbe04012d80 con 0x7fbe140b66a0 2019-12-05T03:49:42.190 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.189+0000 7fbe1a870700 1 -- 172.21.15.96:0/2186270877 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd new", "uuid": "782c4258-e28c-4a11-9d54-3c9c7a36fba6", "id": 0} v 0) v1 -- 0x7fbe140554e0 con 0x7fbe140b66a0 2019-12-05T03:49:42.198 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.197+0000 7fbe18e0d700 1 --2- 172.21.15.96:0/2186270877 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbe140b66a0 0x7fbe1409bc50 secure :-1 s=THROTTLE_DONE pgs=8 cs=0 l=1 rx=0x7fbe040075a0 tx=0x7fbe040109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.198 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.197+0000 7fbe117fa700 1 -- 172.21.15.96:0/2186270877 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "782c4258-e28c-4a11-9d54-3c9c7a36fba6", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbe04009190 con 0x7fbe140b66a0 2019-12-05T03:49:42.205 INFO:teuthology.orchestra.run.smithi096.stdout:0 2019-12-05T03:49:42.208 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.205+0000 7fbe1a870700 1 -- 172.21.15.96:0/2186270877 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbe140b66a0 msgr2=0x7fbe1409bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:42.208 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.205+0000 7fbe1a870700 1 --2- 172.21.15.96:0/2186270877 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbe140b66a0 0x7fbe1409bc50 secure :-1 s=READY pgs=8 cs=0 l=1 rx=0x7fbe040075a0 tx=0x7fbe040109f0).stop 2019-12-05T03:49:42.208 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.209+0000 7fbe1a870700 1 -- 172.21.15.96:0/2186270877 shutdown_connections 2019-12-05T03:49:42.208 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.209+0000 7fbe1a870700 1 --2- 172.21.15.96:0/2186270877 >> v2:172.21.15.158:3300/0 conn(0x7fbe1413c970 0x7fbe141400b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:42.208 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.209+0000 7fbe1a870700 1 --2- 172.21.15.96:0/2186270877 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbe140b66a0 0x7fbe1409bc50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:42.209 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.209+0000 7fbe1a870700 1 -- 172.21.15.96:0/2186270877 shutdown_connections 2019-12-05T03:49:42.209 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.209+0000 7fbe1a870700 1 -- 172.21.15.96:0/2186270877 wait complete. 2019-12-05T03:49:42.209 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.209+0000 7fbe1a870700 1 -- 172.21.15.96:0/2186270877 >> 172.21.15.96:0/2186270877 conn(0x7fbe140969c0 msgr2=0x7fbe1407d800 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:49:42.219 INFO:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd new d4426b21-b666-4158-bf34-a24b14572731 1 2019-12-05T03:49:42.309 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.301+0000 7f8d0290c700 1 Processor -- start 2019-12-05T03:49:42.309 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.301+0000 7f8d0290c700 1 -- start start 2019-12-05T03:49:42.309 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.305+0000 7f8d0290c700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8cfc0b6f20 0x7f8cfc0988e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:42.310 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.305+0000 7f8d0290c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f8cfc0969c0 0x7f8cfc05a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:42.310 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.305+0000 7f8d0290c700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cfc0993b0 con 0x7f8cfc098e30 2019-12-05T03:49:42.310 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.305+0000 7f8d0290c700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cfc098230 con 0x7f8cfc0969c0 2019-12-05T03:49:42.310 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.305+0000 7f8d0290c700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc097eb0 con 0x7f8cfc0b6f20 2019-12-05T03:49:42.310 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.305+0000 7f8d00ea9700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8cfc0b6f20 0x7f8cfc0988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:42.310 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.305+0000 7f8d00ea9700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8cfc0b6f20 0x7f8cfc0988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:37580/0 (socket says 172.21.15.96:37580) 2019-12-05T03:49:42.311 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.305+0000 7f8d00ea9700 1 -- 172.21.15.96:0/2083562072 learned_addr learned my addr 172.21.15.96:0/2083562072 (peer_addr_for_me v2:172.21.15.96:0/0) 2019-12-05T03:49:42.311 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.305+0000 7f8d016aa700 1 --2- 172.21.15.96:0/2083562072 >> v2:172.21.15.158:3300/0 conn(0x7f8cfc0969c0 0x7f8cfc05a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:42.311 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.305+0000 7f8d00ea9700 1 -- 172.21.15.96:0/2083562072 >> v2:172.21.15.158:3300/0 conn(0x7f8cfc0969c0 msgr2=0x7f8cfc05a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:49:42.311 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.305+0000 7f8d00ea9700 1 --2- 172.21.15.96:0/2083562072 >> v2:172.21.15.158:3300/0 conn(0x7f8cfc0969c0 0x7f8cfc05a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:49:42.311 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.305+0000 7f8d00ea9700 1 -- 172.21.15.96:0/2083562072 >> v1:172.21.15.158:6789/0 conn(0x7f8cfc098e30 legacy=0x7f8cfc1550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:42.312 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.305+0000 7f8d00ea9700 1 -- 172.21.15.96:0/2083562072 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cfc07e8c0 con 0x7f8cfc0b6f20 2019-12-05T03:49:42.312 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.305+0000 7f8d00ea9700 1 --2- 172.21.15.96:0/2083562072 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8cfc0b6f20 0x7f8cfc0988e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8cfc0b6cd0 tx=0x7f8cec0100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.312 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.305+0000 7f8d00ea9700 1 --2- 172.21.15.96:0/2083562072 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8cfc0b6f20 0x7f8cfc0988e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8cfc0b6cd0 tx=0x7f8cec0100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.312 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.305+0000 7f8d00ea9700 1 --2- 172.21.15.96:0/2083562072 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8cfc0b6f20 0x7f8cfc0988e0 secure :-1 s=READY pgs=9 cs=0 l=1 rx=0x7f8cfc0b6cd0 tx=0x7f8cec0100b0).ready entity=mon.2 client_cookie=583b8cbafa3bc028 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:42.312 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.305+0000 7f8d00ea9700 1 --2- 172.21.15.96:0/2083562072 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8cfc0b6f20 0x7f8cfc0988e0 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7f8cfc0b6cd0 tx=0x7f8cec0100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.312 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.305+0000 7f8cfb7fe700 1 -- 172.21.15.96:0/2083562072 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cec00a160 con 0x7f8cfc0b6f20 2019-12-05T03:49:42.313 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.305+0000 7f8d00ea9700 1 --2- 172.21.15.96:0/2083562072 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8cfc0b6f20 0x7f8cfc0988e0 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7f8cfc0b6cd0 tx=0x7f8cec0100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.313 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.305+0000 7f8cfb7fe700 1 -- 172.21.15.96:0/2083562072 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cec011a30 con 0x7f8cfc0b6f20 2019-12-05T03:49:42.313 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.305+0000 7f8d0290c700 1 -- 172.21.15.96:0/2083562072 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8cfc0b6f20 msgr2=0x7f8cfc0988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:42.313 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.305+0000 7f8d00ea9700 1 --2- 172.21.15.96:0/2083562072 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8cfc0b6f20 0x7f8cfc0988e0 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7f8cfc0b6cd0 tx=0x7f8cec0100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.313 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.305+0000 7f8cfb7fe700 1 -- 172.21.15.96:0/2083562072 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cec00a550 con 0x7f8cfc0b6f20 2019-12-05T03:49:42.314 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.305+0000 7f8d0290c700 1 --2- 172.21.15.96:0/2083562072 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8cfc0b6f20 0x7f8cfc0988e0 secure :-1 s=READY pgs=9 cs=0 l=1 rx=0x7f8cfc0b6cd0 tx=0x7f8cec0100b0).stop 2019-12-05T03:49:42.314 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.305+0000 7f8d0290c700 1 -- 172.21.15.96:0/2083562072 shutdown_connections 2019-12-05T03:49:42.314 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.305+0000 7f8d0290c700 1 --2- 172.21.15.96:0/2083562072 >> v2:172.21.15.158:3300/0 conn(0x7f8cfc0969c0 0x7f8cfc05a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:49:42.314 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.305+0000 7f8d0290c700 1 --2- 172.21.15.96:0/2083562072 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8cfc0b6f20 0x7f8cfc0988e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:42.314 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.305+0000 7f8d0290c700 1 -- 172.21.15.96:0/2083562072 shutdown_connections 2019-12-05T03:49:42.314 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.305+0000 7f8d0290c700 1 -- 172.21.15.96:0/2083562072 wait complete. 2019-12-05T03:49:42.315 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.305+0000 7f8d0290c700 1 -- 172.21.15.96:0/2083562072 >> 172.21.15.96:0/2083562072 conn(0x7f8cfc05e370 msgr2=0x7f8cfc0b7370 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:49:42.315 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.309+0000 7f8d0290c700 1 Processor -- start 2019-12-05T03:49:42.315 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.309+0000 7f8d0290c700 1 -- start start 2019-12-05T03:49:42.319 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.309+0000 7f8d0290c700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8cfc1305a0 0x7f8cfc05fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:42.319 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.309+0000 7f8d0290c700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8cfc060360 0x7f8cfc143950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:42.319 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.309+0000 7f8d0290c700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cfc07d7e0 con 0x7f8cfc140390 2019-12-05T03:49:42.319 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.309+0000 7f8d0290c700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cfc132710 con 0x7f8cfc060360 2019-12-05T03:49:42.320 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.309+0000 7f8d0290c700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc132470 con 0x7f8cfc1305a0 2019-12-05T03:49:42.320 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.309+0000 7f8cfbfff700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8cfc1305a0 0x7f8cfc05fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:42.320 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.309+0000 7f8cfbfff700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8cfc1305a0 0x7f8cfc05fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:37586/0 (socket says 172.21.15.96:37586) 2019-12-05T03:49:42.320 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.309+0000 7f8d016aa700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8cfc060360 0x7f8cfc143950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:42.320 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.309+0000 7f8cfbfff700 1 -- 172.21.15.96:0/988046615 learned_addr learned my addr 172.21.15.96:0/988046615 (peer_addr_for_me v2:172.21.15.96:0/0) 2019-12-05T03:49:42.320 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.313+0000 7f8cf97fa700 1 -- 172.21.15.96:0/988046615 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1212418219 0 0) 0x7f8cfc07d7e0 con 0x7f8cfc140390 2019-12-05T03:49:42.321 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.313+0000 7f8cfbfff700 1 -- 172.21.15.96:0/988046615 >> v2:172.21.15.96:3300/0 conn(0x7f8cfc060360 msgr2=0x7f8cfc143950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:42.321 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.313+0000 7f8cfbfff700 1 --2- 172.21.15.96:0/988046615 >> v2:172.21.15.96:3300/0 conn(0x7f8cfc060360 0x7f8cfc143950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:42.321 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.313+0000 7f8cfbfff700 1 -- 172.21.15.96:0/988046615 >> v1:172.21.15.158:6789/0 conn(0x7f8cfc140390 legacy=0x7f8cfc07cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:42.321 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.313+0000 7f8cfbfff700 1 -- 172.21.15.96:0/988046615 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cfc1351f0 con 0x7f8cfc1305a0 2019-12-05T03:49:42.321 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.313+0000 7f8d016aa700 1 --2- 172.21.15.96:0/988046615 >> v2:172.21.15.96:3300/0 conn(0x7f8cfc060360 0x7f8cfc143950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:49:42.322 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.313+0000 7f8cfbfff700 1 --2- 172.21.15.96:0/988046615 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8cfc1305a0 0x7f8cfc05fa80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8ce4000e90 tx=0x7f8ce40109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.322 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.313+0000 7f8cfbfff700 1 --2- 172.21.15.96:0/988046615 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8cfc1305a0 0x7f8cfc05fa80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8ce4000e90 tx=0x7f8ce40109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.322 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.313+0000 7f8cfbfff700 1 --2- 172.21.15.96:0/988046615 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8cfc1305a0 0x7f8cfc05fa80 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7f8ce4000e90 tx=0x7f8ce40109a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:42.322 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.313+0000 7f8cfbfff700 1 --2- 172.21.15.96:0/988046615 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8cfc1305a0 0x7f8cfc05fa80 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f8ce4000e90 tx=0x7f8ce40109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.322 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.313+0000 7f8cf97fa700 1 -- 172.21.15.96:0/988046615 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ce400caa0 con 0x7f8cfc1305a0 2019-12-05T03:49:42.322 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.313+0000 7f8cfbfff700 1 --2- 172.21.15.96:0/988046615 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8cfc1305a0 0x7f8cfc05fa80 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f8ce4000e90 tx=0x7f8ce40109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.323 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.313+0000 7f8cf97fa700 1 -- 172.21.15.96:0/988046615 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce400c6c0 con 0x7f8cfc1305a0 2019-12-05T03:49:42.323 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.313+0000 7f8cfbfff700 1 --2- 172.21.15.96:0/988046615 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8cfc1305a0 0x7f8cfc05fa80 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f8ce4000e90 tx=0x7f8ce40109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.323 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.313+0000 7f8d0290c700 1 -- 172.21.15.96:0/988046615 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cfc143ea0 con 0x7f8cfc1305a0 2019-12-05T03:49:42.323 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.313+0000 7f8cf97fa700 1 -- 172.21.15.96:0/988046615 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ce4012210 con 0x7f8cfc1305a0 2019-12-05T03:49:42.323 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.313+0000 7f8d0290c700 1 -- 172.21.15.96:0/988046615 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cfc1443f0 con 0x7f8cfc1305a0 2019-12-05T03:49:42.323 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.313+0000 7f8cfbfff700 1 --2- 172.21.15.96:0/988046615 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8cfc1305a0 0x7f8cfc05fa80 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f8ce4000e90 tx=0x7f8ce40109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.323 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.313+0000 7f8cf97fa700 1 -- 172.21.15.96:0/988046615 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 2) v1 ==== 22500+0+0 (secure 0 0 0) 0x7f8ce40124f0 con 0x7f8cfc1305a0 2019-12-05T03:49:42.324 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.313+0000 7f8cfbfff700 1 --2- 172.21.15.96:0/988046615 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8cfc1305a0 0x7f8cfc05fa80 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f8ce4000e90 tx=0x7f8ce40109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.324 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.313+0000 7f8cf97fa700 1 -- 172.21.15.96:0/988046615 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7f8ce402a180 con 0x7f8cfc1305a0 2019-12-05T03:49:42.324 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.317+0000 7f8d0290c700 1 -- 172.21.15.96:0/988046615 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cfc0554e0 con 0x7f8cfc1305a0 2019-12-05T03:49:42.325 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.321+0000 7f8cfbfff700 1 --2- 172.21.15.96:0/988046615 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8cfc1305a0 0x7f8cfc05fa80 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f8ce4000e90 tx=0x7f8ce40109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.325 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.321+0000 7f8cf97fa700 1 -- 172.21.15.96:0/988046615 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66539 (secure 0 0 0) 0x7f8ce4012cd0 con 0x7f8cfc1305a0 2019-12-05T03:49:42.429 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.429+0000 7f8d0290c700 1 -- 172.21.15.96:0/988046615 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d4426b21-b666-4158-bf34-a24b14572731", "id": 1} v 0) v1 -- 0x7f8cfc066940 con 0x7f8cfc1305a0 2019-12-05T03:49:42.436 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.437+0000 7f8cfbfff700 1 --2- 172.21.15.96:0/988046615 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8cfc1305a0 0x7f8cfc05fa80 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f8ce4000e90 tx=0x7f8ce40109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.437 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.437+0000 7f8cf97fa700 1 -- 172.21.15.96:0/988046615 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d4426b21-b666-4158-bf34-a24b14572731", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8ce4012800 con 0x7f8cfc1305a0 2019-12-05T03:49:42.450 INFO:teuthology.orchestra.run.smithi096.stdout:1 2019-12-05T03:49:42.450 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.445+0000 7f8d0290c700 1 -- 172.21.15.96:0/988046615 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8cfc1305a0 msgr2=0x7f8cfc05fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:42.451 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.445+0000 7f8d0290c700 1 --2- 172.21.15.96:0/988046615 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8cfc1305a0 0x7f8cfc05fa80 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7f8ce4000e90 tx=0x7f8ce40109a0).stop 2019-12-05T03:49:42.451 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.445+0000 7f8d0290c700 1 -- 172.21.15.96:0/988046615 shutdown_connections 2019-12-05T03:49:42.451 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.445+0000 7f8d0290c700 1 --2- 172.21.15.96:0/988046615 >> v2:172.21.15.96:3300/0 conn(0x7f8cfc060360 0x7f8cfc143950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:42.452 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.445+0000 7f8d0290c700 1 --2- 172.21.15.96:0/988046615 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8cfc1305a0 0x7f8cfc05fa80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:42.452 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.445+0000 7f8d0290c700 1 -- 172.21.15.96:0/988046615 shutdown_connections 2019-12-05T03:49:42.453 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.445+0000 7f8d0290c700 1 -- 172.21.15.96:0/988046615 wait complete. 2019-12-05T03:49:42.453 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.445+0000 7f8d0290c700 1 -- 172.21.15.96:0/988046615 >> 172.21.15.96:0/988046615 conn(0x7f8cfc0969c0 msgr2=0x7f8cfc12f390 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:49:42.461 INFO:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd new 22680edd-6490-4ab0-bb15-0605830e4cfb 2 2019-12-05T03:49:42.570 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.557+0000 7f36b7a01700 1 Processor -- start 2019-12-05T03:49:42.571 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.557+0000 7f36b7a01700 1 -- start start 2019-12-05T03:49:42.571 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.561+0000 7f36b7a01700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f36b00b6f20 0x7f36b00988e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:42.571 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.561+0000 7f36b7a01700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f36b0098e30 0x7f36b01550d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:42.571 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.561+0000 7f36b7a01700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36b0155e20 con 0x7f36b00969c0 2019-12-05T03:49:42.571 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.561+0000 7f36b7a01700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b0098230 con 0x7f36b00b6f20 2019-12-05T03:49:42.572 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.561+0000 7f36b7a01700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b00993b0 con 0x7f36b0098e30 2019-12-05T03:49:42.572 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.561+0000 7f36b579d700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f36b0098e30 0x7f36b01550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:42.572 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.561+0000 7f36b679f700 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f36b00969c0 0x7f36b0155620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:51096/0 (socket says 172.21.15.96:51096) 2019-12-05T03:49:42.572 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.561+0000 7f36b679f700 1 -- 172.21.15.96:0/2436373658 learned_addr learned my addr 172.21.15.96:0/2436373658 (peer_addr_for_me v1:172.21.15.96:0/0) 2019-12-05T03:49:42.572 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.561+0000 7f36b5f9e700 1 --2- 172.21.15.96:0/2436373658 >> v2:172.21.15.158:3300/0 conn(0x7f36b00b6f20 0x7f36b00988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:42.573 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.561+0000 7f36b4f9c700 1 -- 172.21.15.96:0/2436373658 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 879185650 0 0) 0x7f36b0155e20 con 0x7f36b00969c0 2019-12-05T03:49:42.573 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.561+0000 7f36b579d700 1 -- 172.21.15.96:0/2436373658 >> v2:172.21.15.158:3300/0 conn(0x7f36b00b6f20 msgr2=0x7f36b00988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:49:42.573 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.561+0000 7f36b579d700 1 --2- 172.21.15.96:0/2436373658 >> v2:172.21.15.158:3300/0 conn(0x7f36b00b6f20 0x7f36b00988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:49:42.573 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.561+0000 7f36b579d700 1 -- 172.21.15.96:0/2436373658 >> v1:172.21.15.96:6789/0 conn(0x7f36b00969c0 legacy=0x7f36b0155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:42.573 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.561+0000 7f36b579d700 1 -- 172.21.15.96:0/2436373658 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b0097eb0 con 0x7f36b0098e30 2019-12-05T03:49:42.573 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.561+0000 7f36b5f9e700 1 --2- 172.21.15.96:0/2436373658 >> v2:172.21.15.158:3300/0 conn(0x7f36b00b6f20 0x7f36b00988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-12-05T03:49:42.574 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.561+0000 7f36b579d700 1 --2- 172.21.15.96:0/2436373658 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f36b0098e30 0x7f36b01550d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f36a0008790 tx=0x7f36a000fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.574 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.561+0000 7f36b579d700 1 --2- 172.21.15.96:0/2436373658 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f36b0098e30 0x7f36b01550d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f36a0008790 tx=0x7f36a000fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.574 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.561+0000 7f36b579d700 1 --2- 172.21.15.96:0/2436373658 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f36b0098e30 0x7f36b01550d0 secure :-1 s=READY pgs=11 cs=0 l=1 rx=0x7f36a0008790 tx=0x7f36a000fc70).ready entity=mon.2 client_cookie=4611449897192c0d server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:42.574 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.561+0000 7f36b579d700 1 --2- 172.21.15.96:0/2436373658 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f36b0098e30 0x7f36b01550d0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f36a0008790 tx=0x7f36a000fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.574 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.561+0000 7f36b579d700 1 --2- 172.21.15.96:0/2436373658 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f36b0098e30 0x7f36b01550d0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f36a0008790 tx=0x7f36a000fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.575 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.561+0000 7f36b4f9c700 1 -- 172.21.15.96:0/2436373658 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36a00112b0 con 0x7f36b0098e30 2019-12-05T03:49:42.575 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.561+0000 7f36b579d700 1 --2- 172.21.15.96:0/2436373658 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f36b0098e30 0x7f36b01550d0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f36a0008790 tx=0x7f36a000fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.575 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.561+0000 7f36b4f9c700 1 -- 172.21.15.96:0/2436373658 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a0008ad0 con 0x7f36b0098e30 2019-12-05T03:49:42.575 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.561+0000 7f36b4f9c700 1 -- 172.21.15.96:0/2436373658 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36a0011890 con 0x7f36b0098e30 2019-12-05T03:49:42.575 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.561+0000 7f36b7a01700 1 -- 172.21.15.96:0/2436373658 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f36b0098e30 msgr2=0x7f36b01550d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:42.575 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.561+0000 7f36b7a01700 1 --2- 172.21.15.96:0/2436373658 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f36b0098e30 0x7f36b01550d0 secure :-1 s=READY pgs=11 cs=0 l=1 rx=0x7f36a0008790 tx=0x7f36a000fc70).stop 2019-12-05T03:49:42.576 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.561+0000 7f36b7a01700 1 -- 172.21.15.96:0/2436373658 shutdown_connections 2019-12-05T03:49:42.576 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.561+0000 7f36b7a01700 1 --2- 172.21.15.96:0/2436373658 >> v2:172.21.15.158:3300/0 conn(0x7f36b00b6f20 0x7f36b00988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:49:42.576 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.561+0000 7f36b7a01700 1 --2- 172.21.15.96:0/2436373658 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f36b0098e30 0x7f36b01550d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:42.576 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.561+0000 7f36b7a01700 1 -- 172.21.15.96:0/2436373658 shutdown_connections 2019-12-05T03:49:42.577 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.561+0000 7f36b7a01700 1 -- 172.21.15.96:0/2436373658 wait complete. 2019-12-05T03:49:42.577 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.561+0000 7f36b7a01700 1 -- 172.21.15.96:0/2436373658 >> 172.21.15.96:0/2436373658 conn(0x7f36b005e370 msgr2=0x7f36b00b7370 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:49:42.577 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.565+0000 7f36b7a01700 1 Processor -- start 2019-12-05T03:49:42.577 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.565+0000 7f36b7a01700 1 -- start start 2019-12-05T03:49:42.577 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.565+0000 7f36b7a01700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f36b00650b0 0x7f36b013c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:42.577 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.565+0000 7f36b7a01700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36b007bf50 con 0x7f36b00b44f0 2019-12-05T03:49:42.578 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.565+0000 7f36b7a01700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36b00b5450 con 0x7f36b009bd00 2019-12-05T03:49:42.578 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.565+0000 7f36b7a01700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b0140950 con 0x7f36b00650b0 2019-12-05T03:49:42.578 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.565+0000 7f36b679f700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f36b00650b0 0x7f36b013c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:42.578 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.565+0000 7f36b5f9e700 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f36b00b44f0 0x7f36b007b750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:51098/0 (socket says 172.21.15.96:51098) 2019-12-05T03:49:42.578 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.565+0000 7f36b5f9e700 1 -- 172.21.15.96:0/1889437198 learned_addr learned my addr 172.21.15.96:0/1889437198 (peer_addr_for_me v1:172.21.15.96:0/0) 2019-12-05T03:49:42.578 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.565+0000 7f36b679f700 1 -- 172.21.15.96:0/1889437198 >> v1:172.21.15.158:6789/0 conn(0x7f36b009bd00 legacy=0x7f36b00b4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:42.579 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.565+0000 7f36b679f700 1 -- 172.21.15.96:0/1889437198 >> v1:172.21.15.96:6789/0 conn(0x7f36b00b44f0 legacy=0x7f36b007b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:42.579 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.565+0000 7f36b679f700 1 -- 172.21.15.96:0/1889437198 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b00654e0 con 0x7f36b00650b0 2019-12-05T03:49:42.579 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.565+0000 7f36a67fc700 1 -- 172.21.15.96:0/1889437198 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 372039967 0 0) 0x7f36b007bf50 con 0x7f36b00b44f0 2019-12-05T03:49:42.579 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.565+0000 7f36b679f700 1 --2- 172.21.15.96:0/1889437198 >> v2:172.21.15.96:3300/0 conn(0x7f36b00650b0 0x7f36b013c9b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f36b009ba90 tx=0x7f36a8010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.579 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.565+0000 7f36b679f700 1 --2- 172.21.15.96:0/1889437198 >> v2:172.21.15.96:3300/0 conn(0x7f36b00650b0 0x7f36b013c9b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f36b009ba90 tx=0x7f36a8010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.579 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.565+0000 7f36b679f700 1 --2- 172.21.15.96:0/1889437198 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36b00650b0 0x7f36b013c9b0 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7f36b009ba90 tx=0x7f36a8010b60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:42.580 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.565+0000 7f36b679f700 1 --2- 172.21.15.96:0/1889437198 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36b00650b0 0x7f36b013c9b0 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f36b009ba90 tx=0x7f36a8010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.580 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.565+0000 7f36a67fc700 1 -- 172.21.15.96:0/1889437198 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36a80119e0 con 0x7f36b00650b0 2019-12-05T03:49:42.580 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.565+0000 7f36b679f700 1 --2- 172.21.15.96:0/1889437198 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36b00650b0 0x7f36b013c9b0 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f36b009ba90 tx=0x7f36a8010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.580 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.565+0000 7f36b679f700 1 --2- 172.21.15.96:0/1889437198 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36b00650b0 0x7f36b013c9b0 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f36b009ba90 tx=0x7f36a8010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.580 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.565+0000 7f36a67fc700 1 -- 172.21.15.96:0/1889437198 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a8011600 con 0x7f36b00650b0 2019-12-05T03:49:42.581 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.565+0000 7f36b7a01700 1 -- 172.21.15.96:0/1889437198 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b00b5680 con 0x7f36b00650b0 2019-12-05T03:49:42.581 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.565+0000 7f36a67fc700 1 -- 172.21.15.96:0/1889437198 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36a800d0c0 con 0x7f36b00650b0 2019-12-05T03:49:42.581 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.565+0000 7f36b7a01700 1 -- 172.21.15.96:0/1889437198 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b01483d0 con 0x7f36b00650b0 2019-12-05T03:49:42.581 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.565+0000 7f36b679f700 1 --2- 172.21.15.96:0/1889437198 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36b00650b0 0x7f36b013c9b0 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f36b009ba90 tx=0x7f36a8010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.581 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.569+0000 7f36a67fc700 1 -- 172.21.15.96:0/1889437198 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f36a800d2c0 con 0x7f36b00650b0 2019-12-05T03:49:42.581 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.569+0000 7f36b679f700 1 --2- 172.21.15.96:0/1889437198 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36b00650b0 0x7f36b013c9b0 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f36b009ba90 tx=0x7f36a8010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.582 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.569+0000 7f36a67fc700 1 --2- 172.21.15.96:0/1889437198 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f369803ac10 0x7f369803d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:42.582 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.569+0000 7f36a67fc700 1 -- 172.21.15.96:0/1889437198 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7f36a804afa0 con 0x7f36b00650b0 2019-12-05T03:49:42.582 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.569+0000 7f36b5f9e700 1 --2- 172.21.15.96:0/1889437198 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f369803ac10 0x7f369803d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:42.582 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.569+0000 7f36b5f9e700 1 --2- 172.21.15.96:0/1889437198 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f369803ac10 0x7f369803d120 crc :-1 s=READY pgs=6 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:42.583 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.573+0000 7f36b7a01700 1 -- 172.21.15.96:0/1889437198 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b00554e0 con 0x7f36b00650b0 2019-12-05T03:49:42.589 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.585+0000 7f36b679f700 1 --2- 172.21.15.96:0/1889437198 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36b00650b0 0x7f36b013c9b0 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f36b009ba90 tx=0x7f36a8010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.589 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.585+0000 7f36a67fc700 1 -- 172.21.15.96:0/1889437198 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f36a8032080 con 0x7f36b00650b0 2019-12-05T03:49:42.758 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.757+0000 7f36b7a01700 1 -- 172.21.15.96:0/1889437198 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd new", "uuid": "22680edd-6490-4ab0-bb15-0605830e4cfb", "id": 2} v 0) v1 -- 0x7f36b0154910 con 0x7f36b00650b0 2019-12-05T03:49:42.766 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.765+0000 7f36b679f700 1 --2- 172.21.15.96:0/1889437198 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36b00650b0 0x7f36b013c9b0 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f36b009ba90 tx=0x7f36a8010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.766 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.765+0000 7f36a67fc700 1 -- 172.21.15.96:0/1889437198 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "22680edd-6490-4ab0-bb15-0605830e4cfb", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f36a80322e0 con 0x7f36b00650b0 2019-12-05T03:49:42.773 INFO:teuthology.orchestra.run.smithi096.stdout:2 2019-12-05T03:49:42.776 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.777+0000 7f36b7a01700 1 -- 172.21.15.96:0/1889437198 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f369803ac10 msgr2=0x7f369803d120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:42.776 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.777+0000 7f36b7a01700 1 --2- 172.21.15.96:0/1889437198 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f369803ac10 0x7f369803d120 crc :-1 s=READY pgs=6 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:42.776 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.777+0000 7f36b7a01700 1 -- 172.21.15.96:0/1889437198 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36b00650b0 msgr2=0x7f36b013c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:42.777 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.777+0000 7f36b7a01700 1 --2- 172.21.15.96:0/1889437198 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36b00650b0 0x7f36b013c9b0 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7f36b009ba90 tx=0x7f36a8010b60).stop 2019-12-05T03:49:42.777 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.777+0000 7f36b7a01700 1 -- 172.21.15.96:0/1889437198 shutdown_connections 2019-12-05T03:49:42.777 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.777+0000 7f36b7a01700 1 --2- 172.21.15.96:0/1889437198 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36b00650b0 0x7f36b013c9b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:42.777 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.777+0000 7f36b7a01700 1 --2- 172.21.15.96:0/1889437198 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f369803ac10 0x7f369803d120 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:42.777 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.777+0000 7f36b7a01700 1 -- 172.21.15.96:0/1889437198 shutdown_connections 2019-12-05T03:49:42.777 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.777+0000 7f36b7a01700 1 -- 172.21.15.96:0/1889437198 wait complete. 2019-12-05T03:49:42.778 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.777+0000 7f36b7a01700 1 -- 172.21.15.96:0/1889437198 >> 172.21.15.96:0/1889437198 conn(0x7f36b0098cc0 msgr2=0x7f36b012f570 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:49:42.787 INFO:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd new 7ec999ee-ace8-4ccb-a4f9-6f5d313bbbd2 3 2019-12-05T03:49:42.880 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.873+0000 7ff81fd9a700 1 Processor -- start 2019-12-05T03:49:42.881 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.873+0000 7ff81fd9a700 1 -- start start 2019-12-05T03:49:42.881 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.877+0000 7ff81fd9a700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff8180b6f20 0x7ff8180988e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:42.881 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.877+0000 7ff81fd9a700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff8180969c0 0x7ff81805a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:42.881 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.877+0000 7ff81fd9a700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8180993b0 con 0x7ff818098e30 2019-12-05T03:49:42.881 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.877+0000 7ff81fd9a700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff818098230 con 0x7ff8180b6f20 2019-12-05T03:49:42.882 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.877+0000 7ff81fd9a700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff818097eb0 con 0x7ff8180969c0 2019-12-05T03:49:42.882 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.877+0000 7ff81e337700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff8180b6f20 0x7ff8180988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:42.882 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.877+0000 7ff81e337700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff8180b6f20 0x7ff8180988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37550/0 (socket says 172.21.15.96:37550) 2019-12-05T03:49:42.882 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.877+0000 7ff81e337700 1 -- 172.21.15.96:0/2756404110 learned_addr learned my addr 172.21.15.96:0/2756404110 (peer_addr_for_me v2:172.21.15.96:0/0) 2019-12-05T03:49:42.882 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.877+0000 7ff81eb38700 1 --2- 172.21.15.96:0/2756404110 >> v2:172.21.15.158:3300/0 conn(0x7ff8180969c0 0x7ff81805a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:42.882 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.877+0000 7ff81e337700 1 -- 172.21.15.96:0/2756404110 >> v2:172.21.15.158:3300/0 conn(0x7ff8180969c0 msgr2=0x7ff81805a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:49:42.883 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.877+0000 7ff81e337700 1 --2- 172.21.15.96:0/2756404110 >> v2:172.21.15.158:3300/0 conn(0x7ff8180969c0 0x7ff81805a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:49:42.883 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.877+0000 7ff81e337700 1 -- 172.21.15.96:0/2756404110 >> v1:172.21.15.96:6789/0 conn(0x7ff818098e30 legacy=0x7ff8181550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:42.883 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.877+0000 7ff81e337700 1 -- 172.21.15.96:0/2756404110 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff81807e8c0 con 0x7ff8180b6f20 2019-12-05T03:49:42.883 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.877+0000 7ff81e337700 1 --2- 172.21.15.96:0/2756404110 >> v2:172.21.15.96:3300/0 conn(0x7ff8180b6f20 0x7ff8180988e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff80c008b10 tx=0x7ff80c0100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.883 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.877+0000 7ff81e337700 1 --2- 172.21.15.96:0/2756404110 >> v2:172.21.15.96:3300/0 conn(0x7ff8180b6f20 0x7ff8180988e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff80c008b10 tx=0x7ff80c0100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.884 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.877+0000 7ff81e337700 1 --2- 172.21.15.96:0/2756404110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8180b6f20 0x7ff8180988e0 secure :-1 s=READY pgs=16 cs=0 l=1 rx=0x7ff80c008b10 tx=0x7ff80c0100b0).ready entity=mon.0 client_cookie=88d68e71d8eb9936 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:42.884 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.877+0000 7ff81e337700 1 --2- 172.21.15.96:0/2756404110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8180b6f20 0x7ff8180988e0 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7ff80c008b10 tx=0x7ff80c0100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.884 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.877+0000 7ff81e337700 1 --2- 172.21.15.96:0/2756404110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8180b6f20 0x7ff8180988e0 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7ff80c008b10 tx=0x7ff80c0100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.884 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.877+0000 7ff81e337700 1 --2- 172.21.15.96:0/2756404110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8180b6f20 0x7ff8180988e0 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7ff80c008b10 tx=0x7ff80c0100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.884 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.877+0000 7ff81d335700 1 -- 172.21.15.96:0/2756404110 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff80c011dd0 con 0x7ff8180b6f20 2019-12-05T03:49:42.885 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.877+0000 7ff81d335700 1 -- 172.21.15.96:0/2756404110 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80c0119f0 con 0x7ff8180b6f20 2019-12-05T03:49:42.885 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.877+0000 7ff81d335700 1 -- 172.21.15.96:0/2756404110 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff80c00a540 con 0x7ff8180b6f20 2019-12-05T03:49:42.885 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.877+0000 7ff81fd9a700 1 -- 172.21.15.96:0/2756404110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8180b6f20 msgr2=0x7ff8180988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:42.885 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.877+0000 7ff81fd9a700 1 --2- 172.21.15.96:0/2756404110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8180b6f20 0x7ff8180988e0 secure :-1 s=READY pgs=16 cs=0 l=1 rx=0x7ff80c008b10 tx=0x7ff80c0100b0).stop 2019-12-05T03:49:42.885 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.877+0000 7ff81fd9a700 1 -- 172.21.15.96:0/2756404110 shutdown_connections 2019-12-05T03:49:42.885 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.877+0000 7ff81fd9a700 1 --2- 172.21.15.96:0/2756404110 >> v2:172.21.15.158:3300/0 conn(0x7ff8180969c0 0x7ff81805a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:49:42.886 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.877+0000 7ff81fd9a700 1 --2- 172.21.15.96:0/2756404110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8180b6f20 0x7ff8180988e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:42.886 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.877+0000 7ff81fd9a700 1 -- 172.21.15.96:0/2756404110 shutdown_connections 2019-12-05T03:49:42.886 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.881+0000 7ff81fd9a700 1 -- 172.21.15.96:0/2756404110 wait complete. 2019-12-05T03:49:42.886 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.881+0000 7ff81fd9a700 1 -- 172.21.15.96:0/2756404110 >> 172.21.15.96:0/2756404110 conn(0x7ff81805e370 msgr2=0x7ff8180b7370 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:49:42.890 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.881+0000 7ff81fd9a700 1 Processor -- start 2019-12-05T03:49:42.890 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.881+0000 7ff81fd9a700 1 -- start start 2019-12-05T03:49:42.890 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.885+0000 7ff81fd9a700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff8180b6300 0x7ff81813d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:42.890 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.885+0000 7ff81fd9a700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff81813c940 0x7ff818064750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:42.890 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.885+0000 7ff81fd9a700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff81813cd70 con 0x7ff81812ffb0 2019-12-05T03:49:42.891 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.885+0000 7ff81fd9a700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff81813d080 con 0x7ff8180b6300 2019-12-05T03:49:42.891 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.885+0000 7ff81fd9a700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff81813d320 con 0x7ff81813c940 2019-12-05T03:49:42.891 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.885+0000 7ff81e337700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff8180b6300 0x7ff81813d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:42.891 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.885+0000 7ff81e337700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff8180b6300 0x7ff81813d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37556/0 (socket says 172.21.15.96:37556) 2019-12-05T03:49:42.891 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.885+0000 7ff81e337700 1 -- 172.21.15.96:0/2903340355 learned_addr learned my addr 172.21.15.96:0/2903340355 (peer_addr_for_me v2:172.21.15.96:0/0) 2019-12-05T03:49:42.891 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.885+0000 7ff81eb38700 1 --2- 172.21.15.96:0/2903340355 >> v2:172.21.15.158:3300/0 conn(0x7ff81813c940 0x7ff818064750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:42.892 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.885+0000 7ff81e337700 1 -- 172.21.15.96:0/2903340355 >> v2:172.21.15.158:3300/0 conn(0x7ff81813c940 msgr2=0x7ff818064750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:42.892 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.885+0000 7ff81e337700 1 --2- 172.21.15.96:0/2903340355 >> v2:172.21.15.158:3300/0 conn(0x7ff81813c940 0x7ff818064750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:42.892 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.885+0000 7ff81e337700 1 -- 172.21.15.96:0/2903340355 >> v1:172.21.15.96:6789/0 conn(0x7ff81812ffb0 legacy=0x7ff8180b5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:42.892 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.885+0000 7ff81e337700 1 -- 172.21.15.96:0/2903340355 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8180b2fc0 con 0x7ff8180b6300 2019-12-05T03:49:42.892 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.885+0000 7ff816ffd700 1 -- 172.21.15.96:0/2903340355 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3864892073 0 0) 0x7ff81813cd70 con 0x7ff81812ffb0 2019-12-05T03:49:42.892 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.885+0000 7ff81e337700 1 --2- 172.21.15.96:0/2903340355 >> v2:172.21.15.96:3300/0 conn(0x7ff8180b6300 0x7ff81813d5c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff81813cfa0 tx=0x7ff80c00f530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.893 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.885+0000 7ff81e337700 1 --2- 172.21.15.96:0/2903340355 >> v2:172.21.15.96:3300/0 conn(0x7ff8180b6300 0x7ff81813d5c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff81813cfa0 tx=0x7ff80c00f530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.893 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.885+0000 7ff81e337700 1 --2- 172.21.15.96:0/2903340355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8180b6300 0x7ff81813d5c0 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7ff81813cfa0 tx=0x7ff80c00f530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:42.893 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.885+0000 7ff81e337700 1 --2- 172.21.15.96:0/2903340355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8180b6300 0x7ff81813d5c0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7ff81813cfa0 tx=0x7ff80c00f530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.893 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.885+0000 7ff81e337700 1 --2- 172.21.15.96:0/2903340355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8180b6300 0x7ff81813d5c0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7ff81813cfa0 tx=0x7ff80c00f530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.893 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.885+0000 7ff816ffd700 1 -- 172.21.15.96:0/2903340355 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff80c0058c0 con 0x7ff8180b6300 2019-12-05T03:49:42.893 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.885+0000 7ff81e337700 1 --2- 172.21.15.96:0/2903340355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8180b6300 0x7ff81813d5c0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7ff81813cfa0 tx=0x7ff80c00f530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.893 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.885+0000 7ff816ffd700 1 -- 172.21.15.96:0/2903340355 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80c00a160 con 0x7ff8180b6300 2019-12-05T03:49:42.894 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.885+0000 7ff81fd9a700 1 -- 172.21.15.96:0/2903340355 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8180984d0 con 0x7ff8180b6300 2019-12-05T03:49:42.894 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.885+0000 7ff816ffd700 1 -- 172.21.15.96:0/2903340355 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff80c007150 con 0x7ff8180b6300 2019-12-05T03:49:42.894 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.885+0000 7ff81fd9a700 1 -- 172.21.15.96:0/2903340355 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff818098a80 con 0x7ff8180b6300 2019-12-05T03:49:42.894 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.885+0000 7ff81e337700 1 --2- 172.21.15.96:0/2903340355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8180b6300 0x7ff81813d5c0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7ff81813cfa0 tx=0x7ff80c00f530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.894 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.885+0000 7ff816ffd700 1 -- 172.21.15.96:0/2903340355 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7ff80c007350 con 0x7ff8180b6300 2019-12-05T03:49:42.894 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.885+0000 7ff81e337700 1 --2- 172.21.15.96:0/2903340355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8180b6300 0x7ff81813d5c0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7ff81813cfa0 tx=0x7ff80c00f530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.895 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.885+0000 7ff816ffd700 1 --2- 172.21.15.96:0/2903340355 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7ff80003ac60 0x7ff80003d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:42.895 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.885+0000 7ff816ffd700 1 -- 172.21.15.96:0/2903340355 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7ff80c04df40 con 0x7ff8180b6300 2019-12-05T03:49:42.895 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.885+0000 7ff81db36700 1 --2- 172.21.15.96:0/2903340355 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7ff80003ac60 0x7ff80003d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:42.895 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.889+0000 7ff81db36700 1 --2- 172.21.15.96:0/2903340355 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7ff80003ac60 0x7ff80003d170 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:42.895 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.889+0000 7ff81fd9a700 1 -- 172.21.15.96:0/2903340355 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8180554e0 con 0x7ff8180b6300 2019-12-05T03:49:42.896 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.893+0000 7ff81e337700 1 --2- 172.21.15.96:0/2903340355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8180b6300 0x7ff81813d5c0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7ff81813cfa0 tx=0x7ff80c00f530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:42.896 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:42.893+0000 7ff816ffd700 1 -- 172.21.15.96:0/2903340355 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7ff80c034fc0 con 0x7ff8180b6300 2019-12-05T03:49:43.066 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.065+0000 7ff81fd9a700 1 -- 172.21.15.96:0/2903340355 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7ec999ee-ace8-4ccb-a4f9-6f5d313bbbd2", "id": 3} v 0) v1 -- 0x7ff81805f450 con 0x7ff8180b6300 2019-12-05T03:49:43.071 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.069+0000 7ff81e337700 1 --2- 172.21.15.96:0/2903340355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8180b6300 0x7ff81813d5c0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7ff81813cfa0 tx=0x7ff80c00f530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.071 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.069+0000 7ff816ffd700 1 -- 172.21.15.96:0/2903340355 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7ec999ee-ace8-4ccb-a4f9-6f5d313bbbd2", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff80c035220 con 0x7ff8180b6300 2019-12-05T03:49:43.073 INFO:teuthology.orchestra.run.smithi096.stdout:3 2019-12-05T03:49:43.078 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.077+0000 7ff81fd9a700 1 -- 172.21.15.96:0/2903340355 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7ff80003ac60 msgr2=0x7ff80003d170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:43.078 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.077+0000 7ff81fd9a700 1 --2- 172.21.15.96:0/2903340355 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7ff80003ac60 0x7ff80003d170 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:43.078 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.077+0000 7ff81fd9a700 1 -- 172.21.15.96:0/2903340355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8180b6300 msgr2=0x7ff81813d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:43.078 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.077+0000 7ff81fd9a700 1 --2- 172.21.15.96:0/2903340355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8180b6300 0x7ff81813d5c0 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7ff81813cfa0 tx=0x7ff80c00f530).stop 2019-12-05T03:49:43.078 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.077+0000 7ff81fd9a700 1 -- 172.21.15.96:0/2903340355 shutdown_connections 2019-12-05T03:49:43.078 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.077+0000 7ff81fd9a700 1 --2- 172.21.15.96:0/2903340355 >> v2:172.21.15.158:3300/0 conn(0x7ff81813c940 0x7ff818064750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:43.079 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.077+0000 7ff81fd9a700 1 --2- 172.21.15.96:0/2903340355 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8180b6300 0x7ff81813d5c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:43.079 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.077+0000 7ff81fd9a700 1 --2- 172.21.15.96:0/2903340355 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7ff80003ac60 0x7ff80003d170 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:43.079 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.077+0000 7ff81fd9a700 1 -- 172.21.15.96:0/2903340355 shutdown_connections 2019-12-05T03:49:43.079 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.077+0000 7ff81fd9a700 1 -- 172.21.15.96:0/2903340355 wait complete. 2019-12-05T03:49:43.079 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.077+0000 7ff81fd9a700 1 -- 172.21.15.96:0/2903340355 >> 172.21.15.96:0/2903340355 conn(0x7ff818098d60 msgr2=0x7ff818155040 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:49:43.088 INFO:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd new 186e69c4-b69f-4dd1-bb8f-faf759c60484 4 2019-12-05T03:49:43.180 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.173+0000 7fd06f0c5700 1 Processor -- start 2019-12-05T03:49:43.180 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.173+0000 7fd06f0c5700 1 -- start start 2019-12-05T03:49:43.180 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.173+0000 7fd06f0c5700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd0680b6f20 0x7fd0680988e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:43.180 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.173+0000 7fd06f0c5700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd068098e30 0x7fd0681550d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:43.180 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.173+0000 7fd06f0c5700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd068155e20 con 0x7fd0680969c0 2019-12-05T03:49:43.181 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.173+0000 7fd06f0c5700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd068098230 con 0x7fd0680b6f20 2019-12-05T03:49:43.181 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.173+0000 7fd06f0c5700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0680993b0 con 0x7fd068098e30 2019-12-05T03:49:43.181 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.173+0000 7fd06ce61700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd068098e30 0x7fd0681550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:43.181 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.173+0000 7fd06d662700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd0680b6f20 0x7fd0680988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:43.181 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.173+0000 7fd06ce61700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd068098e30 0x7fd0681550d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:37628/0 (socket says 172.21.15.96:37628) 2019-12-05T03:49:43.181 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.173+0000 7fd06ce61700 1 -- 172.21.15.96:0/3191104519 learned_addr learned my addr 172.21.15.96:0/3191104519 (peer_addr_for_me v2:172.21.15.96:0/0) 2019-12-05T03:49:43.181 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.177+0000 7fd06ce61700 1 -- 172.21.15.96:0/3191104519 >> v2:172.21.15.96:3300/0 conn(0x7fd0680b6f20 msgr2=0x7fd0680988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:49:43.182 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.177+0000 7fd06ce61700 1 --2- 172.21.15.96:0/3191104519 >> v2:172.21.15.96:3300/0 conn(0x7fd0680b6f20 0x7fd0680988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:49:43.182 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.177+0000 7fd06ce61700 1 -- 172.21.15.96:0/3191104519 >> v1:172.21.15.158:6789/0 conn(0x7fd0680969c0 legacy=0x7fd068155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:43.182 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.177+0000 7fd06ce61700 1 -- 172.21.15.96:0/3191104519 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd068097eb0 con 0x7fd068098e30 2019-12-05T03:49:43.182 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.177+0000 7fd06ce61700 1 --2- 172.21.15.96:0/3191104519 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd068098e30 0x7fd0681550d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd058008790 tx=0x7fd05800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.182 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.177+0000 7fd06ce61700 1 --2- 172.21.15.96:0/3191104519 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd068098e30 0x7fd0681550d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd058008790 tx=0x7fd05800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.182 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.177+0000 7fd06ce61700 1 --2- 172.21.15.96:0/3191104519 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd068098e30 0x7fd0681550d0 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7fd058008790 tx=0x7fd05800fd30).ready entity=mon.2 client_cookie=4a41d85528bd5a56 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:43.182 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.177+0000 7fd06ce61700 1 --2- 172.21.15.96:0/3191104519 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd068098e30 0x7fd0681550d0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7fd058008790 tx=0x7fd05800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.183 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.177+0000 7fd05ffff700 1 -- 172.21.15.96:0/3191104519 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd058011370 con 0x7fd068098e30 2019-12-05T03:49:43.183 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.177+0000 7fd06ce61700 1 --2- 172.21.15.96:0/3191104519 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd068098e30 0x7fd0681550d0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7fd058008790 tx=0x7fd05800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.183 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.177+0000 7fd06ce61700 1 --2- 172.21.15.96:0/3191104519 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd068098e30 0x7fd0681550d0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7fd058008790 tx=0x7fd05800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.183 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.177+0000 7fd05ffff700 1 -- 172.21.15.96:0/3191104519 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd058008bb0 con 0x7fd068098e30 2019-12-05T03:49:43.184 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.177+0000 7fd05ffff700 1 -- 172.21.15.96:0/3191104519 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd058011950 con 0x7fd068098e30 2019-12-05T03:49:43.184 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.177+0000 7fd06f0c5700 1 -- 172.21.15.96:0/3191104519 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd068098e30 msgr2=0x7fd0681550d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:43.184 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.177+0000 7fd06f0c5700 1 --2- 172.21.15.96:0/3191104519 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd068098e30 0x7fd0681550d0 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7fd058008790 tx=0x7fd05800fd30).stop 2019-12-05T03:49:43.184 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.177+0000 7fd06f0c5700 1 -- 172.21.15.96:0/3191104519 shutdown_connections 2019-12-05T03:49:43.184 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.177+0000 7fd06f0c5700 1 --2- 172.21.15.96:0/3191104519 >> v2:172.21.15.96:3300/0 conn(0x7fd0680b6f20 0x7fd0680988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:49:43.184 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.177+0000 7fd06f0c5700 1 --2- 172.21.15.96:0/3191104519 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd068098e30 0x7fd0681550d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:43.185 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.177+0000 7fd06f0c5700 1 -- 172.21.15.96:0/3191104519 shutdown_connections 2019-12-05T03:49:43.185 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.177+0000 7fd06f0c5700 1 -- 172.21.15.96:0/3191104519 wait complete. 2019-12-05T03:49:43.185 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.177+0000 7fd06f0c5700 1 -- 172.21.15.96:0/3191104519 >> 172.21.15.96:0/3191104519 conn(0x7fd06805e370 msgr2=0x7fd0680b7370 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:49:43.188 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.181+0000 7fd06f0c5700 1 Processor -- start 2019-12-05T03:49:43.189 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.181+0000 7fd06f0c5700 1 -- start start 2019-12-05T03:49:43.189 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.181+0000 7fd06f0c5700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd068151c50 0x7fd068136f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:43.189 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.181+0000 7fd06f0c5700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd068154b00 0x7fd068132cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:43.189 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.181+0000 7fd06f0c5700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd068137bb0 con 0x7fd068133220 2019-12-05T03:49:43.189 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.181+0000 7fd06f0c5700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd06807cda0 con 0x7fd068151c50 2019-12-05T03:49:43.189 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.181+0000 7fd06f0c5700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd068137910 con 0x7fd068154b00 2019-12-05T03:49:43.190 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.181+0000 7fd06d662700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd068151c50 0x7fd068136f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:43.190 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.181+0000 7fd06ce61700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd068154b00 0x7fd068132cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:43.190 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.181+0000 7fd06d662700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd068151c50 0x7fd068136f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37570/0 (socket says 172.21.15.96:37570) 2019-12-05T03:49:43.190 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.181+0000 7fd06ce61700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd068154b00 0x7fd068132cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:37636/0 (socket says 172.21.15.96:37636) 2019-12-05T03:49:43.190 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.181+0000 7fd06d662700 1 -- 172.21.15.96:0/1987201892 learned_addr learned my addr 172.21.15.96:0/1987201892 (peer_addr_for_me v2:172.21.15.96:0/0) 2019-12-05T03:49:43.190 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.181+0000 7fd05dffb700 1 -- 172.21.15.96:0/1987201892 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 416404207 0 0) 0x7fd068137bb0 con 0x7fd068133220 2019-12-05T03:49:43.191 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.181+0000 7fd06d662700 1 -- 172.21.15.96:0/1987201892 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd068154b00 msgr2=0x7fd068132cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:43.191 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.181+0000 7fd06d662700 1 --2- 172.21.15.96:0/1987201892 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd068154b00 0x7fd068132cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:43.191 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.181+0000 7fd06d662700 1 -- 172.21.15.96:0/1987201892 >> v1:172.21.15.158:6789/0 conn(0x7fd068133220 legacy=0x7fd068153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:43.191 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.181+0000 7fd06d662700 1 -- 172.21.15.96:0/1987201892 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0681542e0 con 0x7fd068151c50 2019-12-05T03:49:43.191 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.181+0000 7fd06ce61700 1 --2- 172.21.15.96:0/1987201892 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd068154b00 0x7fd068132cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:49:43.191 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.181+0000 7fd06d662700 1 --2- 172.21.15.96:0/1987201892 >> v2:172.21.15.96:3300/0 conn(0x7fd068151c50 0x7fd068136f00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd068137de0 tx=0x7fd064010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.192 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.181+0000 7fd06d662700 1 --2- 172.21.15.96:0/1987201892 >> v2:172.21.15.96:3300/0 conn(0x7fd068151c50 0x7fd068136f00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd068137de0 tx=0x7fd064010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.192 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.181+0000 7fd06d662700 1 --2- 172.21.15.96:0/1987201892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd068151c50 0x7fd068136f00 secure :-1 s=READY pgs=19 cs=0 l=1 rx=0x7fd068137de0 tx=0x7fd064010b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:43.192 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.181+0000 7fd06d662700 1 --2- 172.21.15.96:0/1987201892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd068151c50 0x7fd068136f00 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7fd068137de0 tx=0x7fd064010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.192 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.181+0000 7fd05dffb700 1 -- 172.21.15.96:0/1987201892 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd064012570 con 0x7fd068151c50 2019-12-05T03:49:43.192 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.181+0000 7fd06d662700 1 --2- 172.21.15.96:0/1987201892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd068151c50 0x7fd068136f00 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7fd068137de0 tx=0x7fd064010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.192 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.181+0000 7fd06d662700 1 --2- 172.21.15.96:0/1987201892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd068151c50 0x7fd068136f00 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7fd068137de0 tx=0x7fd064010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.193 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.181+0000 7fd05dffb700 1 -- 172.21.15.96:0/1987201892 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd064007150 con 0x7fd068151c50 2019-12-05T03:49:43.193 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.181+0000 7fd05dffb700 1 -- 172.21.15.96:0/1987201892 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd064012b50 con 0x7fd068151c50 2019-12-05T03:49:43.193 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.181+0000 7fd06f0c5700 1 -- 172.21.15.96:0/1987201892 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd068137450 con 0x7fd068151c50 2019-12-05T03:49:43.193 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.181+0000 7fd06f0c5700 1 -- 172.21.15.96:0/1987201892 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0680b4b60 con 0x7fd068151c50 2019-12-05T03:49:43.193 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.185+0000 7fd06d662700 1 --2- 172.21.15.96:0/1987201892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd068151c50 0x7fd068136f00 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7fd068137de0 tx=0x7fd064010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.193 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.185+0000 7fd05dffb700 1 -- 172.21.15.96:0/1987201892 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fd064005540 con 0x7fd068151c50 2019-12-05T03:49:43.194 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.185+0000 7fd06d662700 1 --2- 172.21.15.96:0/1987201892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd068151c50 0x7fd068136f00 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7fd068137de0 tx=0x7fd064010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.194 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.185+0000 7fd05dffb700 1 --2- 172.21.15.96:0/1987201892 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd04803acb0 0x7fd04803d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:43.194 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.185+0000 7fd05dffb700 1 -- 172.21.15.96:0/1987201892 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7fd06404afc0 con 0x7fd068151c50 2019-12-05T03:49:43.194 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.185+0000 7fd06ce61700 1 --2- 172.21.15.96:0/1987201892 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd04803acb0 0x7fd04803d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:43.194 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.185+0000 7fd06ce61700 1 --2- 172.21.15.96:0/1987201892 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd04803acb0 0x7fd04803d1c0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:43.194 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.189+0000 7fd06f0c5700 1 -- 172.21.15.96:0/1987201892 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0680554e0 con 0x7fd068151c50 2019-12-05T03:49:43.195 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.193+0000 7fd06d662700 1 --2- 172.21.15.96:0/1987201892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd068151c50 0x7fd068136f00 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7fd068137de0 tx=0x7fd064010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.195 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.193+0000 7fd05dffb700 1 -- 172.21.15.96:0/1987201892 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fd064032040 con 0x7fd068151c50 2019-12-05T03:49:43.365 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.365+0000 7fd06f0c5700 1 -- 172.21.15.96:0/1987201892 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd new", "uuid": "186e69c4-b69f-4dd1-bb8f-faf759c60484", "id": 4} v 0) v1 -- 0x7fd0680b3cf0 con 0x7fd068151c50 2019-12-05T03:49:43.374 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.373+0000 7fd06d662700 1 --2- 172.21.15.96:0/1987201892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd068151c50 0x7fd068136f00 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7fd068137de0 tx=0x7fd064010b00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.375 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.373+0000 7fd05dffb700 1 -- 172.21.15.96:0/1987201892 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "186e69c4-b69f-4dd1-bb8f-faf759c60484", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd0640322a0 con 0x7fd068151c50 2019-12-05T03:49:43.380 INFO:teuthology.orchestra.run.smithi096.stdout:4 2019-12-05T03:49:43.384 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.385+0000 7fd06f0c5700 1 -- 172.21.15.96:0/1987201892 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd04803acb0 msgr2=0x7fd04803d1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:43.385 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.385+0000 7fd06f0c5700 1 --2- 172.21.15.96:0/1987201892 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd04803acb0 0x7fd04803d1c0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:43.385 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.385+0000 7fd06f0c5700 1 -- 172.21.15.96:0/1987201892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd068151c50 msgr2=0x7fd068136f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:43.385 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.385+0000 7fd06f0c5700 1 --2- 172.21.15.96:0/1987201892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd068151c50 0x7fd068136f00 secure :-1 s=READY pgs=19 cs=0 l=1 rx=0x7fd068137de0 tx=0x7fd064010b00).stop 2019-12-05T03:49:43.385 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.385+0000 7fd06f0c5700 1 -- 172.21.15.96:0/1987201892 shutdown_connections 2019-12-05T03:49:43.386 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.385+0000 7fd06f0c5700 1 --2- 172.21.15.96:0/1987201892 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd04803acb0 0x7fd04803d1c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:43.386 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.385+0000 7fd06f0c5700 1 --2- 172.21.15.96:0/1987201892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd068151c50 0x7fd068136f00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:43.386 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.385+0000 7fd06f0c5700 1 --2- 172.21.15.96:0/1987201892 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd068154b00 0x7fd068132cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:43.386 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.385+0000 7fd06f0c5700 1 -- 172.21.15.96:0/1987201892 shutdown_connections 2019-12-05T03:49:43.387 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.385+0000 7fd06f0c5700 1 -- 172.21.15.96:0/1987201892 wait complete. 2019-12-05T03:49:43.387 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.385+0000 7fd06f0c5700 1 -- 172.21.15.96:0/1987201892 >> 172.21.15.96:0/1987201892 conn(0x7fd0680969c0 msgr2=0x7fd0680984d0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:49:43.395 INFO:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd new 86b658b2-8b40-4cea-8163-305a3982758b 5 2019-12-05T03:49:43.486 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.481+0000 7fb875092700 1 Processor -- start 2019-12-05T03:49:43.487 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.481+0000 7fb875092700 1 -- start start 2019-12-05T03:49:43.487 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.485+0000 7fb875092700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fb8700b6f20 0x7fb8700988e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:43.487 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.485+0000 7fb875092700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb870098e30 0x7fb8701550d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:43.487 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.485+0000 7fb875092700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb870155e20 con 0x7fb8700969c0 2019-12-05T03:49:43.487 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.485+0000 7fb875092700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb870098230 con 0x7fb870098e30 2019-12-05T03:49:43.487 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.485+0000 7fb875092700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8700993b0 con 0x7fb8700b6f20 2019-12-05T03:49:43.488 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.485+0000 7fb867fff700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb870098e30 0x7fb8701550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:43.488 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.485+0000 7fb867fff700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb870098e30 0x7fb8701550d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37578/0 (socket says 172.21.15.96:37578) 2019-12-05T03:49:43.488 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.485+0000 7fb867fff700 1 -- 172.21.15.96:0/1688040565 learned_addr learned my addr 172.21.15.96:0/1688040565 (peer_addr_for_me v2:172.21.15.96:0/0) 2019-12-05T03:49:43.488 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.485+0000 7fb86f59e700 1 --2- 172.21.15.96:0/1688040565 >> v2:172.21.15.158:3300/0 conn(0x7fb8700b6f20 0x7fb8700988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:43.488 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.485+0000 7fb867fff700 1 -- 172.21.15.96:0/1688040565 >> v2:172.21.15.158:3300/0 conn(0x7fb8700b6f20 msgr2=0x7fb8700988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:49:43.488 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.485+0000 7fb867fff700 1 --2- 172.21.15.96:0/1688040565 >> v2:172.21.15.158:3300/0 conn(0x7fb8700b6f20 0x7fb8700988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:49:43.488 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.485+0000 7fb867fff700 1 -- 172.21.15.96:0/1688040565 >> v1:172.21.15.158:6789/0 conn(0x7fb8700969c0 legacy=0x7fb870155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:49:43.489 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.485+0000 7fb867fff700 1 -- 172.21.15.96:0/1688040565 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb870097eb0 con 0x7fb870098e30 2019-12-05T03:49:43.489 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.485+0000 7fb867fff700 1 --2- 172.21.15.96:0/1688040565 >> v2:172.21.15.96:3300/0 conn(0x7fb870098e30 0x7fb8701550d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb858008790 tx=0x7fb85800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.489 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.485+0000 7fb867fff700 1 --2- 172.21.15.96:0/1688040565 >> v2:172.21.15.96:3300/0 conn(0x7fb870098e30 0x7fb8701550d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb858008790 tx=0x7fb85800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.489 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.485+0000 7fb867fff700 1 --2- 172.21.15.96:0/1688040565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb870098e30 0x7fb8701550d0 secure :-1 s=READY pgs=20 cs=0 l=1 rx=0x7fb858008790 tx=0x7fb85800fd30).ready entity=mon.0 client_cookie=23d88d652cf43643 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:43.489 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.485+0000 7fb867fff700 1 --2- 172.21.15.96:0/1688040565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb870098e30 0x7fb8701550d0 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7fb858008790 tx=0x7fb85800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.489 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.485+0000 7fb86ed9d700 1 -- 172.21.15.96:0/1688040565 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb858011370 con 0x7fb870098e30 2019-12-05T03:49:43.489 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.485+0000 7fb867fff700 1 --2- 172.21.15.96:0/1688040565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb870098e30 0x7fb8701550d0 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7fb858008790 tx=0x7fb85800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.490 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.485+0000 7fb867fff700 1 --2- 172.21.15.96:0/1688040565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb870098e30 0x7fb8701550d0 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7fb858008790 tx=0x7fb85800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.490 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.485+0000 7fb86ed9d700 1 -- 172.21.15.96:0/1688040565 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb858008bb0 con 0x7fb870098e30 2019-12-05T03:49:43.490 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.485+0000 7fb86ed9d700 1 -- 172.21.15.96:0/1688040565 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb858011950 con 0x7fb870098e30 2019-12-05T03:49:43.490 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.485+0000 7fb875092700 1 -- 172.21.15.96:0/1688040565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb870098e30 msgr2=0x7fb8701550d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:43.490 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.485+0000 7fb875092700 1 --2- 172.21.15.96:0/1688040565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb870098e30 0x7fb8701550d0 secure :-1 s=READY pgs=20 cs=0 l=1 rx=0x7fb858008790 tx=0x7fb85800fd30).stop 2019-12-05T03:49:43.490 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.485+0000 7fb875092700 1 -- 172.21.15.96:0/1688040565 shutdown_connections 2019-12-05T03:49:43.490 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.485+0000 7fb875092700 1 --2- 172.21.15.96:0/1688040565 >> v2:172.21.15.158:3300/0 conn(0x7fb8700b6f20 0x7fb8700988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:49:43.491 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.485+0000 7fb875092700 1 --2- 172.21.15.96:0/1688040565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb870098e30 0x7fb8701550d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:43.491 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.485+0000 7fb875092700 1 -- 172.21.15.96:0/1688040565 shutdown_connections 2019-12-05T03:49:43.491 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.485+0000 7fb875092700 1 -- 172.21.15.96:0/1688040565 wait complete. 2019-12-05T03:49:43.491 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.485+0000 7fb875092700 1 -- 172.21.15.96:0/1688040565 >> 172.21.15.96:0/1688040565 conn(0x7fb87005e370 msgr2=0x7fb8700b7370 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:49:43.496 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.485+0000 7fb875092700 1 Processor -- start 2019-12-05T03:49:43.496 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.485+0000 7fb875092700 1 -- start start 2019-12-05T03:49:43.496 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.489+0000 7fb875092700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb870065120 0x7fb8700b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:43.496 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.489+0000 7fb875092700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb8701375d0 0x7fb87009ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:43.496 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.489+0000 7fb875092700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8700b53e0 con 0x7fb8701371a0 2019-12-05T03:49:43.496 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.489+0000 7fb875092700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb87009a320 con 0x7fb8701375d0 2019-12-05T03:49:43.497 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.489+0000 7fb875092700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87009a5c0 con 0x7fb870065120 2019-12-05T03:49:43.497 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.489+0000 7fb86f59e700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb870065120 0x7fb8700b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:43.497 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.489+0000 7fb874891700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb8701375d0 0x7fb87009ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:43.497 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.489+0000 7fb86f59e700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb870065120 0x7fb8700b4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:37646/0 (socket says 172.21.15.96:37646) 2019-12-05T03:49:43.497 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.489+0000 7fb874891700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb8701375d0 0x7fb87009ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37588/0 (socket says 172.21.15.96:37588) 2019-12-05T03:49:43.497 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.489+0000 7fb86f59e700 1 -- 172.21.15.96:0/1564001525 learned_addr learned my addr 172.21.15.96:0/1564001525 (peer_addr_for_me v2:172.21.15.96:0/0) 2019-12-05T03:49:43.497 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.489+0000 7fb874891700 1 -- 172.21.15.96:0/1564001525 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb870065120 msgr2=0x7fb8700b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:43.498 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.489+0000 7fb874891700 1 --2- 172.21.15.96:0/1564001525 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb870065120 0x7fb8700b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:43.498 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.489+0000 7fb874891700 1 -- 172.21.15.96:0/1564001525 >> v1:172.21.15.158:6789/0 conn(0x7fb8701371a0 legacy=0x7fb870152310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:43.498 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.489+0000 7fb86cd99700 1 -- 172.21.15.96:0/1564001525 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3273256406 0 0) 0x7fb8700b53e0 con 0x7fb8701371a0 2019-12-05T03:49:43.498 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.489+0000 7fb874891700 1 -- 172.21.15.96:0/1564001525 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb870065550 con 0x7fb8701375d0 2019-12-05T03:49:43.498 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.489+0000 7fb874891700 1 --2- 172.21.15.96:0/1564001525 >> v2:172.21.15.96:3300/0 conn(0x7fb8701375d0 0x7fb87009ab00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb87009a4e0 tx=0x7fb868010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.498 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.489+0000 7fb874891700 1 --2- 172.21.15.96:0/1564001525 >> v2:172.21.15.96:3300/0 conn(0x7fb8701375d0 0x7fb87009ab00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb87009a4e0 tx=0x7fb868010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.498 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.489+0000 7fb874891700 1 --2- 172.21.15.96:0/1564001525 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8701375d0 0x7fb87009ab00 secure :-1 s=READY pgs=21 cs=0 l=1 rx=0x7fb87009a4e0 tx=0x7fb868010b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:43.499 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.489+0000 7fb874891700 1 --2- 172.21.15.96:0/1564001525 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8701375d0 0x7fb87009ab00 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7fb87009a4e0 tx=0x7fb868010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.499 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.489+0000 7fb86cd99700 1 -- 172.21.15.96:0/1564001525 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb868013060 con 0x7fb8701375d0 2019-12-05T03:49:43.499 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.489+0000 7fb874891700 1 --2- 172.21.15.96:0/1564001525 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8701375d0 0x7fb87009ab00 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7fb87009a4e0 tx=0x7fb868010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.499 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.489+0000 7fb874891700 1 --2- 172.21.15.96:0/1564001525 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8701375d0 0x7fb87009ab00 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7fb87009a4e0 tx=0x7fb868010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.499 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.489+0000 7fb86cd99700 1 -- 172.21.15.96:0/1564001525 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb868005b40 con 0x7fb8701375d0 2019-12-05T03:49:43.501 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.489+0000 7fb875092700 1 -- 172.21.15.96:0/1564001525 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb870152b10 con 0x7fb8701375d0 2019-12-05T03:49:43.501 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.489+0000 7fb86cd99700 1 -- 172.21.15.96:0/1564001525 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb868008e00 con 0x7fb8701375d0 2019-12-05T03:49:43.501 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.489+0000 7fb875092700 1 -- 172.21.15.96:0/1564001525 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb87009bdb0 con 0x7fb8701375d0 2019-12-05T03:49:43.501 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.489+0000 7fb874891700 1 --2- 172.21.15.96:0/1564001525 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8701375d0 0x7fb87009ab00 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7fb87009a4e0 tx=0x7fb868010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.501 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.489+0000 7fb86cd99700 1 -- 172.21.15.96:0/1564001525 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fb868007160 con 0x7fb8701375d0 2019-12-05T03:49:43.501 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.489+0000 7fb874891700 1 --2- 172.21.15.96:0/1564001525 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8701375d0 0x7fb87009ab00 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7fb87009a4e0 tx=0x7fb868010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.502 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.493+0000 7fb86cd99700 1 --2- 172.21.15.96:0/1564001525 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fb85403acf0 0x7fb85403d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:43.502 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.493+0000 7fb86cd99700 1 -- 172.21.15.96:0/1564001525 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7fb86804add0 con 0x7fb8701375d0 2019-12-05T03:49:43.502 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.493+0000 7fb86f59e700 1 --2- 172.21.15.96:0/1564001525 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fb85403acf0 0x7fb85403d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:43.502 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.493+0000 7fb86f59e700 1 --2- 172.21.15.96:0/1564001525 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fb85403acf0 0x7fb85403d200 crc :-1 s=READY pgs=10 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:43.502 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.497+0000 7fb875092700 1 -- 172.21.15.96:0/1564001525 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8700554e0 con 0x7fb8701375d0 2019-12-05T03:49:43.506 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.505+0000 7fb874891700 1 --2- 172.21.15.96:0/1564001525 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8701375d0 0x7fb87009ab00 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7fb87009a4e0 tx=0x7fb868010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.507 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.505+0000 7fb86cd99700 1 -- 172.21.15.96:0/1564001525 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fb868031e50 con 0x7fb8701375d0 2019-12-05T03:49:43.685 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.685+0000 7fb875092700 1 -- 172.21.15.96:0/1564001525 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd new", "uuid": "86b658b2-8b40-4cea-8163-305a3982758b", "id": 5} v 0) v1 -- 0x7fb8700b3cf0 con 0x7fb8701375d0 2019-12-05T03:49:43.692 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.693+0000 7fb874891700 1 --2- 172.21.15.96:0/1564001525 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8701375d0 0x7fb87009ab00 secure :-1 s=THROTTLE_DONE pgs=21 cs=0 l=1 rx=0x7fb87009a4e0 tx=0x7fb868010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.692 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.693+0000 7fb86cd99700 1 -- 172.21.15.96:0/1564001525 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "86b658b2-8b40-4cea-8163-305a3982758b", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb8680320b0 con 0x7fb8701375d0 2019-12-05T03:49:43.700 INFO:teuthology.orchestra.run.smithi096.stdout:5 2019-12-05T03:49:43.703 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.701+0000 7fb875092700 1 -- 172.21.15.96:0/1564001525 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fb85403acf0 msgr2=0x7fb85403d200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:43.703 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.701+0000 7fb875092700 1 --2- 172.21.15.96:0/1564001525 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fb85403acf0 0x7fb85403d200 crc :-1 s=READY pgs=10 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:43.704 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.701+0000 7fb875092700 1 -- 172.21.15.96:0/1564001525 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8701375d0 msgr2=0x7fb87009ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:43.704 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.701+0000 7fb875092700 1 --2- 172.21.15.96:0/1564001525 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8701375d0 0x7fb87009ab00 secure :-1 s=READY pgs=21 cs=0 l=1 rx=0x7fb87009a4e0 tx=0x7fb868010b50).stop 2019-12-05T03:49:43.704 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.701+0000 7fb875092700 1 -- 172.21.15.96:0/1564001525 shutdown_connections 2019-12-05T03:49:43.704 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.701+0000 7fb875092700 1 --2- 172.21.15.96:0/1564001525 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fb85403acf0 0x7fb85403d200 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:43.704 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.701+0000 7fb875092700 1 --2- 172.21.15.96:0/1564001525 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8701375d0 0x7fb87009ab00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:43.704 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.701+0000 7fb875092700 1 --2- 172.21.15.96:0/1564001525 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb870065120 0x7fb8700b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:43.705 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.701+0000 7fb875092700 1 -- 172.21.15.96:0/1564001525 shutdown_connections 2019-12-05T03:49:43.705 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.701+0000 7fb875092700 1 -- 172.21.15.96:0/1564001525 wait complete. 2019-12-05T03:49:43.705 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.701+0000 7fb875092700 1 -- 172.21.15.96:0/1564001525 >> 172.21.15.96:0/1564001525 conn(0x7fb87007dc50 msgr2=0x7fb87012a490 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:49:43.714 INFO:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd new bdadaea8-9296-4788-bc59-d9c9eb8defdf 6 2019-12-05T03:49:43.810 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.801+0000 7f6d86b6e700 1 Processor -- start 2019-12-05T03:49:43.810 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.805+0000 7f6d86b6e700 1 -- start start 2019-12-05T03:49:43.810 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.805+0000 7f6d86b6e700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d800b6f20 0x7f6d800988e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:43.811 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.805+0000 7f6d86b6e700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d800993b0 con 0x7f6d80098e30 2019-12-05T03:49:43.811 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.805+0000 7f6d86b6e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d80097eb0 con 0x7f6d800969c0 2019-12-05T03:49:43.811 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.805+0000 7f6d86b6e700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d80098230 con 0x7f6d800b6f20 2019-12-05T03:49:43.811 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.805+0000 7f6d8490a700 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f6d80098e30 0x7f6d801550d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:51148/0 (socket says 172.21.15.96:51148) 2019-12-05T03:49:43.811 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.805+0000 7f6d8490a700 1 -- 172.21.15.96:0/1792992307 learned_addr learned my addr 172.21.15.96:0/1792992307 (peer_addr_for_me v1:172.21.15.96:0/0) 2019-12-05T03:49:43.811 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.805+0000 7f6d8510b700 1 --2- 172.21.15.96:0/1792992307 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d800b6f20 0x7f6d800988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:43.812 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.805+0000 7f6d77fff700 1 -- 172.21.15.96:0/1792992307 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3530512801 0 0) 0x7f6d800993b0 con 0x7f6d80098e30 2019-12-05T03:49:43.812 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.805+0000 7f6d77fff700 1 -- 172.21.15.96:0/1792992307 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d6c0030b0 con 0x7f6d80098e30 2019-12-05T03:49:43.812 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.805+0000 7f6d8510b700 1 -- 172.21.15.96:0/1792992307 >> v1:172.21.15.158:6789/0 conn(0x7f6d800969c0 legacy=0x7f6d801558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:43.812 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.805+0000 7f6d8510b700 1 -- 172.21.15.96:0/1792992307 >> v1:172.21.15.96:6789/0 conn(0x7f6d80098e30 legacy=0x7f6d801550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:43.812 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.805+0000 7f6d77fff700 1 -- 172.21.15.96:0/1792992307 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 243773684 0 0) 0x7f6d6c0030b0 con 0x7f6d80098e30 2019-12-05T03:49:43.812 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.805+0000 7f6d8510b700 1 -- 172.21.15.96:0/1792992307 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8007e8c0 con 0x7f6d800b6f20 2019-12-05T03:49:43.812 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.805+0000 7f6d8510b700 1 --2- 172.21.15.96:0/1792992307 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d800b6f20 0x7f6d800988e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6d7c008790 tx=0x7f6d70001990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.813 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.805+0000 7f6d8510b700 1 --2- 172.21.15.96:0/1792992307 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d800b6f20 0x7f6d800988e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6d7c008790 tx=0x7f6d70001990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.813 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.805+0000 7f6d8510b700 1 --2- 172.21.15.96:0/1792992307 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d800b6f20 0x7f6d800988e0 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7f6d7c008790 tx=0x7f6d70001990).ready entity=mon.2 client_cookie=a5da42e6a158d3a server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:43.813 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.805+0000 7f6d8510b700 1 --2- 172.21.15.96:0/1792992307 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d800b6f20 0x7f6d800988e0 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7f6d7c008790 tx=0x7f6d70001990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.813 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.805+0000 7f6d77fff700 1 -- 172.21.15.96:0/1792992307 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d70001750 con 0x7f6d800b6f20 2019-12-05T03:49:43.813 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.805+0000 7f6d8510b700 1 --2- 172.21.15.96:0/1792992307 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d800b6f20 0x7f6d800988e0 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7f6d7c008790 tx=0x7f6d70001990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.813 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.805+0000 7f6d8510b700 1 --2- 172.21.15.96:0/1792992307 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d800b6f20 0x7f6d800988e0 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7f6d7c008790 tx=0x7f6d70001990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.813 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.805+0000 7f6d77fff700 1 -- 172.21.15.96:0/1792992307 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d70001560 con 0x7f6d800b6f20 2019-12-05T03:49:43.814 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.805+0000 7f6d77fff700 1 -- 172.21.15.96:0/1792992307 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d7c011360 con 0x7f6d800b6f20 2019-12-05T03:49:43.814 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.805+0000 7f6d86b6e700 1 -- 172.21.15.96:0/1792992307 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d800b6f20 msgr2=0x7f6d800988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:43.814 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.805+0000 7f6d86b6e700 1 --2- 172.21.15.96:0/1792992307 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d800b6f20 0x7f6d800988e0 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7f6d7c008790 tx=0x7f6d70001990).stop 2019-12-05T03:49:43.814 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.809+0000 7f6d86b6e700 1 -- 172.21.15.96:0/1792992307 shutdown_connections 2019-12-05T03:49:43.814 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.809+0000 7f6d86b6e700 1 --2- 172.21.15.96:0/1792992307 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d800b6f20 0x7f6d800988e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:43.814 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.809+0000 7f6d86b6e700 1 -- 172.21.15.96:0/1792992307 shutdown_connections 2019-12-05T03:49:43.814 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.809+0000 7f6d86b6e700 1 -- 172.21.15.96:0/1792992307 wait complete. 2019-12-05T03:49:43.815 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.809+0000 7f6d86b6e700 1 -- 172.21.15.96:0/1792992307 >> 172.21.15.96:0/1792992307 conn(0x7f6d8005e370 msgr2=0x7f6d800b7370 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:49:43.818 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.813+0000 7f6d86b6e700 1 Processor -- start 2019-12-05T03:49:43.818 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.813+0000 7f6d86b6e700 1 -- start start 2019-12-05T03:49:43.818 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.813+0000 7f6d86b6e700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6d8005fa80 0x7f6d8013af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:43.818 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.813+0000 7f6d86b6e700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d80153aa0 con 0x7f6d80152f60 2019-12-05T03:49:43.819 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.813+0000 7f6d86b6e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d8007bc80 con 0x7f6d80061320 2019-12-05T03:49:43.819 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.813+0000 7f6d86b6e700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d80153560 con 0x7f6d8005fa80 2019-12-05T03:49:43.819 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.813+0000 7f6d8590c700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6d8005fa80 0x7f6d8013af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:43.819 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.813+0000 7f6d8510b700 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f6d80152f60 0x7f6d8007b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:51154/0 (socket says 172.21.15.96:51154) 2019-12-05T03:49:43.819 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.813+0000 7f6d8510b700 1 -- 172.21.15.96:0/2149806680 learned_addr learned my addr 172.21.15.96:0/2149806680 (peer_addr_for_me v1:172.21.15.96:0/0) 2019-12-05T03:49:43.819 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.813+0000 7f6d8590c700 1 -- 172.21.15.96:0/2149806680 >> v1:172.21.15.158:6789/0 conn(0x7f6d80061320 legacy=0x7f6d8013a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:43.821 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.813+0000 7f6d8590c700 1 -- 172.21.15.96:0/2149806680 >> v1:172.21.15.96:6789/0 conn(0x7f6d80152f60 legacy=0x7f6d8007b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:43.821 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.813+0000 7f6d8590c700 1 -- 172.21.15.96:0/2149806680 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8005feb0 con 0x7f6d8005fa80 2019-12-05T03:49:43.822 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.813+0000 7f6d75ffb700 1 -- 172.21.15.96:0/2149806680 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 406077719 0 0) 0x7f6d80153aa0 con 0x7f6d80152f60 2019-12-05T03:49:43.822 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.813+0000 7f6d8590c700 1 --2- 172.21.15.96:0/2149806680 >> v2:172.21.15.96:3300/0 conn(0x7f6d8005fa80 0x7f6d8013af90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6d80154710 tx=0x7f6d78010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.822 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.813+0000 7f6d8590c700 1 --2- 172.21.15.96:0/2149806680 >> v2:172.21.15.96:3300/0 conn(0x7f6d8005fa80 0x7f6d8013af90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6d80154710 tx=0x7f6d78010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.822 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.813+0000 7f6d8590c700 1 --2- 172.21.15.96:0/2149806680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d8005fa80 0x7f6d8013af90 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7f6d80154710 tx=0x7f6d78010ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:43.822 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.813+0000 7f6d8590c700 1 --2- 172.21.15.96:0/2149806680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d8005fa80 0x7f6d8013af90 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f6d80154710 tx=0x7f6d78010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.822 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.813+0000 7f6d75ffb700 1 -- 172.21.15.96:0/2149806680 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d78002240 con 0x7f6d8005fa80 2019-12-05T03:49:43.823 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.813+0000 7f6d8590c700 1 --2- 172.21.15.96:0/2149806680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d8005fa80 0x7f6d8013af90 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f6d80154710 tx=0x7f6d78010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.823 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.813+0000 7f6d8590c700 1 --2- 172.21.15.96:0/2149806680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d8005fa80 0x7f6d8013af90 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f6d80154710 tx=0x7f6d78010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.823 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.813+0000 7f6d75ffb700 1 -- 172.21.15.96:0/2149806680 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d78006ad0 con 0x7f6d8005fa80 2019-12-05T03:49:43.823 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.813+0000 7f6d75ffb700 1 -- 172.21.15.96:0/2149806680 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d78002860 con 0x7f6d8005fa80 2019-12-05T03:49:43.823 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.813+0000 7f6d86b6e700 1 -- 172.21.15.96:0/2149806680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d80065680 con 0x7f6d8005fa80 2019-12-05T03:49:43.823 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.813+0000 7f6d86b6e700 1 -- 172.21.15.96:0/2149806680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d8013b4e0 con 0x7f6d8005fa80 2019-12-05T03:49:43.824 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.817+0000 7f6d8590c700 1 --2- 172.21.15.96:0/2149806680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d8005fa80 0x7f6d8013af90 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f6d80154710 tx=0x7f6d78010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.825 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.817+0000 7f6d75ffb700 1 -- 172.21.15.96:0/2149806680 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f6d78002b70 con 0x7f6d8005fa80 2019-12-05T03:49:43.825 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.817+0000 7f6d8590c700 1 --2- 172.21.15.96:0/2149806680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d8005fa80 0x7f6d8013af90 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f6d80154710 tx=0x7f6d78010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.825 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.817+0000 7f6d75ffb700 1 --2- 172.21.15.96:0/2149806680 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f6d6003ac20 0x7f6d6003d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:43.825 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.817+0000 7f6d75ffb700 1 -- 172.21.15.96:0/2149806680 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7f6d7804b440 con 0x7f6d8005fa80 2019-12-05T03:49:43.825 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.817+0000 7f6d8510b700 1 --2- 172.21.15.96:0/2149806680 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f6d6003ac20 0x7f6d6003d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:43.825 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.817+0000 7f6d8510b700 1 --2- 172.21.15.96:0/2149806680 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f6d6003ac20 0x7f6d6003d130 crc :-1 s=READY pgs=11 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:43.826 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.817+0000 7f6d86b6e700 1 -- 172.21.15.96:0/2149806680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d800554e0 con 0x7f6d8005fa80 2019-12-05T03:49:43.826 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.825+0000 7f6d8590c700 1 --2- 172.21.15.96:0/2149806680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d8005fa80 0x7f6d8013af90 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f6d80154710 tx=0x7f6d78010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:43.827 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.825+0000 7f6d75ffb700 1 -- 172.21.15.96:0/2149806680 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f6d780324c0 con 0x7f6d8005fa80 2019-12-05T03:49:43.995 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:43.997+0000 7f6d86b6e700 1 -- 172.21.15.96:0/2149806680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bdadaea8-9296-4788-bc59-d9c9eb8defdf", "id": 6} v 0) v1 -- 0x7f6d800b3cf0 con 0x7f6d8005fa80 2019-12-05T03:49:44.004 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.005+0000 7f6d8590c700 1 --2- 172.21.15.96:0/2149806680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d8005fa80 0x7f6d8013af90 secure :-1 s=THROTTLE_DONE pgs=24 cs=0 l=1 rx=0x7f6d80154710 tx=0x7f6d78010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:44.004 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.005+0000 7f6d75ffb700 1 -- 172.21.15.96:0/2149806680 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bdadaea8-9296-4788-bc59-d9c9eb8defdf", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6d78032720 con 0x7f6d8005fa80 2019-12-05T03:49:44.011 INFO:teuthology.orchestra.run.smithi096.stdout:6 2019-12-05T03:49:44.014 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.013+0000 7f6d86b6e700 1 -- 172.21.15.96:0/2149806680 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f6d6003ac20 msgr2=0x7f6d6003d130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:44.014 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.013+0000 7f6d86b6e700 1 --2- 172.21.15.96:0/2149806680 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f6d6003ac20 0x7f6d6003d130 crc :-1 s=READY pgs=11 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:44.014 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.013+0000 7f6d86b6e700 1 -- 172.21.15.96:0/2149806680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d8005fa80 msgr2=0x7f6d8013af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:44.014 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.013+0000 7f6d86b6e700 1 --2- 172.21.15.96:0/2149806680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d8005fa80 0x7f6d8013af90 secure :-1 s=READY pgs=24 cs=0 l=1 rx=0x7f6d80154710 tx=0x7f6d78010ac0).stop 2019-12-05T03:49:44.015 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.013+0000 7f6d86b6e700 1 -- 172.21.15.96:0/2149806680 shutdown_connections 2019-12-05T03:49:44.015 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.013+0000 7f6d86b6e700 1 --2- 172.21.15.96:0/2149806680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6d8005fa80 0x7f6d8013af90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:44.015 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.013+0000 7f6d86b6e700 1 --2- 172.21.15.96:0/2149806680 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f6d6003ac20 0x7f6d6003d130 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:44.015 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.013+0000 7f6d86b6e700 1 -- 172.21.15.96:0/2149806680 shutdown_connections 2019-12-05T03:49:44.015 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.013+0000 7f6d86b6e700 1 -- 172.21.15.96:0/2149806680 wait complete. 2019-12-05T03:49:44.015 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.013+0000 7f6d86b6e700 1 -- 172.21.15.96:0/2149806680 >> 172.21.15.96:0/2149806680 conn(0x7f6d80099a90 msgr2=0x7f6d8012c110 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:49:44.025 INFO:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd new c6d71846-d68e-430f-ab72-0fb8ea4bf640 7 2019-12-05T03:49:44.125 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.121+0000 7fa3449b3700 1 Processor -- start 2019-12-05T03:49:44.126 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.121+0000 7fa3449b3700 1 -- start start 2019-12-05T03:49:44.126 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.121+0000 7fa3449b3700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa3400b6f20 0x7fa3400988e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:44.126 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.121+0000 7fa3449b3700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3400969c0 0x7fa34005a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:44.126 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.121+0000 7fa3449b3700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3400993b0 con 0x7fa340098e30 2019-12-05T03:49:44.126 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.121+0000 7fa3449b3700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa340098230 con 0x7fa3400b6f20 2019-12-05T03:49:44.126 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.121+0000 7fa3449b3700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa340097eb0 con 0x7fa3400969c0 2019-12-05T03:49:44.127 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.121+0000 7fa33e59c700 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fa340098e30 0x7fa3401550d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:51162/0 (socket says 172.21.15.96:51162) 2019-12-05T03:49:44.127 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.121+0000 7fa33e59c700 1 -- 172.21.15.96:0/1900465485 learned_addr learned my addr 172.21.15.96:0/1900465485 (peer_addr_for_me v1:172.21.15.96:0/0) 2019-12-05T03:49:44.127 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.121+0000 7fa33f59e700 1 --2- 172.21.15.96:0/1900465485 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3400969c0 0x7fa34005a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:44.127 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.121+0000 7fa33ed9d700 1 --2- 172.21.15.96:0/1900465485 >> v2:172.21.15.158:3300/0 conn(0x7fa3400b6f20 0x7fa3400988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:44.127 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.121+0000 7fa33dd9b700 1 -- 172.21.15.96:0/1900465485 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 100769735 0 0) 0x7fa3400993b0 con 0x7fa340098e30 2019-12-05T03:49:44.127 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.121+0000 7fa33dd9b700 1 -- 172.21.15.96:0/1900465485 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3280030b0 con 0x7fa340098e30 2019-12-05T03:49:44.127 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.121+0000 7fa33f59e700 1 -- 172.21.15.96:0/1900465485 >> v2:172.21.15.158:3300/0 conn(0x7fa3400b6f20 msgr2=0x7fa3400988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:49:44.128 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.121+0000 7fa33f59e700 1 --2- 172.21.15.96:0/1900465485 >> v2:172.21.15.158:3300/0 conn(0x7fa3400b6f20 0x7fa3400988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:49:44.128 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.121+0000 7fa33f59e700 1 -- 172.21.15.96:0/1900465485 >> v1:172.21.15.96:6789/0 conn(0x7fa340098e30 legacy=0x7fa3401550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:44.128 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.121+0000 7fa33f59e700 1 -- 172.21.15.96:0/1900465485 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa34007e8c0 con 0x7fa3400969c0 2019-12-05T03:49:44.128 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.121+0000 7fa33f59e700 1 --2- 172.21.15.96:0/1900465485 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3400969c0 0x7fa34005a580 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa338008b10 tx=0x7fa33800fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:44.128 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.121+0000 7fa33f59e700 1 --2- 172.21.15.96:0/1900465485 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3400969c0 0x7fa34005a580 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa338008b10 tx=0x7fa33800fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:44.128 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.121+0000 7fa33f59e700 1 --2- 172.21.15.96:0/1900465485 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3400969c0 0x7fa34005a580 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7fa338008b10 tx=0x7fa33800fff0).ready entity=mon.2 client_cookie=1a18ac1e2b35b8bd server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:44.128 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.125+0000 7fa33f59e700 1 --2- 172.21.15.96:0/1900465485 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3400969c0 0x7fa34005a580 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7fa338008b10 tx=0x7fa33800fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:44.129 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.125+0000 7fa33f59e700 1 --2- 172.21.15.96:0/1900465485 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3400969c0 0x7fa34005a580 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7fa338008b10 tx=0x7fa33800fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:44.129 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.125+0000 7fa33f59e700 1 --2- 172.21.15.96:0/1900465485 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3400969c0 0x7fa34005a580 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7fa338008b10 tx=0x7fa33800fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:44.129 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.125+0000 7fa33dd9b700 1 -- 172.21.15.96:0/1900465485 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa338011a50 con 0x7fa3400969c0 2019-12-05T03:49:44.129 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.125+0000 7fa33dd9b700 1 -- 172.21.15.96:0/1900465485 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa338011670 con 0x7fa3400969c0 2019-12-05T03:49:44.129 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.125+0000 7fa33dd9b700 1 -- 172.21.15.96:0/1900465485 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa33800a350 con 0x7fa3400969c0 2019-12-05T03:49:44.129 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.125+0000 7fa3449b3700 1 -- 172.21.15.96:0/1900465485 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3400969c0 msgr2=0x7fa34005a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:44.130 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.125+0000 7fa3449b3700 1 --2- 172.21.15.96:0/1900465485 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3400969c0 0x7fa34005a580 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7fa338008b10 tx=0x7fa33800fff0).stop 2019-12-05T03:49:44.130 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.125+0000 7fa3449b3700 1 -- 172.21.15.96:0/1900465485 shutdown_connections 2019-12-05T03:49:44.130 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.125+0000 7fa3449b3700 1 --2- 172.21.15.96:0/1900465485 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3400969c0 0x7fa34005a580 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:44.130 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.125+0000 7fa3449b3700 1 --2- 172.21.15.96:0/1900465485 >> v2:172.21.15.158:3300/0 conn(0x7fa3400b6f20 0x7fa3400988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:49:44.130 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.125+0000 7fa3449b3700 1 -- 172.21.15.96:0/1900465485 shutdown_connections 2019-12-05T03:49:44.130 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.125+0000 7fa3449b3700 1 -- 172.21.15.96:0/1900465485 wait complete. 2019-12-05T03:49:44.130 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.125+0000 7fa3449b3700 1 -- 172.21.15.96:0/1900465485 >> 172.21.15.96:0/1900465485 conn(0x7fa34005e370 msgr2=0x7fa3400b7370 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:49:44.134 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.125+0000 7fa3449b3700 1 Processor -- start 2019-12-05T03:49:44.134 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.125+0000 7fa3449b3700 1 -- start start 2019-12-05T03:49:44.134 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.129+0000 7fa3449b3700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3400b6790 0x7fa34009b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:44.134 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.129+0000 7fa3449b3700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa340152890 con 0x7fa340065490 2019-12-05T03:49:44.134 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.129+0000 7fa3449b3700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa340152ac0 con 0x7fa340151c60 2019-12-05T03:49:44.134 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.129+0000 7fa3449b3700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3401300b0 con 0x7fa3400b6790 2019-12-05T03:49:44.135 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.129+0000 7fa33ed9d700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3400b6790 0x7fa34009b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:44.135 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.129+0000 7fa33ed9d700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3400b6790 0x7fa34009b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.96:37674/0 (socket says 172.21.15.96:37674) 2019-12-05T03:49:44.135 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.129+0000 7fa33ed9d700 1 -- 172.21.15.96:0/3297440908 learned_addr learned my addr 172.21.15.96:0/3297440908 (peer_addr_for_me v2:172.21.15.96:0/0) 2019-12-05T03:49:44.135 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.129+0000 7fa32f7fe700 1 -- 172.21.15.96:0/3297440908 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 494003783 0 0) 0x7fa340152890 con 0x7fa340065490 2019-12-05T03:49:44.135 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.129+0000 7fa33ed9d700 1 -- 172.21.15.96:0/3297440908 >> v1:172.21.15.158:6789/0 conn(0x7fa340151c60 legacy=0x7fa340152090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:44.135 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.129+0000 7fa33ed9d700 1 -- 172.21.15.96:0/3297440908 >> v1:172.21.15.96:6789/0 conn(0x7fa340065490 legacy=0x7fa34012c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:44.135 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.129+0000 7fa33ed9d700 1 -- 172.21.15.96:0/3297440908 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa340153910 con 0x7fa3400b6790 2019-12-05T03:49:44.136 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.129+0000 7fa33ed9d700 1 --2- 172.21.15.96:0/3297440908 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3400b6790 0x7fa34009b810 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa330003070 tx=0x7fa330010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:44.136 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.129+0000 7fa33ed9d700 1 --2- 172.21.15.96:0/3297440908 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3400b6790 0x7fa34009b810 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa330003070 tx=0x7fa330010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:44.136 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.129+0000 7fa33ed9d700 1 --2- 172.21.15.96:0/3297440908 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3400b6790 0x7fa34009b810 secure :-1 s=READY pgs=15 cs=0 l=1 rx=0x7fa330003070 tx=0x7fa330010ae0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:44.136 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.129+0000 7fa33ed9d700 1 --2- 172.21.15.96:0/3297440908 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3400b6790 0x7fa34009b810 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7fa330003070 tx=0x7fa330010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:44.136 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.129+0000 7fa32f7fe700 1 -- 172.21.15.96:0/3297440908 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa330012550 con 0x7fa3400b6790 2019-12-05T03:49:44.137 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.129+0000 7fa33ed9d700 1 --2- 172.21.15.96:0/3297440908 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3400b6790 0x7fa34009b810 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7fa330003070 tx=0x7fa330010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:44.137 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.129+0000 7fa33ed9d700 1 --2- 172.21.15.96:0/3297440908 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3400b6790 0x7fa34009b810 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7fa330003070 tx=0x7fa330010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:44.137 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.129+0000 7fa32f7fe700 1 -- 172.21.15.96:0/3297440908 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa330007150 con 0x7fa3400b6790 2019-12-05T03:49:44.137 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.129+0000 7fa3449b3700 1 -- 172.21.15.96:0/3297440908 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa340152cf0 con 0x7fa3400b6790 2019-12-05T03:49:44.137 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.129+0000 7fa32f7fe700 1 -- 172.21.15.96:0/3297440908 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa330012b70 con 0x7fa3400b6790 2019-12-05T03:49:44.137 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.129+0000 7fa3449b3700 1 -- 172.21.15.96:0/3297440908 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa340145fa0 con 0x7fa3400b6790 2019-12-05T03:49:44.138 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.129+0000 7fa33ed9d700 1 --2- 172.21.15.96:0/3297440908 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3400b6790 0x7fa34009b810 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7fa330003070 tx=0x7fa330010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:44.138 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.133+0000 7fa32f7fe700 1 -- 172.21.15.96:0/3297440908 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fa330005540 con 0x7fa3400b6790 2019-12-05T03:49:44.138 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.133+0000 7fa33ed9d700 1 --2- 172.21.15.96:0/3297440908 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3400b6790 0x7fa34009b810 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7fa330003070 tx=0x7fa330010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:44.138 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.133+0000 7fa32f7fe700 1 --2- 172.21.15.96:0/3297440908 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa32403ac70 0x7fa32403d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:44.138 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.133+0000 7fa32f7fe700 1 -- 172.21.15.96:0/3297440908 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7fa33004afb0 con 0x7fa3400b6790 2019-12-05T03:49:44.138 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.133+0000 7fa33e59c700 1 --2- 172.21.15.96:0/3297440908 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa32403ac70 0x7fa32403d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:44.138 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.133+0000 7fa33e59c700 1 --2- 172.21.15.96:0/3297440908 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa32403ac70 0x7fa32403d180 crc :-1 s=READY pgs=12 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:44.139 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.137+0000 7fa3449b3700 1 -- 172.21.15.96:0/3297440908 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3400554e0 con 0x7fa3400b6790 2019-12-05T03:49:44.142 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.141+0000 7fa33ed9d700 1 --2- 172.21.15.96:0/3297440908 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3400b6790 0x7fa34009b810 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7fa330003070 tx=0x7fa330010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:44.142 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.141+0000 7fa32f7fe700 1 -- 172.21.15.96:0/3297440908 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fa340153910 con 0x7fa3400b6790 2019-12-05T03:49:44.316 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.317+0000 7fa3449b3700 1 -- 172.21.15.96:0/3297440908 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c6d71846-d68e-430f-ab72-0fb8ea4bf640", "id": 7} v 0) v1 -- 0x7fa3400b3cf0 con 0x7fa3400b6790 2019-12-05T03:49:44.323 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.325+0000 7fa33ed9d700 1 --2- 172.21.15.96:0/3297440908 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3400b6790 0x7fa34009b810 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7fa330003070 tx=0x7fa330010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:44.324 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.325+0000 7fa32f7fe700 1 -- 172.21.15.96:0/3297440908 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c6d71846-d68e-430f-ab72-0fb8ea4bf640", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa330032030 con 0x7fa3400b6790 2019-12-05T03:49:44.331 INFO:teuthology.orchestra.run.smithi096.stdout:7 2019-12-05T03:49:44.335 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.333+0000 7fa3449b3700 1 -- 172.21.15.96:0/3297440908 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa32403ac70 msgr2=0x7fa32403d180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:44.335 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.333+0000 7fa3449b3700 1 --2- 172.21.15.96:0/3297440908 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa32403ac70 0x7fa32403d180 crc :-1 s=READY pgs=12 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:44.335 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.333+0000 7fa3449b3700 1 -- 172.21.15.96:0/3297440908 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3400b6790 msgr2=0x7fa34009b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:44.336 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.333+0000 7fa3449b3700 1 --2- 172.21.15.96:0/3297440908 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3400b6790 0x7fa34009b810 secure :-1 s=READY pgs=15 cs=0 l=1 rx=0x7fa330003070 tx=0x7fa330010ae0).stop 2019-12-05T03:49:44.336 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.333+0000 7fa3449b3700 1 -- 172.21.15.96:0/3297440908 shutdown_connections 2019-12-05T03:49:44.336 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.333+0000 7fa3449b3700 1 --2- 172.21.15.96:0/3297440908 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa3400b6790 0x7fa34009b810 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:44.336 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.333+0000 7fa3449b3700 1 --2- 172.21.15.96:0/3297440908 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa32403ac70 0x7fa32403d180 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:44.336 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.333+0000 7fa3449b3700 1 -- 172.21.15.96:0/3297440908 shutdown_connections 2019-12-05T03:49:44.336 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.333+0000 7fa3449b3700 1 -- 172.21.15.96:0/3297440908 wait complete. 2019-12-05T03:49:44.336 INFO:teuthology.orchestra.run.smithi096.stderr:2019-12-05T03:49:44.333+0000 7fa3449b3700 1 -- 172.21.15.96:0/3297440908 >> 172.21.15.96:0/3297440908 conn(0x7fa34007dc50 msgr2=0x7fa3400984d0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:49:44.347 INFO:tasks.ceph.osd.0:Restarting daemon 2019-12-05T03:49:44.348 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2019-12-05T03:49:44.353 INFO:tasks.ceph.osd.0:Started 2019-12-05T03:49:44.353 INFO:tasks.ceph.osd.1:Restarting daemon 2019-12-05T03:49:44.353 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2019-12-05T03:49:44.356 INFO:tasks.ceph.osd.1:Started 2019-12-05T03:49:44.357 INFO:tasks.ceph.osd.2:Restarting daemon 2019-12-05T03:49:44.357 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2019-12-05T03:49:44.360 INFO:tasks.ceph.osd.2:Started 2019-12-05T03:49:44.360 INFO:tasks.ceph.osd.3:Restarting daemon 2019-12-05T03:49:44.361 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2019-12-05T03:49:44.364 INFO:tasks.ceph.osd.3:Started 2019-12-05T03:49:44.365 INFO:tasks.ceph.osd.4:Restarting daemon 2019-12-05T03:49:44.365 INFO:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2019-12-05T03:49:44.369 INFO:tasks.ceph.osd.4:Started 2019-12-05T03:49:44.369 INFO:tasks.ceph.osd.5:Restarting daemon 2019-12-05T03:49:44.369 INFO:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2019-12-05T03:49:44.374 INFO:tasks.ceph.osd.5:Started 2019-12-05T03:49:44.374 INFO:tasks.ceph.osd.6:Restarting daemon 2019-12-05T03:49:44.374 INFO:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2019-12-05T03:49:44.379 INFO:tasks.ceph.osd.6:Started 2019-12-05T03:49:44.379 INFO:tasks.ceph.osd.7:Restarting daemon 2019-12-05T03:49:44.379 INFO:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2019-12-05T03:49:44.383 INFO:tasks.ceph.osd.7:Started 2019-12-05T03:49:44.383 INFO:tasks.ceph:Waiting for OSDs to come up 2019-12-05T03:49:44.701 INFO:tasks.ceph.osd.0.smithi158.stderr:2019-12-05T03:49:44.699+0000 7f4537bdcd80 -1 Falling back to public interface 2019-12-05T03:49:44.709 INFO:tasks.ceph.osd.1.smithi158.stderr:2019-12-05T03:49:44.707+0000 7f3d91bd6d80 -1 Falling back to public interface 2019-12-05T03:49:44.721 INFO:tasks.ceph.osd.4.smithi096.stderr:2019-12-05T03:49:44.721+0000 7f5e27423d80 -1 Falling back to public interface 2019-12-05T03:49:44.953 INFO:tasks.ceph.osd.3.smithi158.stderr:2019-12-05T03:49:44.951+0000 7f2d66599d80 -1 Falling back to public interface 2019-12-05T03:49:44.965 INFO:tasks.ceph.osd.2.smithi158.stderr:2019-12-05T03:49:44.963+0000 7fb538dd4d80 -1 Falling back to public interface 2019-12-05T03:49:44.973 INFO:tasks.ceph.osd.5.smithi096.stderr:2019-12-05T03:49:44.973+0000 7f8aacfe1d80 -1 Falling back to public interface 2019-12-05T03:49:44.985 INFO:tasks.ceph.osd.7.smithi096.stderr:2019-12-05T03:49:44.985+0000 7fe11bfd5d80 -1 Falling back to public interface 2019-12-05T03:49:44.997 INFO:tasks.ceph.osd.6.smithi096.stderr:2019-12-05T03:49:44.997+0000 7faa21c9cd80 -1 Falling back to public interface 2019-12-05T03:49:45.191 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2019-12-05T03:49:45.283 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.275+0000 7fbbf9f69700 1 Processor -- start 2019-12-05T03:49:45.283 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.275+0000 7fbbf9f69700 1 -- start start 2019-12-05T03:49:45.283 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.279+0000 7fbbf9f69700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbbf409cf60 0x7fbbf409a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:45.283 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.279+0000 7fbbf9f69700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbf40accb0 con 0x7fbbf41553b0 2019-12-05T03:49:45.284 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.279+0000 7fbbf9f69700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbf40b6980 con 0x7fbbf405a740 2019-12-05T03:49:45.284 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.279+0000 7fbbf9f69700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf40b1730 con 0x7fbbf409cf60 2019-12-05T03:49:45.284 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.279+0000 7fbbf37fe700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fbbf405a740 0x7fbbf4151460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:47750/0 (socket says 172.21.15.158:47750) 2019-12-05T03:49:45.284 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.279+0000 7fbbf37fe700 1 -- 172.21.15.158:0/3508005750 learned_addr learned my addr 172.21.15.158:0/3508005750 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:49:45.284 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.279+0000 7fbbf3fff700 1 --2- 172.21.15.158:0/3508005750 >> v2:172.21.15.96:3300/0 conn(0x7fbbf409cf60 0x7fbbf409a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:45.284 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.279+0000 7fbbf2ffd700 1 -- 172.21.15.158:0/3508005750 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1559555941 0 0) 0x7fbbf40b6980 con 0x7fbbf405a740 2019-12-05T03:49:45.285 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.279+0000 7fbbf3fff700 1 -- 172.21.15.158:0/3508005750 >> v1:172.21.15.158:6789/0 conn(0x7fbbf405a740 legacy=0x7fbbf4151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:45.285 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.279+0000 7fbbf3fff700 1 -- 172.21.15.158:0/3508005750 >> v1:172.21.15.96:6789/0 conn(0x7fbbf41553b0 legacy=0x7fbbf41557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:45.285 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.279+0000 7fbbf3fff700 1 -- 172.21.15.158:0/3508005750 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf405ab70 con 0x7fbbf409cf60 2019-12-05T03:49:45.285 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.279+0000 7fbbf3fff700 1 --2- 172.21.15.158:0/3508005750 >> v2:172.21.15.96:3300/0 conn(0x7fbbf409cf60 0x7fbbf409a320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbbe4008b10 tx=0x7fbbe400ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:45.285 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.279+0000 7fbbf3fff700 1 --2- 172.21.15.158:0/3508005750 >> v2:172.21.15.96:3300/0 conn(0x7fbbf409cf60 0x7fbbf409a320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbbe4008b10 tx=0x7fbbe400ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:45.285 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.279+0000 7fbbf3fff700 1 --2- 172.21.15.158:0/3508005750 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbf409cf60 0x7fbbf409a320 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7fbbe4008b10 tx=0x7fbbe400ff70).ready entity=mon.0 client_cookie=c6db616dbe488e9e server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:45.285 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.279+0000 7fbbf3fff700 1 --2- 172.21.15.158:0/3508005750 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbf409cf60 0x7fbbf409a320 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7fbbe4008b10 tx=0x7fbbe400ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:45.286 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.279+0000 7fbbf2ffd700 1 -- 172.21.15.158:0/3508005750 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbe4011990 con 0x7fbbf409cf60 2019-12-05T03:49:45.286 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.279+0000 7fbbf3fff700 1 --2- 172.21.15.158:0/3508005750 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbf409cf60 0x7fbbf409a320 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7fbbe4008b10 tx=0x7fbbe400ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:45.286 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.279+0000 7fbbf2ffd700 1 -- 172.21.15.158:0/3508005750 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe40115b0 con 0x7fbbf409cf60 2019-12-05T03:49:45.286 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.279+0000 7fbbf3fff700 1 --2- 172.21.15.158:0/3508005750 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbf409cf60 0x7fbbf409a320 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7fbbe4008b10 tx=0x7fbbe400ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:45.286 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.279+0000 7fbbf2ffd700 1 -- 172.21.15.158:0/3508005750 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbe400a160 con 0x7fbbf409cf60 2019-12-05T03:49:45.286 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.279+0000 7fbbf9f69700 1 -- 172.21.15.158:0/3508005750 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbf409cf60 msgr2=0x7fbbf409a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:45.287 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.279+0000 7fbbf9f69700 1 --2- 172.21.15.158:0/3508005750 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbf409cf60 0x7fbbf409a320 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7fbbe4008b10 tx=0x7fbbe400ff70).stop 2019-12-05T03:49:45.287 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.279+0000 7fbbf9f69700 1 -- 172.21.15.158:0/3508005750 shutdown_connections 2019-12-05T03:49:45.287 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.279+0000 7fbbf9f69700 1 --2- 172.21.15.158:0/3508005750 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbf409cf60 0x7fbbf409a320 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:45.287 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.279+0000 7fbbf9f69700 1 -- 172.21.15.158:0/3508005750 shutdown_connections 2019-12-05T03:49:45.287 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.279+0000 7fbbf9f69700 1 -- 172.21.15.158:0/3508005750 wait complete. 2019-12-05T03:49:45.288 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.279+0000 7fbbf9f69700 1 -- 172.21.15.158:0/3508005750 >> 172.21.15.158:0/3508005750 conn(0x7fbbf40b7e60 msgr2=0x7fbbf40b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:49:45.291 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.283+0000 7fbbf9f69700 1 Processor -- start 2019-12-05T03:49:45.292 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.283+0000 7fbbf9f69700 1 -- start start 2019-12-05T03:49:45.292 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.283+0000 7fbbf9f69700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbbf40ad240 0x7fbbf40ad670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:45.292 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.283+0000 7fbbf9f69700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbf412e580 0x7fbbf412e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:45.292 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.283+0000 7fbbf9f69700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbf4064d90 con 0x7fbbf40b3070 2019-12-05T03:49:45.292 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.283+0000 7fbbf9f69700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf4154cf0 con 0x7fbbf40ad240 2019-12-05T03:49:45.293 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.283+0000 7fbbf9f69700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf413bda0 con 0x7fbbf412e580 2019-12-05T03:49:45.293 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.283+0000 7fbbf3fff700 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fbbf40b3070 0x7fbbf4154320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.158:42888/0 (socket says 172.21.15.158:42888) 2019-12-05T03:49:45.293 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.283+0000 7fbbf3fff700 1 -- 172.21.15.158:0/3605884116 learned_addr learned my addr 172.21.15.158:0/3605884116 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:49:45.293 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.283+0000 7fbbf8d07700 1 --2- 172.21.15.158:0/3605884116 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbf412e580 0x7fbbf412e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:45.293 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.283+0000 7fbbf37fe700 1 --2- 172.21.15.158:0/3605884116 >> v2:172.21.15.96:3300/0 conn(0x7fbbf40ad240 0x7fbbf40ad670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:45.294 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.287+0000 7fbbf0ff9700 1 -- 172.21.15.158:0/3605884116 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2647661483 0 0) 0x7fbbf4064d90 con 0x7fbbf40b3070 2019-12-05T03:49:45.294 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.287+0000 7fbbf0ff9700 1 -- 172.21.15.158:0/3605884116 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbd80030b0 con 0x7fbbf40b3070 2019-12-05T03:49:45.294 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.287+0000 7fbbf8d07700 1 -- 172.21.15.158:0/3605884116 >> v2:172.21.15.96:3300/0 conn(0x7fbbf40ad240 msgr2=0x7fbbf40ad670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:45.294 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.287+0000 7fbbf8d07700 1 --2- 172.21.15.158:0/3605884116 >> v2:172.21.15.96:3300/0 conn(0x7fbbf40ad240 0x7fbbf40ad670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:45.294 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.287+0000 7fbbf8d07700 1 -- 172.21.15.158:0/3605884116 >> v1:172.21.15.96:6789/0 conn(0x7fbbf40b3070 legacy=0x7fbbf4154320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:45.294 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.287+0000 7fbbf8d07700 1 -- 172.21.15.158:0/3605884116 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf40b34a0 con 0x7fbbf412e580 2019-12-05T03:49:45.294 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.287+0000 7fbbf8d07700 1 --2- 172.21.15.158:0/3605884116 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbf412e580 0x7fbbf412e9b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbbec000b80 tx=0x7fbbec010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:45.295 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.287+0000 7fbbf8d07700 1 --2- 172.21.15.158:0/3605884116 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbf412e580 0x7fbbf412e9b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbbec000b80 tx=0x7fbbec010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:45.295 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.287+0000 7fbbf8d07700 1 --2- 172.21.15.158:0/3605884116 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbf412e580 0x7fbbf412e9b0 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7fbbec000b80 tx=0x7fbbec010780).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:45.295 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.287+0000 7fbbf8d07700 1 --2- 172.21.15.158:0/3605884116 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbf412e580 0x7fbbf412e9b0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fbbec000b80 tx=0x7fbbec010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:45.295 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.287+0000 7fbbf0ff9700 1 -- 172.21.15.158:0/3605884116 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbec006a40 con 0x7fbbf412e580 2019-12-05T03:49:45.295 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.287+0000 7fbbf8d07700 1 --2- 172.21.15.158:0/3605884116 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbf412e580 0x7fbbf412e9b0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fbbec000b80 tx=0x7fbbec010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:45.295 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.287+0000 7fbbf8d07700 1 --2- 172.21.15.158:0/3605884116 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbf412e580 0x7fbbf412e9b0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fbbec000b80 tx=0x7fbbec010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:45.296 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.287+0000 7fbbf0ff9700 1 -- 172.21.15.158:0/3605884116 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbec006660 con 0x7fbbf412e580 2019-12-05T03:49:45.296 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.287+0000 7fbbf9f69700 1 -- 172.21.15.158:0/3605884116 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbf412ef00 con 0x7fbbf412e580 2019-12-05T03:49:45.296 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.287+0000 7fbbf0ff9700 1 -- 172.21.15.158:0/3605884116 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbec010fc0 con 0x7fbbf412e580 2019-12-05T03:49:45.296 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.287+0000 7fbbf9f69700 1 -- 172.21.15.158:0/3605884116 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbf40ac4f0 con 0x7fbbf412e580 2019-12-05T03:49:45.296 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.287+0000 7fbbf8d07700 1 --2- 172.21.15.158:0/3605884116 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbf412e580 0x7fbbf412e9b0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fbbec000b80 tx=0x7fbbec010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:45.296 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.287+0000 7fbbf8d07700 1 --2- 172.21.15.158:0/3605884116 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbf412e580 0x7fbbf412e9b0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fbbec000b80 tx=0x7fbbec010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:45.296 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.287+0000 7fbbf0ff9700 1 -- 172.21.15.158:0/3605884116 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fbbec0112d0 con 0x7fbbf412e580 2019-12-05T03:49:45.297 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.287+0000 7fbbf0ff9700 1 --2- 172.21.15.158:0/3605884116 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fbbd803b250 0x7fbbd803d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:45.297 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.287+0000 7fbbf0ff9700 1 -- 172.21.15.158:0/3605884116 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7fbbec04af90 con 0x7fbbf412e580 2019-12-05T03:49:45.297 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.287+0000 7fbbf3fff700 1 --2- 172.21.15.158:0/3605884116 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fbbd803b250 0x7fbbd803d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:45.297 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.287+0000 7fbbf3fff700 1 --2- 172.21.15.158:0/3605884116 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fbbd803b250 0x7fbbd803d760 crc :-1 s=READY pgs=13 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:45.309 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.291+0000 7fbbf9f69700 1 -- 172.21.15.158:0/3605884116 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbf40554e0 con 0x7fbbf412e580 2019-12-05T03:49:45.309 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.303+0000 7fbbf8d07700 1 --2- 172.21.15.158:0/3605884116 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbf412e580 0x7fbbf412e9b0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fbbec000b80 tx=0x7fbbec010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:45.309 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.303+0000 7fbbf0ff9700 1 -- 172.21.15.158:0/3605884116 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fbbec032010 con 0x7fbbf412e580 2019-12-05T03:49:45.466 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.463+0000 7fbbf9f69700 1 -- 172.21.15.158:0/3605884116 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbbf4066940 con 0x7fbbf412e580 2019-12-05T03:49:45.467 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.463+0000 7fbbf8d07700 1 --2- 172.21.15.158:0/3605884116 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbf412e580 0x7fbbf412e9b0 secure :-1 s=THROTTLE_DONE pgs=23 cs=0 l=1 rx=0x7fbbec000b80 tx=0x7fbbec010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:45.467 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.467+0000 7fbbf0ff9700 1 -- 172.21.15.158:0/3605884116 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+6849 (secure 0 0 0) 0x7fbbec032270 con 0x7fbbf412e580 2019-12-05T03:49:45.469 INFO:teuthology.misc.health.smithi158.stdout: 2019-12-05T03:49:45.469 INFO:teuthology.misc.health.smithi158.stdout:{"epoch":10,"fsid":"a91186ae-f496-4de1-918d-820c55ff1feb","created":"2019-12-05T03:49:39.187523+0000","modified":"2019-12-05T03:49:44.319127+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"782c4258-e28c-4a11-9d54-3c9c7a36fba6","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d4426b21-b666-4158-bf34-a24b14572731","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"22680edd-6490-4ab0-bb15-0605830e4cfb","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7ec999ee-ace8-4ccb-a4f9-6f5d313bbbd2","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"186e69c4-b69f-4dd1-bb8f-faf759c60484","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"86b658b2-8b40-4cea-8163-305a3982758b","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"bdadaea8-9296-4788-bc59-d9c9eb8defdf","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c6d71846-d68e-430f-ab72-0fb8ea4bf640","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-05T03:49:45.471 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.467+0000 7fbbf9f69700 1 -- 172.21.15.158:0/3605884116 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fbbd803b250 msgr2=0x7fbbd803d760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:45.472 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.467+0000 7fbbf9f69700 1 --2- 172.21.15.158:0/3605884116 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fbbd803b250 0x7fbbd803d760 crc :-1 s=READY pgs=13 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:45.472 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.467+0000 7fbbf9f69700 1 -- 172.21.15.158:0/3605884116 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbf412e580 msgr2=0x7fbbf412e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:45.472 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.467+0000 7fbbf9f69700 1 --2- 172.21.15.158:0/3605884116 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbf412e580 0x7fbbf412e9b0 secure :-1 s=READY pgs=23 cs=0 l=1 rx=0x7fbbec000b80 tx=0x7fbbec010780).stop 2019-12-05T03:49:45.472 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.467+0000 7fbbf9f69700 1 -- 172.21.15.158:0/3605884116 shutdown_connections 2019-12-05T03:49:45.472 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.467+0000 7fbbf9f69700 1 --2- 172.21.15.158:0/3605884116 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbbf412e580 0x7fbbf412e9b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:45.472 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.467+0000 7fbbf9f69700 1 --2- 172.21.15.158:0/3605884116 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fbbd803b250 0x7fbbd803d760 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:45.472 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.467+0000 7fbbf9f69700 1 --2- 172.21.15.158:0/3605884116 >> v2:172.21.15.96:3300/0 conn(0x7fbbf40ad240 0x7fbbf40ad670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:45.473 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.471+0000 7fbbf9f69700 1 -- 172.21.15.158:0/3605884116 shutdown_connections 2019-12-05T03:49:45.473 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.471+0000 7fbbf9f69700 1 -- 172.21.15.158:0/3605884116 wait complete. 2019-12-05T03:49:45.473 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:45.471+0000 7fbbf9f69700 1 -- 172.21.15.158:0/3605884116 >> 172.21.15.158:0/3605884116 conn(0x7fbbf40b7e60 msgr2=0x7fbbf409ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:49:45.481 DEBUG:teuthology.misc:0 of 8 OSDs are up 2019-12-05T03:49:45.896 INFO:tasks.ceph.osd.0.smithi158.stderr:2019-12-05T03:49:45.895+0000 7f4537bdcd80 -1 osd.0 0 log_to_monitors {default=true} 2019-12-05T03:49:45.897 INFO:tasks.ceph.osd.4.smithi096.stderr:2019-12-05T03:49:45.897+0000 7f5e27423d80 -1 osd.4 0 log_to_monitors {default=true} 2019-12-05T03:49:45.901 INFO:tasks.ceph.osd.1.smithi158.stderr:2019-12-05T03:49:45.899+0000 7f3d91bd6d80 -1 osd.1 0 log_to_monitors {default=true} 2019-12-05T03:49:46.129 INFO:tasks.ceph.osd.5.smithi096.stderr:2019-12-05T03:49:46.129+0000 7f8aacfe1d80 -1 osd.5 0 log_to_monitors {default=true} 2019-12-05T03:49:46.145 INFO:tasks.ceph.osd.7.smithi096.stderr:2019-12-05T03:49:46.145+0000 7fe11bfd5d80 -1 osd.7 0 log_to_monitors {default=true} 2019-12-05T03:49:46.155 INFO:tasks.ceph.osd.3.smithi158.stderr:2019-12-05T03:49:46.151+0000 7f2d66599d80 -1 osd.3 0 log_to_monitors {default=true} 2019-12-05T03:49:46.197 INFO:tasks.ceph.osd.2.smithi158.stderr:2019-12-05T03:49:46.187+0000 7fb538dd4d80 -1 osd.2 0 log_to_monitors {default=true} 2019-12-05T03:49:46.230 INFO:tasks.ceph.osd.6.smithi096.stderr:2019-12-05T03:49:46.229+0000 7faa21c9cd80 -1 osd.6 0 log_to_monitors {default=true} 2019-12-05T03:49:47.555 INFO:tasks.ceph.osd.7.smithi096.stderr:2019-12-05T03:49:47.553+0000 7fe105207700 -1 osd.7 0 waiting for initial osdmap 2019-12-05T03:49:47.555 INFO:tasks.ceph.osd.4.smithi096.stderr:2019-12-05T03:49:47.553+0000 7f5e10655700 -1 osd.4 0 waiting for initial osdmap 2019-12-05T03:49:47.556 INFO:tasks.ceph.osd.1.smithi158.stderr:2019-12-05T03:49:47.555+0000 7f3d7ae08700 -1 osd.1 0 waiting for initial osdmap 2019-12-05T03:49:47.556 INFO:tasks.ceph.osd.0.smithi158.stderr:2019-12-05T03:49:47.555+0000 7f4520e0e700 -1 osd.0 0 waiting for initial osdmap 2019-12-05T03:49:47.557 INFO:tasks.ceph.osd.2.smithi158.stderr:2019-12-05T03:49:47.555+0000 7fb522006700 -1 osd.2 0 waiting for initial osdmap 2019-12-05T03:49:47.557 INFO:tasks.ceph.osd.3.smithi158.stderr:2019-12-05T03:49:47.555+0000 7f2d4f7cb700 -1 osd.3 0 waiting for initial osdmap 2019-12-05T03:49:47.557 INFO:tasks.ceph.osd.6.smithi096.stderr:2019-12-05T03:49:47.557+0000 7faa0aece700 -1 osd.6 0 waiting for initial osdmap 2019-12-05T03:49:47.559 INFO:tasks.ceph.osd.5.smithi096.stderr:2019-12-05T03:49:47.561+0000 7f8a96213700 -1 osd.5 0 waiting for initial osdmap 2019-12-05T03:49:52.289 INFO:teuthology.orchestra.run.smithi158:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2019-12-05T03:49:52.384 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.375+0000 7fd2ece0e700 1 Processor -- start 2019-12-05T03:49:52.385 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.375+0000 7fd2ece0e700 1 -- start start 2019-12-05T03:49:52.385 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.375+0000 7fd2ece0e700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd2e809cf60 0x7fd2e809a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:52.385 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.375+0000 7fd2ece0e700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd2e81553b0 0x7fd2e81557e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:52.385 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.375+0000 7fd2ece0e700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e80accb0 con 0x7fd2e805a740 2019-12-05T03:49:52.385 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.375+0000 7fd2ece0e700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2e80b1730 con 0x7fd2e81553b0 2019-12-05T03:49:52.386 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.375+0000 7fd2ece0e700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e80b19d0 con 0x7fd2e809cf60 2019-12-05T03:49:52.386 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.375+0000 7fd2e759e700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd2e81553b0 0x7fd2e81557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:52.386 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.375+0000 7fd2e6d9d700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd2e809cf60 0x7fd2e809a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:52.386 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.375+0000 7fd2e759e700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd2e81553b0 0x7fd2e81557e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.158:39792/0 (socket says 172.21.15.158:39792) 2019-12-05T03:49:52.386 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.375+0000 7fd2e759e700 1 -- 172.21.15.158:0/3822375689 learned_addr learned my addr 172.21.15.158:0/3822375689 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:49:52.386 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.379+0000 7fd2e759e700 1 -- 172.21.15.158:0/3822375689 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd2e809cf60 msgr2=0x7fd2e809a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:49:52.386 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.379+0000 7fd2e759e700 1 --2- 172.21.15.158:0/3822375689 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd2e809cf60 0x7fd2e809a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:49:52.387 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.379+0000 7fd2e759e700 1 -- 172.21.15.158:0/3822375689 >> v1:172.21.15.96:6789/0 conn(0x7fd2e805a740 legacy=0x7fd2e8151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:52.387 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.379+0000 7fd2e759e700 1 -- 172.21.15.158:0/3822375689 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e805ab70 con 0x7fd2e81553b0 2019-12-05T03:49:52.387 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.379+0000 7fd2e759e700 1 --2- 172.21.15.158:0/3822375689 >> v2:172.21.15.96:3300/0 conn(0x7fd2e81553b0 0x7fd2e81557e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd2e80b18f0 tx=0x7fd2e000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:52.387 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.379+0000 7fd2e759e700 1 --2- 172.21.15.158:0/3822375689 >> v2:172.21.15.96:3300/0 conn(0x7fd2e81553b0 0x7fd2e81557e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd2e80b18f0 tx=0x7fd2e000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:52.387 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.379+0000 7fd2e759e700 1 --2- 172.21.15.158:0/3822375689 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2e81553b0 0x7fd2e81557e0 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7fd2e80b18f0 tx=0x7fd2e000fd30).ready entity=mon.0 client_cookie=9c0f24db5c3f6592 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:52.387 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.379+0000 7fd2e759e700 1 --2- 172.21.15.158:0/3822375689 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2e81553b0 0x7fd2e81557e0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fd2e80b18f0 tx=0x7fd2e000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:52.388 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.379+0000 7fd2e759e700 1 --2- 172.21.15.158:0/3822375689 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2e81553b0 0x7fd2e81557e0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fd2e80b18f0 tx=0x7fd2e000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:52.388 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.379+0000 7fd2e5d9b700 1 -- 172.21.15.158:0/3822375689 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2e00113b0 con 0x7fd2e81553b0 2019-12-05T03:49:52.388 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.379+0000 7fd2e759e700 1 --2- 172.21.15.158:0/3822375689 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2e81553b0 0x7fd2e81557e0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fd2e80b18f0 tx=0x7fd2e000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:52.388 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.379+0000 7fd2e5d9b700 1 -- 172.21.15.158:0/3822375689 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e0008bb0 con 0x7fd2e81553b0 2019-12-05T03:49:52.388 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.379+0000 7fd2e5d9b700 1 -- 172.21.15.158:0/3822375689 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2e0011990 con 0x7fd2e81553b0 2019-12-05T03:49:52.388 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.379+0000 7fd2ece0e700 1 -- 172.21.15.158:0/3822375689 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2e81553b0 msgr2=0x7fd2e81557e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:52.388 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.379+0000 7fd2ece0e700 1 --2- 172.21.15.158:0/3822375689 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2e81553b0 0x7fd2e81557e0 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7fd2e80b18f0 tx=0x7fd2e000fd30).stop 2019-12-05T03:49:52.389 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.379+0000 7fd2ece0e700 1 -- 172.21.15.158:0/3822375689 shutdown_connections 2019-12-05T03:49:52.389 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.379+0000 7fd2ece0e700 1 --2- 172.21.15.158:0/3822375689 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2e81553b0 0x7fd2e81557e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:52.389 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.379+0000 7fd2ece0e700 1 --2- 172.21.15.158:0/3822375689 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd2e809cf60 0x7fd2e809a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:49:52.389 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.379+0000 7fd2ece0e700 1 -- 172.21.15.158:0/3822375689 shutdown_connections 2019-12-05T03:49:52.389 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.379+0000 7fd2ece0e700 1 -- 172.21.15.158:0/3822375689 wait complete. 2019-12-05T03:49:52.389 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.379+0000 7fd2ece0e700 1 -- 172.21.15.158:0/3822375689 >> 172.21.15.158:0/3822375689 conn(0x7fd2e80b7e60 msgr2=0x7fd2e80b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:49:52.389 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.383+0000 7fd2ece0e700 1 Processor -- start 2019-12-05T03:49:52.390 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.383+0000 7fd2ece0e700 1 -- start start 2019-12-05T03:49:52.393 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.383+0000 7fd2ece0e700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd2e812b680 0x7fd2e80ada40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:52.393 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.383+0000 7fd2ece0e700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e813d6d0 con 0x7fd2e813d2a0 2019-12-05T03:49:52.394 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.383+0000 7fd2ece0e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e812bab0 con 0x7fd2e81533e0 2019-12-05T03:49:52.394 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.383+0000 7fd2ece0e700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e813e190 con 0x7fd2e812b680 2019-12-05T03:49:52.394 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.383+0000 7fd2e6d9d700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fd2e81533e0 0x7fd2e807b060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:47986/0 (socket says 172.21.15.158:47986) 2019-12-05T03:49:52.394 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.383+0000 7fd2e6d9d700 1 -- 172.21.15.158:0/3115131707 learned_addr learned my addr 172.21.15.158:0/3115131707 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:49:52.394 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.383+0000 7fd2e759e700 1 --2- 172.21.15.158:0/3115131707 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd2e812b680 0x7fd2e80ada40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:52.394 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.383+0000 7fd2d77fe700 1 -- 172.21.15.158:0/3115131707 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1225326410 0 0) 0x7fd2e812bab0 con 0x7fd2e81533e0 2019-12-05T03:49:52.394 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.387+0000 7fd2d77fe700 1 -- 172.21.15.158:0/3115131707 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2cc0030b0 con 0x7fd2e81533e0 2019-12-05T03:49:52.395 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.387+0000 7fd2d77fe700 1 -- 172.21.15.158:0/3115131707 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4064552399 0 0) 0x7fd2e80accb0 con 0x7fd2e813d2a0 2019-12-05T03:49:52.395 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.387+0000 7fd2d77fe700 1 -- 172.21.15.158:0/3115131707 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2e812bab0 con 0x7fd2e813d2a0 2019-12-05T03:49:52.395 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.387+0000 7fd2e759e700 1 -- 172.21.15.158:0/3115131707 >> v1:172.21.15.158:6789/0 conn(0x7fd2e81533e0 legacy=0x7fd2e807b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:52.395 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.387+0000 7fd2d77fe700 1 -- 172.21.15.158:0/3115131707 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3701849124 0 0) 0x7fd2cc0030b0 con 0x7fd2e81533e0 2019-12-05T03:49:52.395 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.387+0000 7fd2e759e700 1 -- 172.21.15.158:0/3115131707 >> v1:172.21.15.96:6789/0 conn(0x7fd2e813d2a0 legacy=0x7fd2e80ad240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:52.395 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.387+0000 7fd2e759e700 1 -- 172.21.15.158:0/3115131707 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e807b860 con 0x7fd2e812b680 2019-12-05T03:49:52.395 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.387+0000 7fd2e759e700 1 --2- 172.21.15.158:0/3115131707 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd2e812b680 0x7fd2e80ada40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd2d8007c80 tx=0x7fd2d80032f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:52.396 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.387+0000 7fd2e759e700 1 --2- 172.21.15.158:0/3115131707 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd2e812b680 0x7fd2e80ada40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd2d8007c80 tx=0x7fd2d80032f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:52.396 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.387+0000 7fd2e759e700 1 --2- 172.21.15.158:0/3115131707 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd2e812b680 0x7fd2e80ada40 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7fd2d8007c80 tx=0x7fd2d80032f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:52.396 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.387+0000 7fd2e759e700 1 --2- 172.21.15.158:0/3115131707 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd2e812b680 0x7fd2e80ada40 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7fd2d8007c80 tx=0x7fd2d80032f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:52.396 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.387+0000 7fd2e759e700 1 --2- 172.21.15.158:0/3115131707 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd2e812b680 0x7fd2e80ada40 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7fd2d8007c80 tx=0x7fd2d80032f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:52.396 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.387+0000 7fd2d77fe700 1 -- 172.21.15.158:0/3115131707 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2d8001810 con 0x7fd2e812b680 2019-12-05T03:49:52.396 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.387+0000 7fd2e759e700 1 --2- 172.21.15.158:0/3115131707 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd2e812b680 0x7fd2e80ada40 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7fd2d8007c80 tx=0x7fd2d80032f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:52.397 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.387+0000 7fd2d77fe700 1 -- 172.21.15.158:0/3115131707 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d8001620 con 0x7fd2e812b680 2019-12-05T03:49:52.397 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.387+0000 7fd2ece0e700 1 -- 172.21.15.158:0/3115131707 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e80adf90 con 0x7fd2e812b680 2019-12-05T03:49:52.397 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.387+0000 7fd2d77fe700 1 -- 172.21.15.158:0/3115131707 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2e0007340 con 0x7fd2e812b680 2019-12-05T03:49:52.397 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.387+0000 7fd2ece0e700 1 -- 172.21.15.158:0/3115131707 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e8139ce0 con 0x7fd2e812b680 2019-12-05T03:49:52.397 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.387+0000 7fd2e759e700 1 --2- 172.21.15.158:0/3115131707 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd2e812b680 0x7fd2e80ada40 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7fd2d8007c80 tx=0x7fd2d80032f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:52.397 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.387+0000 7fd2d77fe700 1 -- 172.21.15.158:0/3115131707 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fd2e000f360 con 0x7fd2e812b680 2019-12-05T03:49:52.397 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.387+0000 7fd2e759e700 1 --2- 172.21.15.158:0/3115131707 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd2e812b680 0x7fd2e80ada40 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7fd2d8007c80 tx=0x7fd2d80032f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:52.398 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.387+0000 7fd2d77fe700 1 --2- 172.21.15.158:0/3115131707 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd2cc03b3f0 0x7fd2cc03d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:52.398 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.387+0000 7fd2d77fe700 1 -- 172.21.15.158:0/3115131707 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4500+0+0 (secure 0 0 0) 0x7fd2e004ac80 con 0x7fd2e812b680 2019-12-05T03:49:52.398 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.387+0000 7fd2e6d9d700 1 --2- 172.21.15.158:0/3115131707 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd2cc03b3f0 0x7fd2cc03d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:52.398 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.391+0000 7fd2e6d9d700 1 --2- 172.21.15.158:0/3115131707 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd2cc03b3f0 0x7fd2cc03d900 crc :-1 s=READY pgs=38 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:52.398 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.391+0000 7fd2ece0e700 1 -- 172.21.15.158:0/3115131707 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2e80554e0 con 0x7fd2e812b680 2019-12-05T03:49:52.401 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.399+0000 7fd2e759e700 1 --2- 172.21.15.158:0/3115131707 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd2e812b680 0x7fd2e80ada40 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7fd2d8007c80 tx=0x7fd2d80032f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:52.401 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.399+0000 7fd2d77fe700 1 -- 172.21.15.158:0/3115131707 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fd2e000f670 con 0x7fd2e812b680 2019-12-05T03:49:52.570 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.567+0000 7fd2ece0e700 1 -- 172.21.15.158:0/3115131707 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2e8066940 con 0x7fd2e812b680 2019-12-05T03:49:52.571 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.571+0000 7fd2e759e700 1 --2- 172.21.15.158:0/3115131707 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd2e812b680 0x7fd2e80ada40 secure :-1 s=THROTTLE_DONE pgs=26 cs=0 l=1 rx=0x7fd2d8007c80 tx=0x7fd2d80032f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:52.572 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.571+0000 7fd2d77fe700 1 -- 172.21.15.158:0/3115131707 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10439 (secure 0 0 0) 0x7fd2e002f920 con 0x7fd2e812b680 2019-12-05T03:49:52.573 INFO:teuthology.misc.health.smithi158.stdout: 2019-12-05T03:49:52.573 INFO:teuthology.misc.health.smithi158.stdout:{"epoch":14,"fsid":"a91186ae-f496-4de1-918d-820c55ff1feb","created":"2019-12-05T03:49:39.187523+0000","modified":"2019-12-05T03:49:49.565780+0000","last_up_change":"2019-12-05T03:49:48.551934+0000","last_in_change":"2019-12-05T03:49:48.551934+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"782c4258-e28c-4a11-9d54-3c9c7a36fba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":12192},{"type":"v1","addr":"172.21.15.158:6801","nonce":12192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":12192},{"type":"v1","addr":"172.21.15.158:6803","nonce":12192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":12192},{"type":"v1","addr":"172.21.15.158:6807","nonce":12192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":12192},{"type":"v1","addr":"172.21.15.158:6805","nonce":12192}]},"public_addr":"172.21.15.158:6801/12192","cluster_addr":"172.21.15.158:6803/12192","heartbeat_back_addr":"172.21.15.158:6807/12192","heartbeat_front_addr":"172.21.15.158:6805/12192","state":["exists","up"]},{"osd":1,"uuid":"d4426b21-b666-4158-bf34-a24b14572731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":12193},{"type":"v1","addr":"172.21.15.158:6809","nonce":12193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":12193},{"type":"v1","addr":"172.21.15.158:6811","nonce":12193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":12193},{"type":"v1","addr":"172.21.15.158:6815","nonce":12193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":12193},{"type":"v1","addr":"172.21.15.158:6813","nonce":12193}]},"public_addr":"172.21.15.158:6809/12193","cluster_addr":"172.21.15.158:6811/12193","heartbeat_back_addr":"172.21.15.158:6815/12193","heartbeat_front_addr":"172.21.15.158:6813/12193","state":["exists","up"]},{"osd":2,"uuid":"22680edd-6490-4ab0-bb15-0605830e4cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":12195},{"type":"v1","addr":"172.21.15.158:6825","nonce":12195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":12195},{"type":"v1","addr":"172.21.15.158:6827","nonce":12195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":12195},{"type":"v1","addr":"172.21.15.158:6831","nonce":12195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":12195},{"type":"v1","addr":"172.21.15.158:6829","nonce":12195}]},"public_addr":"172.21.15.158:6825/12195","cluster_addr":"172.21.15.158:6827/12195","heartbeat_back_addr":"172.21.15.158:6831/12195","heartbeat_front_addr":"172.21.15.158:6829/12195","state":["exists","up"]},{"osd":3,"uuid":"7ec999ee-ace8-4ccb-a4f9-6f5d313bbbd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":12194},{"type":"v1","addr":"172.21.15.158:6817","nonce":12194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":12194},{"type":"v1","addr":"172.21.15.158:6819","nonce":12194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":12194},{"type":"v1","addr":"172.21.15.158:6823","nonce":12194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":12194},{"type":"v1","addr":"172.21.15.158:6821","nonce":12194}]},"public_addr":"172.21.15.158:6817/12194","cluster_addr":"172.21.15.158:6819/12194","heartbeat_back_addr":"172.21.15.158:6823/12194","heartbeat_front_addr":"172.21.15.158:6821/12194","state":["exists","up"]},{"osd":4,"uuid":"186e69c4-b69f-4dd1-bb8f-faf759c60484","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":12460},{"type":"v1","addr":"172.21.15.96:6803","nonce":12460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":12460},{"type":"v1","addr":"172.21.15.96:6805","nonce":12460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":12460},{"type":"v1","addr":"172.21.15.96:6809","nonce":12460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":12460},{"type":"v1","addr":"172.21.15.96:6807","nonce":12460}]},"public_addr":"172.21.15.96:6803/12460","cluster_addr":"172.21.15.96:6805/12460","heartbeat_back_addr":"172.21.15.96:6809/12460","heartbeat_front_addr":"172.21.15.96:6807/12460","state":["exists","up"]},{"osd":5,"uuid":"86b658b2-8b40-4cea-8163-305a3982758b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":12461},{"type":"v1","addr":"172.21.15.96:6811","nonce":12461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":12461},{"type":"v1","addr":"172.21.15.96:6813","nonce":12461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":12461},{"type":"v1","addr":"172.21.15.96:6817","nonce":12461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":12461},{"type":"v1","addr":"172.21.15.96:6815","nonce":12461}]},"public_addr":"172.21.15.96:6811/12461","cluster_addr":"172.21.15.96:6813/12461","heartbeat_back_addr":"172.21.15.96:6817/12461","heartbeat_front_addr":"172.21.15.96:6815/12461","state":["exists","up"]},{"osd":6,"uuid":"bdadaea8-9296-4788-bc59-d9c9eb8defdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":12463},{"type":"v1","addr":"172.21.15.96:6827","nonce":12463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":12463},{"type":"v1","addr":"172.21.15.96:6829","nonce":12463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":12463},{"type":"v1","addr":"172.21.15.96:6833","nonce":12463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":12463},{"type":"v1","addr":"172.21.15.96:6831","nonce":12463}]},"public_addr":"172.21.15.96:6827/12463","cluster_addr":"172.21.15.96:6829/12463","heartbeat_back_addr":"172.21.15.96:6833/12463","heartbeat_front_addr":"172.21.15.96:6831/12463","state":["exists","up"]},{"osd":7,"uuid":"c6d71846-d68e-430f-ab72-0fb8ea4bf640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":12462},{"type":"v1","addr":"172.21.15.96:6819","nonce":12462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":12462},{"type":"v1","addr":"172.21.15.96:6821","nonce":12462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":12462},{"type":"v1","addr":"172.21.15.96:6825","nonce":12462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":12462},{"type":"v1","addr":"172.21.15.96:6823","nonce":12462}]},"public_addr":"172.21.15.96:6819/12462","cluster_addr":"172.21.15.96:6821/12462","heartbeat_back_addr":"172.21.15.96:6825/12462","heartbeat_front_addr":"172.21.15.96:6823/12462","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.875762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.900817+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.210347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.133973+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.864697+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.131015+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.237225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.154377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-05T03:49:52.576 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.571+0000 7fd2ece0e700 1 -- 172.21.15.158:0/3115131707 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd2cc03b3f0 msgr2=0x7fd2cc03d900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:52.576 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.571+0000 7fd2ece0e700 1 --2- 172.21.15.158:0/3115131707 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd2cc03b3f0 0x7fd2cc03d900 crc :-1 s=READY pgs=38 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:52.576 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.575+0000 7fd2ece0e700 1 -- 172.21.15.158:0/3115131707 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd2e812b680 msgr2=0x7fd2e80ada40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:52.576 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.575+0000 7fd2ece0e700 1 --2- 172.21.15.158:0/3115131707 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd2e812b680 0x7fd2e80ada40 secure :-1 s=READY pgs=26 cs=0 l=1 rx=0x7fd2d8007c80 tx=0x7fd2d80032f0).stop 2019-12-05T03:49:52.576 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.575+0000 7fd2ece0e700 1 -- 172.21.15.158:0/3115131707 shutdown_connections 2019-12-05T03:49:52.576 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.575+0000 7fd2ece0e700 1 --2- 172.21.15.158:0/3115131707 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd2e812b680 0x7fd2e80ada40 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:52.577 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.575+0000 7fd2ece0e700 1 --2- 172.21.15.158:0/3115131707 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd2cc03b3f0 0x7fd2cc03d900 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:52.577 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.575+0000 7fd2ece0e700 1 -- 172.21.15.158:0/3115131707 shutdown_connections 2019-12-05T03:49:52.577 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.575+0000 7fd2ece0e700 1 -- 172.21.15.158:0/3115131707 wait complete. 2019-12-05T03:49:52.577 INFO:teuthology.misc.health.smithi158.stderr:2019-12-05T03:49:52.575+0000 7fd2ece0e700 1 -- 172.21.15.158:0/3115131707 >> 172.21.15.158:0/3115131707 conn(0x7fd2e812c0e0 msgr2=0x7fd2e812e900 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:49:52.585 DEBUG:teuthology.misc:8 of 8 OSDs are up 2019-12-05T03:49:52.585 INFO:tasks.ceph:Creating RBD pool 2019-12-05T03:49:52.585 INFO:teuthology.orchestra.run.smithi158:> sudo ceph --cluster ceph osd pool create rbd 8 2019-12-05T03:49:52.682 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.675+0000 7fdad8bd7700 1 Processor -- start 2019-12-05T03:49:52.683 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.675+0000 7fdad8bd7700 1 -- start start 2019-12-05T03:49:52.683 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.675+0000 7fdad8bd7700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdad40b6970 0x7fdad409add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:52.683 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.675+0000 7fdad8bd7700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdad4099e30 con 0x7fdad409ba40 2019-12-05T03:49:52.683 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.675+0000 7fdad8bd7700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdad407e960 con 0x7fdad40b5370 2019-12-05T03:49:52.683 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.675+0000 7fdad8bd7700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad409d210 con 0x7fdad40b6970 2019-12-05T03:49:52.684 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.675+0000 7fdad359e700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fdad40b5370 0x7fdad40b57a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:47998/0 (socket says 172.21.15.158:47998) 2019-12-05T03:49:52.684 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.675+0000 7fdad359e700 1 -- 172.21.15.158:0/11643542 learned_addr learned my addr 172.21.15.158:0/11643542 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:49:52.684 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.675+0000 7fdad2d9d700 1 --2- 172.21.15.158:0/11643542 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdad40b6970 0x7fdad409add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:52.684 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.675+0000 7fdad1d9b700 1 -- 172.21.15.158:0/11643542 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1693534401 0 0) 0x7fdad407e960 con 0x7fdad40b5370 2019-12-05T03:49:52.684 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.675+0000 7fdad1d9b700 1 -- 172.21.15.158:0/11643542 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdac00030b0 con 0x7fdad40b5370 2019-12-05T03:49:52.684 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.675+0000 7fdad1d9b700 1 -- 172.21.15.158:0/11643542 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2701395411 0 0) 0x7fdad4099e30 con 0x7fdad409ba40 2019-12-05T03:49:52.685 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.675+0000 7fdad1d9b700 1 -- 172.21.15.158:0/11643542 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdad407e960 con 0x7fdad409ba40 2019-12-05T03:49:52.685 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.675+0000 7fdad2d9d700 1 -- 172.21.15.158:0/11643542 >> v1:172.21.15.158:6789/0 conn(0x7fdad40b5370 legacy=0x7fdad40b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:52.685 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.675+0000 7fdad2d9d700 1 -- 172.21.15.158:0/11643542 >> v1:172.21.15.96:6789/0 conn(0x7fdad409ba40 legacy=0x7fdad405a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:52.685 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.675+0000 7fdad2d9d700 1 -- 172.21.15.158:0/11643542 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad40b5fa0 con 0x7fdad40b6970 2019-12-05T03:49:52.685 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.675+0000 7fdad2d9d700 1 --2- 172.21.15.158:0/11643542 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdad40b6970 0x7fdad409add0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdac4002f30 tx=0x7fdac400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:52.685 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.675+0000 7fdad2d9d700 1 --2- 172.21.15.158:0/11643542 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdad40b6970 0x7fdad409add0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdac4002f30 tx=0x7fdac400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:52.685 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.675+0000 7fdad2d9d700 1 --2- 172.21.15.158:0/11643542 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdad40b6970 0x7fdad409add0 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7fdac4002f30 tx=0x7fdac400fbf0).ready entity=mon.2 client_cookie=72a6d04b80d0962c server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:52.686 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.679+0000 7fdad2d9d700 1 --2- 172.21.15.158:0/11643542 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdad40b6970 0x7fdad409add0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7fdac4002f30 tx=0x7fdac400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:52.686 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.679+0000 7fdad1d9b700 1 -- 172.21.15.158:0/11643542 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdac4008bb0 con 0x7fdad40b6970 2019-12-05T03:49:52.686 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.679+0000 7fdad2d9d700 1 --2- 172.21.15.158:0/11643542 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdad40b6970 0x7fdad409add0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7fdac4002f30 tx=0x7fdac400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:52.686 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.679+0000 7fdad1d9b700 1 -- 172.21.15.158:0/11643542 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac40087d0 con 0x7fdad40b6970 2019-12-05T03:49:52.686 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.679+0000 7fdad2d9d700 1 --2- 172.21.15.158:0/11643542 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdad40b6970 0x7fdad409add0 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7fdac4002f30 tx=0x7fdac400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:52.687 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.679+0000 7fdad1d9b700 1 -- 172.21.15.158:0/11643542 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdac40118d0 con 0x7fdad40b6970 2019-12-05T03:49:52.687 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.679+0000 7fdad8bd7700 1 -- 172.21.15.158:0/11643542 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdad40b6970 msgr2=0x7fdad409add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:52.687 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.679+0000 7fdad8bd7700 1 --2- 172.21.15.158:0/11643542 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdad40b6970 0x7fdad409add0 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7fdac4002f30 tx=0x7fdac400fbf0).stop 2019-12-05T03:49:52.687 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.679+0000 7fdad8bd7700 1 -- 172.21.15.158:0/11643542 shutdown_connections 2019-12-05T03:49:52.687 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.679+0000 7fdad8bd7700 1 --2- 172.21.15.158:0/11643542 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdad40b6970 0x7fdad409add0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:52.687 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.679+0000 7fdad8bd7700 1 -- 172.21.15.158:0/11643542 shutdown_connections 2019-12-05T03:49:52.687 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.679+0000 7fdad8bd7700 1 -- 172.21.15.158:0/11643542 wait complete. 2019-12-05T03:49:52.688 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.679+0000 7fdad8bd7700 1 -- 172.21.15.158:0/11643542 >> 172.21.15.158:0/11643542 conn(0x7fdad40b7ef0 msgr2=0x7fdad40b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:49:52.688 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.679+0000 7fdad8bd7700 1 Processor -- start 2019-12-05T03:49:52.688 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.679+0000 7fdad8bd7700 1 -- start start 2019-12-05T03:49:52.691 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.683+0000 7fdad8bd7700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdad413e3c0 0x7fdad40609c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:52.691 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.683+0000 7fdad8bd7700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fdad4060f10 0x7fdad413ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:52.692 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.683+0000 7fdad8bd7700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdad405ff10 con 0x7fdad40b0aa0 2019-12-05T03:49:52.692 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.683+0000 7fdad8bd7700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdad40601e0 con 0x7fdad4060f10 2019-12-05T03:49:52.692 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.683+0000 7fdad8bd7700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad4060480 con 0x7fdad413e3c0 2019-12-05T03:49:52.692 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.683+0000 7fdad259c700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdad413e3c0 0x7fdad40609c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:52.692 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.683+0000 7fdad259c700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdad413e3c0 0x7fdad40609c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.158:35962/0 (socket says 172.21.15.158:35962) 2019-12-05T03:49:52.692 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.683+0000 7fdad259c700 1 -- 172.21.15.158:0/3802698479 learned_addr learned my addr 172.21.15.158:0/3802698479 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:49:52.693 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.683+0000 7fdad2d9d700 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fdad40b0aa0 0x7fdad407b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.158:43134/0 (socket says 172.21.15.158:43134) 2019-12-05T03:49:52.693 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.683+0000 7fdad359e700 1 --2- 172.21.15.158:0/3802698479 >> v2:172.21.15.96:3300/0 conn(0x7fdad4060f10 0x7fdad413ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:52.693 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.683+0000 7fdacb7fe700 1 -- 172.21.15.158:0/3802698479 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1424896288 0 0) 0x7fdad405ff10 con 0x7fdad40b0aa0 2019-12-05T03:49:52.693 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.683+0000 7fdacb7fe700 1 -- 172.21.15.158:0/3802698479 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdab80030b0 con 0x7fdad40b0aa0 2019-12-05T03:49:52.693 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.683+0000 7fdad259c700 1 -- 172.21.15.158:0/3802698479 >> v2:172.21.15.96:3300/0 conn(0x7fdad4060f10 msgr2=0x7fdad413ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:52.693 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.683+0000 7fdad259c700 1 --2- 172.21.15.158:0/3802698479 >> v2:172.21.15.96:3300/0 conn(0x7fdad4060f10 0x7fdad413ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:52.694 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.683+0000 7fdad259c700 1 -- 172.21.15.158:0/3802698479 >> v1:172.21.15.96:6789/0 conn(0x7fdad40b0aa0 legacy=0x7fdad407b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:52.694 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.683+0000 7fdad259c700 1 -- 172.21.15.158:0/3802698479 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad40b0ed0 con 0x7fdad413e3c0 2019-12-05T03:49:52.694 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.683+0000 7fdad259c700 1 --2- 172.21.15.158:0/3802698479 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdad413e3c0 0x7fdad40609c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdabc001210 tx=0x7fdabc010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:52.694 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.683+0000 7fdad259c700 1 --2- 172.21.15.158:0/3802698479 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdad413e3c0 0x7fdad40609c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdabc001210 tx=0x7fdabc010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:52.694 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.683+0000 7fdad259c700 1 --2- 172.21.15.158:0/3802698479 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdad413e3c0 0x7fdad40609c0 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7fdabc001210 tx=0x7fdabc010d20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:52.694 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.683+0000 7fdad259c700 1 --2- 172.21.15.158:0/3802698479 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdad413e3c0 0x7fdad40609c0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fdabc001210 tx=0x7fdabc010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:52.694 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.683+0000 7fdacb7fe700 1 -- 172.21.15.158:0/3802698479 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdabc0123a0 con 0x7fdad413e3c0 2019-12-05T03:49:52.695 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.683+0000 7fdad259c700 1 --2- 172.21.15.158:0/3802698479 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdad413e3c0 0x7fdad40609c0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fdabc001210 tx=0x7fdabc010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:52.695 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.683+0000 7fdad259c700 1 --2- 172.21.15.158:0/3802698479 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdad413e3c0 0x7fdad40609c0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fdabc001210 tx=0x7fdabc010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:52.695 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.683+0000 7fdacb7fe700 1 -- 172.21.15.158:0/3802698479 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdabc00ca40 con 0x7fdad413e3c0 2019-12-05T03:49:52.695 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.683+0000 7fdad8bd7700 1 -- 172.21.15.158:0/3802698479 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdad407bb20 con 0x7fdad413e3c0 2019-12-05T03:49:52.695 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.683+0000 7fdacb7fe700 1 -- 172.21.15.158:0/3802698479 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdabc012980 con 0x7fdad413e3c0 2019-12-05T03:49:52.695 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.683+0000 7fdad8bd7700 1 -- 172.21.15.158:0/3802698479 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdad40b4090 con 0x7fdad413e3c0 2019-12-05T03:49:52.695 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.683+0000 7fdad259c700 1 --2- 172.21.15.158:0/3802698479 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdad413e3c0 0x7fdad40609c0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fdabc001210 tx=0x7fdabc010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:52.696 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.687+0000 7fdacb7fe700 1 -- 172.21.15.158:0/3802698479 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fdabc012c90 con 0x7fdad413e3c0 2019-12-05T03:49:52.696 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.687+0000 7fdad259c700 1 --2- 172.21.15.158:0/3802698479 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdad413e3c0 0x7fdad40609c0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fdabc001210 tx=0x7fdabc010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:52.696 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.687+0000 7fdacb7fe700 1 --2- 172.21.15.158:0/3802698479 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fdab803b280 0x7fdab803d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:52.696 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.687+0000 7fdacb7fe700 1 -- 172.21.15.158:0/3802698479 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4500+0+0 (secure 0 0 0) 0x7fdabc04b540 con 0x7fdad413e3c0 2019-12-05T03:49:52.696 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.687+0000 7fdad2d9d700 1 --2- 172.21.15.158:0/3802698479 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fdab803b280 0x7fdab803d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:52.697 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.687+0000 7fdad2d9d700 1 --2- 172.21.15.158:0/3802698479 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fdab803b280 0x7fdab803d790 crc :-1 s=READY pgs=39 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:52.697 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.691+0000 7fdad8bd7700 1 -- 172.21.15.158:0/3802698479 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdad40554e0 con 0x7fdad413e3c0 2019-12-05T03:49:52.702 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.699+0000 7fdad259c700 1 --2- 172.21.15.158:0/3802698479 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdad413e3c0 0x7fdad40609c0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fdabc001210 tx=0x7fdabc010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:52.702 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.699+0000 7fdacb7fe700 1 -- 172.21.15.158:0/3802698479 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fdabc0325c0 con 0x7fdad413e3c0 2019-12-05T03:49:52.869 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:52.867+0000 7fdad8bd7700 1 -- 172.21.15.158:0/3802698479 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "rbd"} v 0) v1 -- 0x7fdad4066940 con 0x7fdad413e3c0 2019-12-05T03:49:53.598 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.595+0000 7fdad259c700 1 --2- 172.21.15.158:0/3802698479 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdad413e3c0 0x7fdad40609c0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7fdabc001210 tx=0x7fdabc010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:53.598 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.595+0000 7fdacb7fe700 1 -- 172.21.15.158:0/3802698479 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "rbd"}]=0 pool 'rbd' created v15) v1 ==== 109+0+0 (secure 0 0 0) 0x7fdabc032820 con 0x7fdad413e3c0 2019-12-05T03:49:53.634 INFO:teuthology.orchestra.run.smithi158.stderr:pool 'rbd' created 2019-12-05T03:49:53.639 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.635+0000 7fdad8bd7700 1 -- 172.21.15.158:0/3802698479 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fdab803b280 msgr2=0x7fdab803d790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:53.639 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.635+0000 7fdad8bd7700 1 --2- 172.21.15.158:0/3802698479 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fdab803b280 0x7fdab803d790 crc :-1 s=READY pgs=39 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:53.639 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.635+0000 7fdad8bd7700 1 -- 172.21.15.158:0/3802698479 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdad413e3c0 msgr2=0x7fdad40609c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:53.640 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.635+0000 7fdad8bd7700 1 --2- 172.21.15.158:0/3802698479 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdad413e3c0 0x7fdad40609c0 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7fdabc001210 tx=0x7fdabc010d20).stop 2019-12-05T03:49:53.640 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.635+0000 7fdad8bd7700 1 -- 172.21.15.158:0/3802698479 shutdown_connections 2019-12-05T03:49:53.640 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.635+0000 7fdad8bd7700 1 --2- 172.21.15.158:0/3802698479 >> v2:172.21.15.96:3300/0 conn(0x7fdad4060f10 0x7fdad413ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:53.640 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.635+0000 7fdad8bd7700 1 --2- 172.21.15.158:0/3802698479 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fdab803b280 0x7fdab803d790 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:53.640 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.635+0000 7fdad8bd7700 1 --2- 172.21.15.158:0/3802698479 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdad413e3c0 0x7fdad40609c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:53.640 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.635+0000 7fdad8bd7700 1 -- 172.21.15.158:0/3802698479 shutdown_connections 2019-12-05T03:49:53.640 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.635+0000 7fdad8bd7700 1 -- 172.21.15.158:0/3802698479 wait complete. 2019-12-05T03:49:53.641 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.635+0000 7fdad8bd7700 1 -- 172.21.15.158:0/3802698479 >> 172.21.15.158:0/3802698479 conn(0x7fdad4059db0 msgr2=0x7fdad41304d0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:49:53.652 INFO:teuthology.orchestra.run.smithi158:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2019-12-05T03:49:53.753 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.747+0000 7f35cefce700 1 Processor -- start 2019-12-05T03:49:53.754 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.747+0000 7f35cefce700 1 -- start start 2019-12-05T03:49:53.754 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.747+0000 7f35cefce700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f35c809ba30 0x7f35c809adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:53.754 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.747+0000 7f35cefce700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f35c80b5360 0x7f35c80b5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:53.754 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.747+0000 7f35cefce700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c8099e20 con 0x7f35c80b6960 2019-12-05T03:49:53.754 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.747+0000 7f35cefce700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c809d200 con 0x7f35c80b5360 2019-12-05T03:49:53.755 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.747+0000 7f35cefce700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c8099b80 con 0x7f35c809ba30 2019-12-05T03:49:53.755 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.747+0000 7f35cdd6c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f35c80b5360 0x7f35c80b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:53.755 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.747+0000 7f35cdd6c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f35c80b5360 0x7f35c80b5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53232/0 (socket says 172.21.15.158:53232) 2019-12-05T03:49:53.755 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.747+0000 7f35cdd6c700 1 -- 172.21.15.158:0/4136420908 learned_addr learned my addr 172.21.15.158:0/4136420908 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:49:53.755 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.747+0000 7f35ccd6a700 1 --2- 172.21.15.158:0/4136420908 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f35c809ba30 0x7f35c809adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:53.755 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.747+0000 7f35cdd6c700 1 -- 172.21.15.158:0/4136420908 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f35c809ba30 msgr2=0x7f35c809adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:49:53.755 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.747+0000 7f35cdd6c700 1 --2- 172.21.15.158:0/4136420908 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f35c809ba30 0x7f35c809adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:49:53.756 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.747+0000 7f35cdd6c700 1 -- 172.21.15.158:0/4136420908 >> v1:172.21.15.96:6789/0 conn(0x7f35c80b6960 legacy=0x7f35c805a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:53.756 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.747+0000 7f35cdd6c700 1 -- 172.21.15.158:0/4136420908 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c807e950 con 0x7f35c80b5360 2019-12-05T03:49:53.756 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.747+0000 7f35cdd6c700 1 --2- 172.21.15.158:0/4136420908 >> v2:172.21.15.158:3300/0 conn(0x7f35c80b5360 0x7f35c80b5790 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f35c0008790 tx=0x7f35c000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:53.756 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.747+0000 7f35cdd6c700 1 --2- 172.21.15.158:0/4136420908 >> v2:172.21.15.158:3300/0 conn(0x7f35c80b5360 0x7f35c80b5790 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f35c0008790 tx=0x7f35c000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:53.756 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.747+0000 7f35cdd6c700 1 --2- 172.21.15.158:0/4136420908 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f35c80b5360 0x7f35c80b5790 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7f35c0008790 tx=0x7f35c000fd30).ready entity=mon.1 client_cookie=82abbc9e272bb140 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:53.756 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.747+0000 7f35cdd6c700 1 --2- 172.21.15.158:0/4136420908 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f35c80b5360 0x7f35c80b5790 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f35c0008790 tx=0x7f35c000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:53.756 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.747+0000 7f35cdd6c700 1 --2- 172.21.15.158:0/4136420908 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f35c80b5360 0x7f35c80b5790 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f35c0008790 tx=0x7f35c000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:53.757 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.747+0000 7f35c7fff700 1 -- 172.21.15.158:0/4136420908 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35c0008c90 con 0x7f35c80b5360 2019-12-05T03:49:53.757 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.747+0000 7f35cdd6c700 1 --2- 172.21.15.158:0/4136420908 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f35c80b5360 0x7f35c80b5790 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7f35c0008790 tx=0x7f35c000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:53.757 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.747+0000 7f35c7fff700 1 -- 172.21.15.158:0/4136420908 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c00088b0 con 0x7f35c80b5360 2019-12-05T03:49:53.757 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.747+0000 7f35c7fff700 1 -- 172.21.15.158:0/4136420908 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35c0011b10 con 0x7f35c80b5360 2019-12-05T03:49:53.757 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.747+0000 7f35cefce700 1 -- 172.21.15.158:0/4136420908 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f35c80b5360 msgr2=0x7f35c80b5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:53.757 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.751+0000 7f35cefce700 1 --2- 172.21.15.158:0/4136420908 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f35c80b5360 0x7f35c80b5790 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7f35c0008790 tx=0x7f35c000fd30).stop 2019-12-05T03:49:53.757 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.751+0000 7f35cefce700 1 -- 172.21.15.158:0/4136420908 shutdown_connections 2019-12-05T03:49:53.758 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.751+0000 7f35cefce700 1 --2- 172.21.15.158:0/4136420908 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f35c80b5360 0x7f35c80b5790 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:53.758 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.751+0000 7f35cefce700 1 --2- 172.21.15.158:0/4136420908 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f35c809ba30 0x7f35c809adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:49:53.758 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.751+0000 7f35cefce700 1 -- 172.21.15.158:0/4136420908 shutdown_connections 2019-12-05T03:49:53.758 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.751+0000 7f35cefce700 1 -- 172.21.15.158:0/4136420908 wait complete. 2019-12-05T03:49:53.758 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.751+0000 7f35cefce700 1 -- 172.21.15.158:0/4136420908 >> 172.21.15.158:0/4136420908 conn(0x7f35c80b7ee0 msgr2=0x7f35c80b3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:49:53.758 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.751+0000 7f35cefce700 1 Processor -- start 2019-12-05T03:49:53.758 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.751+0000 7f35cefce700 1 -- start start 2019-12-05T03:49:53.762 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.751+0000 7f35cefce700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f35c8153e80 0x7f35c80ac870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:53.762 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.751+0000 7f35cefce700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c8099570 con 0x7f35c80b1e20 2019-12-05T03:49:53.762 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.751+0000 7f35cefce700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c8134900 con 0x7f35c80acdc0 2019-12-05T03:49:53.762 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.751+0000 7f35cefce700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c80ad290 con 0x7f35c8153e80 2019-12-05T03:49:53.762 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.751+0000 7f35ccd6a700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f35c80acdc0 0x7f35c8098d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48016/0 (socket says 172.21.15.158:48016) 2019-12-05T03:49:53.762 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.751+0000 7f35ccd6a700 1 -- 172.21.15.158:0/4034626393 learned_addr learned my addr 172.21.15.158:0/4034626393 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:49:53.763 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.751+0000 7f35cd56b700 1 --2- 172.21.15.158:0/4034626393 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f35c8153e80 0x7f35c80ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:53.763 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.755+0000 7f35c5ffb700 1 -- 172.21.15.158:0/4034626393 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2047049970 0 0) 0x7f35c8134900 con 0x7f35c80acdc0 2019-12-05T03:49:53.763 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.755+0000 7f35c5ffb700 1 -- 172.21.15.158:0/4034626393 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35a80030b0 con 0x7f35c80acdc0 2019-12-05T03:49:53.763 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.755+0000 7f35c5ffb700 1 -- 172.21.15.158:0/4034626393 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1540275668 0 0) 0x7f35c8099570 con 0x7f35c80b1e20 2019-12-05T03:49:53.763 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.755+0000 7f35c5ffb700 1 -- 172.21.15.158:0/4034626393 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35c8134900 con 0x7f35c80b1e20 2019-12-05T03:49:53.763 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.755+0000 7f35cd56b700 1 -- 172.21.15.158:0/4034626393 >> v1:172.21.15.158:6789/0 conn(0x7f35c80acdc0 legacy=0x7f35c8098d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:53.763 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.755+0000 7f35cd56b700 1 -- 172.21.15.158:0/4034626393 >> v1:172.21.15.96:6789/0 conn(0x7f35c80b1e20 legacy=0x7f35c80b2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:53.764 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.755+0000 7f35cd56b700 1 -- 172.21.15.158:0/4034626393 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c81542b0 con 0x7f35c8153e80 2019-12-05T03:49:53.764 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.755+0000 7f35cd56b700 1 --2- 172.21.15.158:0/4034626393 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f35c8153e80 0x7f35c80ac870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f35b8000e90 tx=0x7f35b800c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:53.764 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.755+0000 7f35cd56b700 1 --2- 172.21.15.158:0/4034626393 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f35c8153e80 0x7f35c80ac870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f35b8000e90 tx=0x7f35b800c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:53.764 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.755+0000 7f35cd56b700 1 --2- 172.21.15.158:0/4034626393 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f35c8153e80 0x7f35c80ac870 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f35b8000e90 tx=0x7f35b800c320).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:53.764 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.755+0000 7f35cd56b700 1 --2- 172.21.15.158:0/4034626393 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f35c8153e80 0x7f35c80ac870 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f35b8000e90 tx=0x7f35b800c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:53.764 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.755+0000 7f35c5ffb700 1 -- 172.21.15.158:0/4034626393 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35b800cb70 con 0x7f35c8153e80 2019-12-05T03:49:53.764 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.755+0000 7f35cd56b700 1 --2- 172.21.15.158:0/4034626393 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f35c8153e80 0x7f35c80ac870 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f35b8000e90 tx=0x7f35b800c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:53.765 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.755+0000 7f35cd56b700 1 --2- 172.21.15.158:0/4034626393 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f35c8153e80 0x7f35c80ac870 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f35b8000e90 tx=0x7f35b800c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:53.765 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.755+0000 7f35c5ffb700 1 -- 172.21.15.158:0/4034626393 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b800c790 con 0x7f35c8153e80 2019-12-05T03:49:53.765 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.755+0000 7f35cefce700 1 -- 172.21.15.158:0/4034626393 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c80ada70 con 0x7f35c8153e80 2019-12-05T03:49:53.765 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.755+0000 7f35c5ffb700 1 -- 172.21.15.158:0/4034626393 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35b80110b0 con 0x7f35c8153e80 2019-12-05T03:49:53.765 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.755+0000 7f35cefce700 1 -- 172.21.15.158:0/4034626393 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c80b2a50 con 0x7f35c8153e80 2019-12-05T03:49:53.765 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.755+0000 7f35cd56b700 1 --2- 172.21.15.158:0/4034626393 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f35c8153e80 0x7f35c80ac870 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f35b8000e90 tx=0x7f35b800c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:53.765 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.755+0000 7f35c5ffb700 1 -- 172.21.15.158:0/4034626393 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f35b8011410 con 0x7f35c8153e80 2019-12-05T03:49:53.766 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.755+0000 7f35cd56b700 1 --2- 172.21.15.158:0/4034626393 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f35c8153e80 0x7f35c80ac870 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f35b8000e90 tx=0x7f35b800c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:53.766 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.755+0000 7f35c5ffb700 1 --2- 172.21.15.158:0/4034626393 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f35a803b460 0x7f35a803d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:53.766 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.755+0000 7f35c5ffb700 1 -- 172.21.15.158:0/4034626393 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4842+0+0 (secure 0 0 0) 0x7f35b804b0e0 con 0x7f35c8153e80 2019-12-05T03:49:53.766 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.759+0000 7f35ccd6a700 1 --2- 172.21.15.158:0/4034626393 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f35a803b460 0x7f35a803d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:53.766 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.759+0000 7f35ccd6a700 1 --2- 172.21.15.158:0/4034626393 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f35a803b460 0x7f35a803d970 crc :-1 s=READY pgs=40 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:53.767 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.763+0000 7f35cefce700 1 -- 172.21.15.158:0/4034626393 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c80554d0 con 0x7f35c8153e80 2019-12-05T03:49:53.781 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.771+0000 7f35cd56b700 1 --2- 172.21.15.158:0/4034626393 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f35c8153e80 0x7f35c80ac870 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f35b8000e90 tx=0x7f35b800c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:53.781 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.771+0000 7f35c5ffb700 1 -- 172.21.15.158:0/4034626393 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f35b8032140 con 0x7f35c8153e80 2019-12-05T03:49:53.936 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:53.935+0000 7f35cefce700 1 -- 172.21.15.158:0/4034626393 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd pool application enable", "app": "rbd", "pool": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f35c8066930 con 0x7f35c8153e80 2019-12-05T03:49:54.601 INFO:teuthology.orchestra.run.smithi158.stderr:enabled application 'rbd' on pool 'rbd' 2019-12-05T03:49:54.601 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.599+0000 7f35cd56b700 1 --2- 172.21.15.158:0/4034626393 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f35c8153e80 0x7f35c80ac870 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7f35b8000e90 tx=0x7f35b800c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:54.602 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.599+0000 7f35c5ffb700 1 -- 172.21.15.158:0/4034626393 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "app": "rbd", "pool": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v16) v1 ==== 173+0+0 (secure 0 0 0) 0x7f35b80323a0 con 0x7f35c8153e80 2019-12-05T03:49:54.606 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.603+0000 7f35cefce700 1 -- 172.21.15.158:0/4034626393 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f35a803b460 msgr2=0x7f35a803d970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:54.606 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.603+0000 7f35cefce700 1 --2- 172.21.15.158:0/4034626393 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f35a803b460 0x7f35a803d970 crc :-1 s=READY pgs=40 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:54.606 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.603+0000 7f35cefce700 1 -- 172.21.15.158:0/4034626393 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f35c8153e80 msgr2=0x7f35c80ac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:54.607 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.603+0000 7f35cefce700 1 --2- 172.21.15.158:0/4034626393 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f35c8153e80 0x7f35c80ac870 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7f35b8000e90 tx=0x7f35b800c320).stop 2019-12-05T03:49:54.607 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.607+0000 7f35cefce700 1 -- 172.21.15.158:0/4034626393 shutdown_connections 2019-12-05T03:49:54.608 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.607+0000 7f35cefce700 1 --2- 172.21.15.158:0/4034626393 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f35a803b460 0x7f35a803d970 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:54.608 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.607+0000 7f35cefce700 1 --2- 172.21.15.158:0/4034626393 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f35c8153e80 0x7f35c80ac870 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:54.608 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.607+0000 7f35cefce700 1 -- 172.21.15.158:0/4034626393 shutdown_connections 2019-12-05T03:49:54.608 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.607+0000 7f35cefce700 1 -- 172.21.15.158:0/4034626393 wait complete. 2019-12-05T03:49:54.608 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.607+0000 7f35cefce700 1 -- 172.21.15.158:0/4034626393 >> 172.21.15.158:0/4034626393 conn(0x7f35c80b3810 msgr2=0x7f35c809a310 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:49:54.615 INFO:tasks.ceph:Setting up CephFS filesystem... 2019-12-05T03:49:54.616 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-05T03:49:54.704 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.695+0000 7fabea504700 1 Processor -- start 2019-12-05T03:49:54.704 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.695+0000 7fabea504700 1 -- start start 2019-12-05T03:49:54.704 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.695+0000 7fabea504700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fabe409cf60 0x7fabe409a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:54.704 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.695+0000 7fabea504700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fabe405a740 0x7fabe4151460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:54.705 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.695+0000 7fabea504700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fabe41519b0 0x7fabe40b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:54.705 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.695+0000 7fabea504700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabe40b1730 con 0x7fabe41519b0 2019-12-05T03:49:54.705 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.695+0000 7fabea504700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabe40b19d0 con 0x7fabe405a740 2019-12-05T03:49:54.705 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.695+0000 7fabea504700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe405ab70 con 0x7fabe409cf60 2019-12-05T03:49:54.705 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.699+0000 7fabe3fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fabe405a740 0x7fabe4151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:54.705 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.699+0000 7fabe3fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fabe405a740 0x7fabe4151460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53244/0 (socket says 172.21.15.158:53244) 2019-12-05T03:49:54.706 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.699+0000 7fabe3fff700 1 -- 172.21.15.158:0/3319349038 learned_addr learned my addr 172.21.15.158:0/3319349038 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:49:54.706 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.699+0000 7fabe8aa1700 1 --2- 172.21.15.158:0/3319349038 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fabe409cf60 0x7fabe409a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:54.706 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.699+0000 7fabe92a2700 1 --2- 172.21.15.158:0/3319349038 >> v2:172.21.15.96:3300/0 conn(0x7fabe41519b0 0x7fabe40b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:54.706 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.699+0000 7fabe3fff700 1 -- 172.21.15.158:0/3319349038 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fabe409cf60 msgr2=0x7fabe409a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:49:54.706 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.699+0000 7fabe3fff700 1 --2- 172.21.15.158:0/3319349038 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fabe409cf60 0x7fabe409a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:49:54.706 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.699+0000 7fabe3fff700 1 -- 172.21.15.158:0/3319349038 >> v2:172.21.15.96:3300/0 conn(0x7fabe41519b0 msgr2=0x7fabe40b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:49:54.706 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.699+0000 7fabe3fff700 1 --2- 172.21.15.158:0/3319349038 >> v2:172.21.15.96:3300/0 conn(0x7fabe41519b0 0x7fabe40b52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:49:54.707 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.699+0000 7fabe3fff700 1 -- 172.21.15.158:0/3319349038 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe40accb0 con 0x7fabe405a740 2019-12-05T03:49:54.707 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.699+0000 7fabe8aa1700 1 --2- 172.21.15.158:0/3319349038 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fabe409cf60 0x7fabe409a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-12-05T03:49:54.707 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.699+0000 7fabe3fff700 1 --2- 172.21.15.158:0/3319349038 >> v2:172.21.15.158:3300/0 conn(0x7fabe405a740 0x7fabe4151460 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fabe40b1b90 tx=0x7fabcc00fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:54.707 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.699+0000 7fabe3fff700 1 --2- 172.21.15.158:0/3319349038 >> v2:172.21.15.158:3300/0 conn(0x7fabe405a740 0x7fabe4151460 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fabe40b1b90 tx=0x7fabcc00fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:54.708 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.699+0000 7fabe3fff700 1 --2- 172.21.15.158:0/3319349038 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fabe405a740 0x7fabe4151460 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7fabe40b1b90 tx=0x7fabcc00fdb0).ready entity=mon.1 client_cookie=43a1e25ee3a316c9 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:54.708 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.699+0000 7fabe3fff700 1 --2- 172.21.15.158:0/3319349038 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fabe405a740 0x7fabe4151460 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7fabe40b1b90 tx=0x7fabcc00fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:54.708 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.699+0000 7fabe3fff700 1 --2- 172.21.15.158:0/3319349038 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fabe405a740 0x7fabe4151460 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7fabe40b1b90 tx=0x7fabcc00fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:54.708 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.699+0000 7fabe37fe700 1 -- 172.21.15.158:0/3319349038 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabcc0113f0 con 0x7fabe405a740 2019-12-05T03:49:54.708 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.699+0000 7fabe3fff700 1 --2- 172.21.15.158:0/3319349038 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fabe405a740 0x7fabe4151460 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7fabe40b1b90 tx=0x7fabcc00fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:54.708 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.699+0000 7fabe37fe700 1 -- 172.21.15.158:0/3319349038 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabcc008bb0 con 0x7fabe405a740 2019-12-05T03:49:54.709 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.699+0000 7fabe37fe700 1 -- 172.21.15.158:0/3319349038 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabcc0119d0 con 0x7fabe405a740 2019-12-05T03:49:54.709 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.699+0000 7fabea504700 1 -- 172.21.15.158:0/3319349038 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fabe405a740 msgr2=0x7fabe4151460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:54.709 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.699+0000 7fabea504700 1 --2- 172.21.15.158:0/3319349038 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fabe405a740 0x7fabe4151460 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7fabe40b1b90 tx=0x7fabcc00fdb0).stop 2019-12-05T03:49:54.709 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.699+0000 7fabea504700 1 -- 172.21.15.158:0/3319349038 shutdown_connections 2019-12-05T03:49:54.709 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.699+0000 7fabea504700 1 --2- 172.21.15.158:0/3319349038 >> v2:172.21.15.96:3300/0 conn(0x7fabe41519b0 0x7fabe40b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:49:54.709 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.699+0000 7fabea504700 1 --2- 172.21.15.158:0/3319349038 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fabe409cf60 0x7fabe409a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:49:54.710 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.699+0000 7fabea504700 1 --2- 172.21.15.158:0/3319349038 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fabe405a740 0x7fabe4151460 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:54.710 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.699+0000 7fabea504700 1 -- 172.21.15.158:0/3319349038 shutdown_connections 2019-12-05T03:49:54.710 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.699+0000 7fabea504700 1 -- 172.21.15.158:0/3319349038 wait complete. 2019-12-05T03:49:54.710 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.699+0000 7fabea504700 1 -- 172.21.15.158:0/3319349038 >> 172.21.15.158:0/3319349038 conn(0x7fabe40b7e60 msgr2=0x7fabe40b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:49:54.710 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.703+0000 7fabea504700 1 Processor -- start 2019-12-05T03:49:54.710 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.703+0000 7fabea504700 1 -- start start 2019-12-05T03:49:54.714 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.703+0000 7fabea504700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fabe4154c80 0x7fabe4153760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:54.714 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.703+0000 7fabea504700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe4064870 con 0x7fabe4064440 2019-12-05T03:49:54.714 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.703+0000 7fabea504700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe413fa10 con 0x7fabe407c740 2019-12-05T03:49:54.715 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.703+0000 7fabea504700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe412df30 con 0x7fabe4154c80 2019-12-05T03:49:54.715 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.703+0000 7fabe3fff700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fabe407c740 0x7fabe409a320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48030/0 (socket says 172.21.15.158:48030) 2019-12-05T03:49:54.715 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.703+0000 7fabe3fff700 1 -- 172.21.15.158:0/2151099493 learned_addr learned my addr 172.21.15.158:0/2151099493 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:49:54.715 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.703+0000 7fabe8aa1700 1 --2- 172.21.15.158:0/2151099493 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fabe4154c80 0x7fabe4153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:54.715 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.703+0000 7fabe17fa700 1 -- 172.21.15.158:0/2151099493 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1044615595 0 0) 0x7fabe413fa10 con 0x7fabe407c740 2019-12-05T03:49:54.715 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.703+0000 7fabe17fa700 1 -- 172.21.15.158:0/2151099493 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabc80030b0 con 0x7fabe407c740 2019-12-05T03:49:54.716 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.703+0000 7fabe17fa700 1 -- 172.21.15.158:0/2151099493 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 862444186 0 0) 0x7fabe4064870 con 0x7fabe4064440 2019-12-05T03:49:54.716 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.703+0000 7fabe17fa700 1 -- 172.21.15.158:0/2151099493 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabe413fa10 con 0x7fabe4064440 2019-12-05T03:49:54.716 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.703+0000 7fabe8aa1700 1 -- 172.21.15.158:0/2151099493 >> v1:172.21.15.158:6789/0 conn(0x7fabe407c740 legacy=0x7fabe409a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:54.716 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.703+0000 7fabe8aa1700 1 -- 172.21.15.158:0/2151099493 >> v1:172.21.15.96:6789/0 conn(0x7fabe4064440 legacy=0x7fabe413f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:54.716 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.703+0000 7fabe8aa1700 1 -- 172.21.15.158:0/2151099493 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe413fc40 con 0x7fabe4154c80 2019-12-05T03:49:54.716 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.703+0000 7fabe8aa1700 1 --2- 172.21.15.158:0/2151099493 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fabe4154c80 0x7fabe4153760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fabd4002f30 tx=0x7fabd4010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:54.717 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.703+0000 7fabe8aa1700 1 --2- 172.21.15.158:0/2151099493 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fabe4154c80 0x7fabe4153760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fabd4002f30 tx=0x7fabd4010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:54.717 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.703+0000 7fabe8aa1700 1 --2- 172.21.15.158:0/2151099493 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fabe4154c80 0x7fabe4153760 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7fabd4002f30 tx=0x7fabd4010a00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:54.717 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.703+0000 7fabe8aa1700 1 --2- 172.21.15.158:0/2151099493 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fabe4154c80 0x7fabe4153760 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fabd4002f30 tx=0x7fabd4010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:54.718 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.703+0000 7fabe17fa700 1 -- 172.21.15.158:0/2151099493 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabd4005540 con 0x7fabe4154c80 2019-12-05T03:49:54.719 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.703+0000 7fabe8aa1700 1 --2- 172.21.15.158:0/2151099493 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fabe4154c80 0x7fabe4153760 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fabd4002f30 tx=0x7fabd4010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:54.719 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.703+0000 7fabe8aa1700 1 --2- 172.21.15.158:0/2151099493 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fabe4154c80 0x7fabe4153760 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fabd4002f30 tx=0x7fabd4010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:54.719 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.703+0000 7fabe17fa700 1 -- 172.21.15.158:0/2151099493 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd4007150 con 0x7fabe4154c80 2019-12-05T03:49:54.719 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.703+0000 7fabea504700 1 -- 172.21.15.158:0/2151099493 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe413feb0 con 0x7fabe4154c80 2019-12-05T03:49:54.719 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.703+0000 7fabe17fa700 1 -- 172.21.15.158:0/2151099493 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabd4005b20 con 0x7fabe4154c80 2019-12-05T03:49:54.719 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.703+0000 7fabea504700 1 -- 172.21.15.158:0/2151099493 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe4147670 con 0x7fabe4154c80 2019-12-05T03:49:54.719 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.707+0000 7fabe8aa1700 1 --2- 172.21.15.158:0/2151099493 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fabe4154c80 0x7fabe4153760 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fabd4002f30 tx=0x7fabd4010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:54.720 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.707+0000 7fabe8aa1700 1 --2- 172.21.15.158:0/2151099493 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fabe4154c80 0x7fabe4153760 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fabd4002f30 tx=0x7fabd4010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:54.720 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.707+0000 7fabe17fa700 1 -- 172.21.15.158:0/2151099493 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fabd40124b0 con 0x7fabe4154c80 2019-12-05T03:49:54.720 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.707+0000 7fabe17fa700 1 --2- 172.21.15.158:0/2151099493 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fabc803b4a0 0x7fabc803d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:54.720 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.707+0000 7fabe17fa700 1 -- 172.21.15.158:0/2151099493 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fabd404ac60 con 0x7fabe4154c80 2019-12-05T03:49:54.720 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.707+0000 7fabe3fff700 1 --2- 172.21.15.158:0/2151099493 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fabc803b4a0 0x7fabc803d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:54.720 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.707+0000 7fabe3fff700 1 --2- 172.21.15.158:0/2151099493 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fabc803b4a0 0x7fabc803d9b0 crc :-1 s=READY pgs=41 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:54.721 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.711+0000 7fabea504700 1 -- 172.21.15.158:0/2151099493 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe40554e0 con 0x7fabe4154c80 2019-12-05T03:49:54.722 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.719+0000 7fabe8aa1700 1 --2- 172.21.15.158:0/2151099493 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fabe4154c80 0x7fabe4153760 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fabd4002f30 tx=0x7fabd4010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:54.722 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.719+0000 7fabe17fa700 1 -- 172.21.15.158:0/2151099493 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fabd4005d20 con 0x7fabe4154c80 2019-12-05T03:49:54.889 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.887+0000 7fabea504700 1 -- 172.21.15.158:0/2151099493 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fabe412af10 con 0x7fabe4154c80 2019-12-05T03:49:54.890 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.887+0000 7fabe8aa1700 1 --2- 172.21.15.158:0/2151099493 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fabe4154c80 0x7fabe4153760 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fabd4002f30 tx=0x7fabd4010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:54.891 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.887+0000 7fabe17fa700 1 -- 172.21.15.158:0/2151099493 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11826 (secure 0 0 0) 0x7fabd402f1c0 con 0x7fabe4154c80 2019-12-05T03:49:54.892 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:49:54.892 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":16,"fsid":"a91186ae-f496-4de1-918d-820c55ff1feb","created":"2019-12-05T03:49:39.187523+0000","modified":"2019-12-05T03:49:54.592726+0000","last_up_change":"2019-12-05T03:49:48.551934+0000","last_in_change":"2019-12-05T03:49:48.551934+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-05T03:49:52.900870+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"782c4258-e28c-4a11-9d54-3c9c7a36fba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":12192},{"type":"v1","addr":"172.21.15.158:6801","nonce":12192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":12192},{"type":"v1","addr":"172.21.15.158:6803","nonce":12192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":12192},{"type":"v1","addr":"172.21.15.158:6807","nonce":12192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":12192},{"type":"v1","addr":"172.21.15.158:6805","nonce":12192}]},"public_addr":"172.21.15.158:6801/12192","cluster_addr":"172.21.15.158:6803/12192","heartbeat_back_addr":"172.21.15.158:6807/12192","heartbeat_front_addr":"172.21.15.158:6805/12192","state":["exists","up"]},{"osd":1,"uuid":"d4426b21-b666-4158-bf34-a24b14572731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":12193},{"type":"v1","addr":"172.21.15.158:6809","nonce":12193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":12193},{"type":"v1","addr":"172.21.15.158:6811","nonce":12193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":12193},{"type":"v1","addr":"172.21.15.158:6815","nonce":12193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":12193},{"type":"v1","addr":"172.21.15.158:6813","nonce":12193}]},"public_addr":"172.21.15.158:6809/12193","cluster_addr":"172.21.15.158:6811/12193","heartbeat_back_addr":"172.21.15.158:6815/12193","heartbeat_front_addr":"172.21.15.158:6813/12193","state":["exists","up"]},{"osd":2,"uuid":"22680edd-6490-4ab0-bb15-0605830e4cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":12195},{"type":"v1","addr":"172.21.15.158:6825","nonce":12195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":12195},{"type":"v1","addr":"172.21.15.158:6827","nonce":12195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":12195},{"type":"v1","addr":"172.21.15.158:6831","nonce":12195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":12195},{"type":"v1","addr":"172.21.15.158:6829","nonce":12195}]},"public_addr":"172.21.15.158:6825/12195","cluster_addr":"172.21.15.158:6827/12195","heartbeat_back_addr":"172.21.15.158:6831/12195","heartbeat_front_addr":"172.21.15.158:6829/12195","state":["exists","up"]},{"osd":3,"uuid":"7ec999ee-ace8-4ccb-a4f9-6f5d313bbbd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":12194},{"type":"v1","addr":"172.21.15.158:6817","nonce":12194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":12194},{"type":"v1","addr":"172.21.15.158:6819","nonce":12194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":12194},{"type":"v1","addr":"172.21.15.158:6823","nonce":12194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":12194},{"type":"v1","addr":"172.21.15.158:6821","nonce":12194}]},"public_addr":"172.21.15.158:6817/12194","cluster_addr":"172.21.15.158:6819/12194","heartbeat_back_addr":"172.21.15.158:6823/12194","heartbeat_front_addr":"172.21.15.158:6821/12194","state":["exists","up"]},{"osd":4,"uuid":"186e69c4-b69f-4dd1-bb8f-faf759c60484","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":12460},{"type":"v1","addr":"172.21.15.96:6803","nonce":12460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":12460},{"type":"v1","addr":"172.21.15.96:6805","nonce":12460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":12460},{"type":"v1","addr":"172.21.15.96:6809","nonce":12460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":12460},{"type":"v1","addr":"172.21.15.96:6807","nonce":12460}]},"public_addr":"172.21.15.96:6803/12460","cluster_addr":"172.21.15.96:6805/12460","heartbeat_back_addr":"172.21.15.96:6809/12460","heartbeat_front_addr":"172.21.15.96:6807/12460","state":["exists","up"]},{"osd":5,"uuid":"86b658b2-8b40-4cea-8163-305a3982758b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":12461},{"type":"v1","addr":"172.21.15.96:6811","nonce":12461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":12461},{"type":"v1","addr":"172.21.15.96:6813","nonce":12461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":12461},{"type":"v1","addr":"172.21.15.96:6817","nonce":12461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":12461},{"type":"v1","addr":"172.21.15.96:6815","nonce":12461}]},"public_addr":"172.21.15.96:6811/12461","cluster_addr":"172.21.15.96:6813/12461","heartbeat_back_addr":"172.21.15.96:6817/12461","heartbeat_front_addr":"172.21.15.96:6815/12461","state":["exists","up"]},{"osd":6,"uuid":"bdadaea8-9296-4788-bc59-d9c9eb8defdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":12463},{"type":"v1","addr":"172.21.15.96:6827","nonce":12463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":12463},{"type":"v1","addr":"172.21.15.96:6829","nonce":12463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":12463},{"type":"v1","addr":"172.21.15.96:6833","nonce":12463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":12463},{"type":"v1","addr":"172.21.15.96:6831","nonce":12463}]},"public_addr":"172.21.15.96:6827/12463","cluster_addr":"172.21.15.96:6829/12463","heartbeat_back_addr":"172.21.15.96:6833/12463","heartbeat_front_addr":"172.21.15.96:6831/12463","state":["exists","up"]},{"osd":7,"uuid":"c6d71846-d68e-430f-ab72-0fb8ea4bf640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":12462},{"type":"v1","addr":"172.21.15.96:6819","nonce":12462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":12462},{"type":"v1","addr":"172.21.15.96:6821","nonce":12462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":12462},{"type":"v1","addr":"172.21.15.96:6825","nonce":12462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":12462},{"type":"v1","addr":"172.21.15.96:6823","nonce":12462}]},"public_addr":"172.21.15.96:6819/12462","cluster_addr":"172.21.15.96:6821/12462","heartbeat_back_addr":"172.21.15.96:6825/12462","heartbeat_front_addr":"172.21.15.96:6823/12462","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.875762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.900817+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.210347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.133973+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.864697+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.131015+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.237225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.154377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-05T03:49:54.895 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.891+0000 7fabea504700 1 -- 172.21.15.158:0/2151099493 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fabc803b4a0 msgr2=0x7fabc803d9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:54.895 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.891+0000 7fabea504700 1 --2- 172.21.15.158:0/2151099493 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fabc803b4a0 0x7fabc803d9b0 crc :-1 s=READY pgs=41 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:54.895 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.891+0000 7fabea504700 1 -- 172.21.15.158:0/2151099493 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fabe4154c80 msgr2=0x7fabe4153760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:54.895 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.891+0000 7fabea504700 1 --2- 172.21.15.158:0/2151099493 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fabe4154c80 0x7fabe4153760 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7fabd4002f30 tx=0x7fabd4010a00).stop 2019-12-05T03:49:54.896 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.891+0000 7fabea504700 1 -- 172.21.15.158:0/2151099493 shutdown_connections 2019-12-05T03:49:54.896 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.891+0000 7fabea504700 1 --2- 172.21.15.158:0/2151099493 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fabc803b4a0 0x7fabc803d9b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:54.896 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.891+0000 7fabea504700 1 --2- 172.21.15.158:0/2151099493 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fabe4154c80 0x7fabe4153760 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:54.896 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.891+0000 7fabea504700 1 -- 172.21.15.158:0/2151099493 shutdown_connections 2019-12-05T03:49:54.896 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.891+0000 7fabea504700 1 -- 172.21.15.158:0/2151099493 wait complete. 2019-12-05T03:49:54.896 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:54.891+0000 7fabea504700 1 -- 172.21.15.158:0/2151099493 >> 172.21.15.158:0/2151099493 conn(0x7fabe407e3f0 msgr2=0x7fabe4155320 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:49:54.905 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool,creating', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:49:52.900870+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 32769, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'16', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-12-05T03:49:54.905 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-12-05T03:49:55.013 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.007+0000 7fda65291700 1 Processor -- start 2019-12-05T03:49:55.013 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.007+0000 7fda65291700 1 -- start start 2019-12-05T03:49:55.013 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.007+0000 7fda65291700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fda600b6970 0x7fda6009add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:55.013 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.007+0000 7fda65291700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fda600b5370 0x7fda600b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:55.014 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.007+0000 7fda65291700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda60099e30 con 0x7fda6009ba40 2019-12-05T03:49:55.014 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.007+0000 7fda65291700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda6009d210 con 0x7fda600b5370 2019-12-05T03:49:55.014 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.007+0000 7fda65291700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda60099b90 con 0x7fda600b6970 2019-12-05T03:49:55.014 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.007+0000 7fda5f7fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fda600b6970 0x7fda6009add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:55.014 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.007+0000 7fda5effd700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fda6009ba40 0x7fda6005a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48036/0 (socket says 172.21.15.158:48036) 2019-12-05T03:49:55.014 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.007+0000 7fda5effd700 1 -- 172.21.15.158:0/3170722316 learned_addr learned my addr 172.21.15.158:0/3170722316 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:49:55.014 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.007+0000 7fda5f7fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fda600b6970 0x7fda6009add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53256/0 (socket says 172.21.15.158:53256) 2019-12-05T03:49:55.015 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.007+0000 7fda5ffff700 1 --2- 172.21.15.158:0/3170722316 >> v2:172.21.15.96:3300/0 conn(0x7fda600b5370 0x7fda600b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:55.015 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.007+0000 7fda5f7fe700 1 -- 172.21.15.158:0/3170722316 >> v2:172.21.15.96:3300/0 conn(0x7fda600b5370 msgr2=0x7fda600b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:49:55.015 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.007+0000 7fda5f7fe700 1 --2- 172.21.15.158:0/3170722316 >> v2:172.21.15.96:3300/0 conn(0x7fda600b5370 0x7fda600b57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:49:55.015 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.007+0000 7fda5f7fe700 1 -- 172.21.15.158:0/3170722316 >> v1:172.21.15.158:6789/0 conn(0x7fda6009ba40 legacy=0x7fda6005a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:55.015 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.007+0000 7fda5f7fe700 1 -- 172.21.15.158:0/3170722316 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda6007e960 con 0x7fda600b6970 2019-12-05T03:49:55.015 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.007+0000 7fda5e7fc700 1 -- 172.21.15.158:0/3170722316 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1300124205 0 0) 0x7fda60099e30 con 0x7fda6009ba40 2019-12-05T03:49:55.015 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.007+0000 7fda5f7fe700 1 --2- 172.21.15.158:0/3170722316 >> v2:172.21.15.158:3300/0 conn(0x7fda600b6970 0x7fda6009add0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fda48002f30 tx=0x7fda4800fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.016 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.007+0000 7fda5f7fe700 1 --2- 172.21.15.158:0/3170722316 >> v2:172.21.15.158:3300/0 conn(0x7fda600b6970 0x7fda6009add0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fda48002f30 tx=0x7fda4800fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.016 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.007+0000 7fda5f7fe700 1 --2- 172.21.15.158:0/3170722316 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda600b6970 0x7fda6009add0 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7fda48002f30 tx=0x7fda4800fc70).ready entity=mon.1 client_cookie=85afb1478c85ba6 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:55.016 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.007+0000 7fda5f7fe700 1 --2- 172.21.15.158:0/3170722316 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda600b6970 0x7fda6009add0 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fda48002f30 tx=0x7fda4800fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.016 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.007+0000 7fda5e7fc700 1 -- 172.21.15.158:0/3170722316 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda48008bb0 con 0x7fda600b6970 2019-12-05T03:49:55.016 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.007+0000 7fda5f7fe700 1 --2- 172.21.15.158:0/3170722316 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda600b6970 0x7fda6009add0 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fda48002f30 tx=0x7fda4800fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.016 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.007+0000 7fda5f7fe700 1 --2- 172.21.15.158:0/3170722316 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda600b6970 0x7fda6009add0 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fda48002f30 tx=0x7fda4800fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.017 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.011+0000 7fda5e7fc700 1 -- 172.21.15.158:0/3170722316 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda480087d0 con 0x7fda600b6970 2019-12-05T03:49:55.017 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.011+0000 7fda5e7fc700 1 -- 172.21.15.158:0/3170722316 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda48011820 con 0x7fda600b6970 2019-12-05T03:49:55.017 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.011+0000 7fda65291700 1 -- 172.21.15.158:0/3170722316 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda600b6970 msgr2=0x7fda6009add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:55.017 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.011+0000 7fda65291700 1 --2- 172.21.15.158:0/3170722316 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda600b6970 0x7fda6009add0 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7fda48002f30 tx=0x7fda4800fc70).stop 2019-12-05T03:49:55.017 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.011+0000 7fda65291700 1 -- 172.21.15.158:0/3170722316 shutdown_connections 2019-12-05T03:49:55.017 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.011+0000 7fda65291700 1 --2- 172.21.15.158:0/3170722316 >> v2:172.21.15.96:3300/0 conn(0x7fda600b5370 0x7fda600b57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:49:55.017 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.011+0000 7fda65291700 1 --2- 172.21.15.158:0/3170722316 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda600b6970 0x7fda6009add0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:55.018 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.011+0000 7fda65291700 1 -- 172.21.15.158:0/3170722316 shutdown_connections 2019-12-05T03:49:55.018 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.011+0000 7fda65291700 1 -- 172.21.15.158:0/3170722316 wait complete. 2019-12-05T03:49:55.018 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.011+0000 7fda65291700 1 -- 172.21.15.158:0/3170722316 >> 172.21.15.158:0/3170722316 conn(0x7fda600b7ef0 msgr2=0x7fda600b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:49:55.022 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.011+0000 7fda65291700 1 Processor -- start 2019-12-05T03:49:55.022 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.011+0000 7fda65291700 1 -- start start 2019-12-05T03:49:55.022 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.015+0000 7fda65291700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fda60154160 0x7fda6007b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:55.022 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.015+0000 7fda65291700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fda6013a1e0 0x7fda6013a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:55.022 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.015+0000 7fda65291700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda6013af00 con 0x7fda6012d800 2019-12-05T03:49:55.023 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.015+0000 7fda65291700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda600adbb0 con 0x7fda6013a1e0 2019-12-05T03:49:55.023 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.015+0000 7fda65291700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda600ade50 con 0x7fda60154160 2019-12-05T03:49:55.023 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.015+0000 7fda5f7fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fda60154160 0x7fda6007b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:55.023 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.015+0000 7fda5f7fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fda60154160 0x7fda6007b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53264/0 (socket says 172.21.15.158:53264) 2019-12-05T03:49:55.023 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.015+0000 7fda5f7fe700 1 -- 172.21.15.158:0/3995400668 learned_addr learned my addr 172.21.15.158:0/3995400668 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:49:55.023 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.015+0000 7fda5effd700 1 --2- 172.21.15.158:0/3995400668 >> v2:172.21.15.96:3300/0 conn(0x7fda6013a1e0 0x7fda6013a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:55.023 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.015+0000 7fda57fff700 1 -- 172.21.15.158:0/3995400668 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2618058211 0 0) 0x7fda6013af00 con 0x7fda6012d800 2019-12-05T03:49:55.024 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.015+0000 7fda5f7fe700 1 -- 172.21.15.158:0/3995400668 >> v2:172.21.15.96:3300/0 conn(0x7fda6013a1e0 msgr2=0x7fda6013a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:55.024 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.015+0000 7fda5f7fe700 1 --2- 172.21.15.158:0/3995400668 >> v2:172.21.15.96:3300/0 conn(0x7fda6013a1e0 0x7fda6013a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:55.024 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.015+0000 7fda5f7fe700 1 -- 172.21.15.158:0/3995400668 >> v1:172.21.15.96:6789/0 conn(0x7fda6012d800 legacy=0x7fda600ae0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:55.024 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.015+0000 7fda5f7fe700 1 -- 172.21.15.158:0/3995400668 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda600ac470 con 0x7fda60154160 2019-12-05T03:49:55.024 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.015+0000 7fda5f7fe700 1 --2- 172.21.15.158:0/3995400668 >> v2:172.21.15.158:3300/0 conn(0x7fda60154160 0x7fda6007b8b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fda48002f30 tx=0x7fda48008a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.024 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.015+0000 7fda5f7fe700 1 --2- 172.21.15.158:0/3995400668 >> v2:172.21.15.158:3300/0 conn(0x7fda60154160 0x7fda6007b8b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fda48002f30 tx=0x7fda48008a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.024 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.015+0000 7fda5f7fe700 1 --2- 172.21.15.158:0/3995400668 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda60154160 0x7fda6007b8b0 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7fda48002f30 tx=0x7fda48008a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:55.025 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.015+0000 7fda5f7fe700 1 --2- 172.21.15.158:0/3995400668 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda60154160 0x7fda6007b8b0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fda48002f30 tx=0x7fda48008a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.025 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.015+0000 7fda57fff700 1 -- 172.21.15.158:0/3995400668 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda48005540 con 0x7fda60154160 2019-12-05T03:49:55.025 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.015+0000 7fda5f7fe700 1 --2- 172.21.15.158:0/3995400668 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda60154160 0x7fda6007b8b0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fda48002f30 tx=0x7fda48008a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.025 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.015+0000 7fda5f7fe700 1 --2- 172.21.15.158:0/3995400668 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda60154160 0x7fda6007b8b0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fda48002f30 tx=0x7fda48008a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.025 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.015+0000 7fda57fff700 1 -- 172.21.15.158:0/3995400668 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda48008db0 con 0x7fda60154160 2019-12-05T03:49:55.025 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.015+0000 7fda65291700 1 -- 172.21.15.158:0/3995400668 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda6013a610 con 0x7fda60154160 2019-12-05T03:49:55.025 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.015+0000 7fda57fff700 1 -- 172.21.15.158:0/3995400668 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda48005b20 con 0x7fda60154160 2019-12-05T03:49:55.026 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.015+0000 7fda65291700 1 -- 172.21.15.158:0/3995400668 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda6012de50 con 0x7fda60154160 2019-12-05T03:49:55.026 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.015+0000 7fda5f7fe700 1 --2- 172.21.15.158:0/3995400668 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda60154160 0x7fda6007b8b0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fda48002f30 tx=0x7fda48008a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.026 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.015+0000 7fda57fff700 1 -- 172.21.15.158:0/3995400668 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fda480130b0 con 0x7fda60154160 2019-12-05T03:49:55.026 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.015+0000 7fda5f7fe700 1 --2- 172.21.15.158:0/3995400668 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda60154160 0x7fda6007b8b0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fda48002f30 tx=0x7fda48008a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.026 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.015+0000 7fda57fff700 1 --2- 172.21.15.158:0/3995400668 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fda4403ac30 0x7fda4403d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:55.026 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.019+0000 7fda57fff700 1 -- 172.21.15.158:0/3995400668 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fda4804b6a0 con 0x7fda60154160 2019-12-05T03:49:55.026 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.019+0000 7fda5effd700 1 --2- 172.21.15.158:0/3995400668 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fda4403ac30 0x7fda4403d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:55.027 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.019+0000 7fda5effd700 1 --2- 172.21.15.158:0/3995400668 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fda4403ac30 0x7fda4403d140 crc :-1 s=READY pgs=42 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:55.027 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.023+0000 7fda65291700 1 -- 172.21.15.158:0/3995400668 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda600554e0 con 0x7fda60154160 2019-12-05T03:49:55.033 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.031+0000 7fda5f7fe700 1 --2- 172.21.15.158:0/3995400668 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda60154160 0x7fda6007b8b0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fda48002f30 tx=0x7fda48008a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.033 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.031+0000 7fda57fff700 1 -- 172.21.15.158:0/3995400668 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fda48005db0 con 0x7fda60154160 2019-12-05T03:49:55.193 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.191+0000 7fda65291700 1 -- 172.21.15.158:0/3995400668 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fda6012c340 con 0x7fda60154160 2019-12-05T03:49:55.194 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.191+0000 7fda5f7fe700 1 --2- 172.21.15.158:0/3995400668 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda60154160 0x7fda6007b8b0 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fda48002f30 tx=0x7fda48008a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.194 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.191+0000 7fda57fff700 1 -- 172.21.15.158:0/3995400668 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7fda48032980 con 0x7fda60154160 2019-12-05T03:49:55.194 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:49:55.197 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.195+0000 7fda65291700 1 -- 172.21.15.158:0/3995400668 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fda4403ac30 msgr2=0x7fda4403d140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:55.197 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.195+0000 7fda65291700 1 --2- 172.21.15.158:0/3995400668 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fda4403ac30 0x7fda4403d140 crc :-1 s=READY pgs=42 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:55.197 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.195+0000 7fda65291700 1 -- 172.21.15.158:0/3995400668 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda60154160 msgr2=0x7fda6007b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:55.197 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.195+0000 7fda65291700 1 --2- 172.21.15.158:0/3995400668 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda60154160 0x7fda6007b8b0 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7fda48002f30 tx=0x7fda48008a40).stop 2019-12-05T03:49:55.197 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.195+0000 7fda65291700 1 -- 172.21.15.158:0/3995400668 shutdown_connections 2019-12-05T03:49:55.198 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.195+0000 7fda65291700 1 --2- 172.21.15.158:0/3995400668 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fda4403ac30 0x7fda4403d140 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:55.198 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.195+0000 7fda65291700 1 --2- 172.21.15.158:0/3995400668 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda60154160 0x7fda6007b8b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:55.198 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.195+0000 7fda65291700 1 --2- 172.21.15.158:0/3995400668 >> v2:172.21.15.96:3300/0 conn(0x7fda6013a1e0 0x7fda6013a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:55.198 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.195+0000 7fda65291700 1 -- 172.21.15.158:0/3995400668 shutdown_connections 2019-12-05T03:49:55.198 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.195+0000 7fda65291700 1 -- 172.21.15.158:0/3995400668 wait complete. 2019-12-05T03:49:55.198 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.195+0000 7fda65291700 1 -- 172.21.15.158:0/3995400668 >> 172.21.15.158:0/3995400668 conn(0x7fda600b3910 msgr2=0x7fda6005a070 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:49:55.206 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2019-12-05T03:49:55.304 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.299+0000 7fe5eb94d700 1 Processor -- start 2019-12-05T03:49:55.305 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.299+0000 7fe5eb94d700 1 -- start start 2019-12-05T03:49:55.305 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.299+0000 7fe5eb94d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe5e409cf60 0x7fe5e409a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:55.305 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.299+0000 7fe5eb94d700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe5e405a740 0x7fe5e4151460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:55.305 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.299+0000 7fe5eb94d700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe5e41519b0 0x7fe5e40b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:55.305 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.299+0000 7fe5eb94d700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5e40b1730 con 0x7fe5e41519b0 2019-12-05T03:49:55.305 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.299+0000 7fe5eb94d700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5e40b19d0 con 0x7fe5e409cf60 2019-12-05T03:49:55.306 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.299+0000 7fe5eb94d700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e405ab70 con 0x7fe5e405a740 2019-12-05T03:49:55.306 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.299+0000 7fe5e9eea700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe5e409cf60 0x7fe5e409a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:55.306 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.299+0000 7fe5e9eea700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe5e409cf60 0x7fe5e409a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53272/0 (socket says 172.21.15.158:53272) 2019-12-05T03:49:55.306 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.299+0000 7fe5e9eea700 1 -- 172.21.15.158:0/3534485862 learned_addr learned my addr 172.21.15.158:0/3534485862 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:49:55.306 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.299+0000 7fe5e96e9700 1 --2- 172.21.15.158:0/3534485862 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe5e405a740 0x7fe5e4151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:55.306 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.299+0000 7fe5ea6eb700 1 --2- 172.21.15.158:0/3534485862 >> v2:172.21.15.96:3300/0 conn(0x7fe5e41519b0 0x7fe5e40b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:55.306 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.299+0000 7fe5e9eea700 1 -- 172.21.15.158:0/3534485862 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe5e405a740 msgr2=0x7fe5e4151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:49:55.307 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.299+0000 7fe5e9eea700 1 --2- 172.21.15.158:0/3534485862 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe5e405a740 0x7fe5e4151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:49:55.307 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.299+0000 7fe5e9eea700 1 -- 172.21.15.158:0/3534485862 >> v2:172.21.15.96:3300/0 conn(0x7fe5e41519b0 msgr2=0x7fe5e40b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:49:55.307 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.299+0000 7fe5e9eea700 1 --2- 172.21.15.158:0/3534485862 >> v2:172.21.15.96:3300/0 conn(0x7fe5e41519b0 0x7fe5e40b52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:49:55.307 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.299+0000 7fe5e9eea700 1 -- 172.21.15.158:0/3534485862 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e40accb0 con 0x7fe5e409cf60 2019-12-05T03:49:55.307 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.299+0000 7fe5e96e9700 1 --2- 172.21.15.158:0/3534485862 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe5e405a740 0x7fe5e4151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-12-05T03:49:55.307 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.299+0000 7fe5e9eea700 1 --2- 172.21.15.158:0/3534485862 >> v2:172.21.15.158:3300/0 conn(0x7fe5e409cf60 0x7fe5e409a320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe5e40b1b90 tx=0x7fe5d800fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.307 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.299+0000 7fe5e9eea700 1 --2- 172.21.15.158:0/3534485862 >> v2:172.21.15.158:3300/0 conn(0x7fe5e409cf60 0x7fe5e409a320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe5e40b1b90 tx=0x7fe5d800fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.308 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.299+0000 7fe5e9eea700 1 --2- 172.21.15.158:0/3534485862 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe5e409cf60 0x7fe5e409a320 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7fe5e40b1b90 tx=0x7fe5d800fdb0).ready entity=mon.1 client_cookie=a477ac53c7c94087 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:55.308 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.299+0000 7fe5e9eea700 1 --2- 172.21.15.158:0/3534485862 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe5e409cf60 0x7fe5e409a320 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7fe5e40b1b90 tx=0x7fe5d800fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.308 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.299+0000 7fe5e8ee8700 1 -- 172.21.15.158:0/3534485862 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5d80113f0 con 0x7fe5e409cf60 2019-12-05T03:49:55.308 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.299+0000 7fe5e9eea700 1 --2- 172.21.15.158:0/3534485862 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe5e409cf60 0x7fe5e409a320 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7fe5e40b1b90 tx=0x7fe5d800fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.308 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.299+0000 7fe5e9eea700 1 --2- 172.21.15.158:0/3534485862 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe5e409cf60 0x7fe5e409a320 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7fe5e40b1b90 tx=0x7fe5d800fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.308 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.299+0000 7fe5e8ee8700 1 -- 172.21.15.158:0/3534485862 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d8008bb0 con 0x7fe5e409cf60 2019-12-05T03:49:55.309 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.299+0000 7fe5e8ee8700 1 -- 172.21.15.158:0/3534485862 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5d80119d0 con 0x7fe5e409cf60 2019-12-05T03:49:55.309 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.299+0000 7fe5eb94d700 1 -- 172.21.15.158:0/3534485862 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe5e409cf60 msgr2=0x7fe5e409a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:55.309 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.299+0000 7fe5eb94d700 1 --2- 172.21.15.158:0/3534485862 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe5e409cf60 0x7fe5e409a320 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7fe5e40b1b90 tx=0x7fe5d800fdb0).stop 2019-12-05T03:49:55.309 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.303+0000 7fe5eb94d700 1 -- 172.21.15.158:0/3534485862 shutdown_connections 2019-12-05T03:49:55.309 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.303+0000 7fe5eb94d700 1 --2- 172.21.15.158:0/3534485862 >> v2:172.21.15.96:3300/0 conn(0x7fe5e41519b0 0x7fe5e40b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:49:55.309 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.303+0000 7fe5eb94d700 1 --2- 172.21.15.158:0/3534485862 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe5e409cf60 0x7fe5e409a320 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:55.309 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.303+0000 7fe5eb94d700 1 --2- 172.21.15.158:0/3534485862 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe5e405a740 0x7fe5e4151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:49:55.310 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.303+0000 7fe5eb94d700 1 -- 172.21.15.158:0/3534485862 shutdown_connections 2019-12-05T03:49:55.310 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.303+0000 7fe5eb94d700 1 -- 172.21.15.158:0/3534485862 wait complete. 2019-12-05T03:49:55.310 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.303+0000 7fe5eb94d700 1 -- 172.21.15.158:0/3534485862 >> 172.21.15.158:0/3534485862 conn(0x7fe5e40b7e60 msgr2=0x7fe5e40b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:49:55.313 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.303+0000 7fe5eb94d700 1 Processor -- start 2019-12-05T03:49:55.313 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.303+0000 7fe5eb94d700 1 -- start start 2019-12-05T03:49:55.313 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.303+0000 7fe5eb94d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe5e413c980 0x7fe5e40b3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:55.313 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.303+0000 7fe5eb94d700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe5e407d8b0 0x7fe5e407dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:55.314 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.303+0000 7fe5eb94d700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5e4138cc0 con 0x7fe5e4154810 2019-12-05T03:49:55.314 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.303+0000 7fe5eb94d700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5e4154f00 con 0x7fe5e407d8b0 2019-12-05T03:49:55.314 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.303+0000 7fe5eb94d700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5e4138a20 con 0x7fe5e413c980 2019-12-05T03:49:55.314 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.303+0000 7fe5e9eea700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe5e413c980 0x7fe5e40b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:55.315 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.303+0000 7fe5e9eea700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe5e413c980 0x7fe5e40b3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53278/0 (socket says 172.21.15.158:53278) 2019-12-05T03:49:55.315 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.303+0000 7fe5e9eea700 1 -- 172.21.15.158:0/2756260439 learned_addr learned my addr 172.21.15.158:0/2756260439 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:49:55.315 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.303+0000 7fe5ea6eb700 1 --2- 172.21.15.158:0/2756260439 >> v2:172.21.15.96:3300/0 conn(0x7fe5e407d8b0 0x7fe5e407dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:55.315 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.303+0000 7fe5e9eea700 1 -- 172.21.15.158:0/2756260439 >> v2:172.21.15.96:3300/0 conn(0x7fe5e407d8b0 msgr2=0x7fe5e407dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:55.315 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.303+0000 7fe5e9eea700 1 --2- 172.21.15.158:0/2756260439 >> v2:172.21.15.96:3300/0 conn(0x7fe5e407d8b0 0x7fe5e407dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:55.315 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.303+0000 7fe5e9eea700 1 -- 172.21.15.158:0/2756260439 >> v1:172.21.15.96:6789/0 conn(0x7fe5e4154810 legacy=0x7fe5e4152a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:55.315 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.303+0000 7fe5e9eea700 1 -- 172.21.15.158:0/2756260439 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e4154c40 con 0x7fe5e413c980 2019-12-05T03:49:55.316 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.303+0000 7fe5ea6eb700 1 --2- 172.21.15.158:0/2756260439 >> v2:172.21.15.96:3300/0 conn(0x7fe5e407d8b0 0x7fe5e407dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-12-05T03:49:55.316 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.303+0000 7fe5e9eea700 1 --2- 172.21.15.158:0/2756260439 >> v2:172.21.15.158:3300/0 conn(0x7fe5e413c980 0x7fe5e40b3700 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe5e40adc10 tx=0x7fe5d8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.316 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.307+0000 7fe5e9eea700 1 --2- 172.21.15.158:0/2756260439 >> v2:172.21.15.158:3300/0 conn(0x7fe5e413c980 0x7fe5e40b3700 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe5e40adc10 tx=0x7fe5d8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.316 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.307+0000 7fe5e9eea700 1 --2- 172.21.15.158:0/2756260439 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe5e413c980 0x7fe5e40b3700 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7fe5e40adc10 tx=0x7fe5d8008c60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:55.316 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.307+0000 7fe5e9eea700 1 --2- 172.21.15.158:0/2756260439 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe5e413c980 0x7fe5e40b3700 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7fe5e40adc10 tx=0x7fe5d8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.316 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.307+0000 7fe5d67fc700 1 -- 172.21.15.158:0/2756260439 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5d8007150 con 0x7fe5e413c980 2019-12-05T03:49:55.316 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.307+0000 7fe5e9eea700 1 --2- 172.21.15.158:0/2756260439 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe5e413c980 0x7fe5e40b3700 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7fe5e40adc10 tx=0x7fe5d8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.317 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.307+0000 7fe5e9eea700 1 --2- 172.21.15.158:0/2756260439 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe5e413c980 0x7fe5e40b3700 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7fe5e40adc10 tx=0x7fe5d8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.317 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.307+0000 7fe5d67fc700 1 -- 172.21.15.158:0/2756260439 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d80115f0 con 0x7fe5e413c980 2019-12-05T03:49:55.317 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.307+0000 7fe5d67fc700 1 -- 172.21.15.158:0/2756260439 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5d8005730 con 0x7fe5e413c980 2019-12-05T03:49:55.317 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.307+0000 7fe5eb94d700 1 -- 172.21.15.158:0/2756260439 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5e4138ef0 con 0x7fe5e413c980 2019-12-05T03:49:55.317 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.307+0000 7fe5eb94d700 1 -- 172.21.15.158:0/2756260439 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5e4139470 con 0x7fe5e413c980 2019-12-05T03:49:55.317 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.307+0000 7fe5e9eea700 1 --2- 172.21.15.158:0/2756260439 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe5e413c980 0x7fe5e40b3700 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7fe5e40adc10 tx=0x7fe5d8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.317 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.307+0000 7fe5d67fc700 1 -- 172.21.15.158:0/2756260439 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fe5d8005a00 con 0x7fe5e413c980 2019-12-05T03:49:55.318 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.307+0000 7fe5e9eea700 1 --2- 172.21.15.158:0/2756260439 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe5e413c980 0x7fe5e40b3700 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7fe5e40adc10 tx=0x7fe5d8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.318 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.307+0000 7fe5d67fc700 1 --2- 172.21.15.158:0/2756260439 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fe5cc03ace0 0x7fe5cc03d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:55.318 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.307+0000 7fe5d67fc700 1 -- 172.21.15.158:0/2756260439 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe5d804b740 con 0x7fe5e413c980 2019-12-05T03:49:55.318 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.307+0000 7fe5e96e9700 1 --2- 172.21.15.158:0/2756260439 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fe5cc03ace0 0x7fe5cc03d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:55.318 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.307+0000 7fe5e96e9700 1 --2- 172.21.15.158:0/2756260439 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fe5cc03ace0 0x7fe5cc03d1f0 crc :-1 s=READY pgs=43 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:55.319 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.315+0000 7fe5eb94d700 1 -- 172.21.15.158:0/2756260439 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5e40554e0 con 0x7fe5e413c980 2019-12-05T03:49:55.322 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.319+0000 7fe5e9eea700 1 --2- 172.21.15.158:0/2756260439 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe5e413c980 0x7fe5e40b3700 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7fe5e40adc10 tx=0x7fe5d8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.322 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.319+0000 7fe5d67fc700 1 -- 172.21.15.158:0/2756260439 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fe5e4154c40 con 0x7fe5e413c980 2019-12-05T03:49:55.475 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.471+0000 7fe5eb94d700 1 -- 172.21.15.158:0/2756260439 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe5e4066940 con 0x7fe5e413c980 2019-12-05T03:49:55.475 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.475+0000 7fe5e9eea700 1 --2- 172.21.15.158:0/2756260439 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe5e413c980 0x7fe5e40b3700 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7fe5e40adc10 tx=0x7fe5d8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.476 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.475+0000 7fe5d67fc700 1 -- 172.21.15.158:0/2756260439 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+64 (secure 0 0 0) 0x7fe5d80327c0 con 0x7fe5e413c980 2019-12-05T03:49:55.476 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:49:55.476 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2019-12-05T03:49:55.476 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:49:55.476 INFO:teuthology.orchestra.run.smithi158.stdout: "poolnum": 1, 2019-12-05T03:49:55.476 INFO:teuthology.orchestra.run.smithi158.stdout: "poolname": "rbd" 2019-12-05T03:49:55.477 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:49:55.477 INFO:teuthology.orchestra.run.smithi158.stdout:] 2019-12-05T03:49:55.478 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.475+0000 7fe5eb94d700 1 -- 172.21.15.158:0/2756260439 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fe5cc03ace0 msgr2=0x7fe5cc03d1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:55.478 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.475+0000 7fe5eb94d700 1 --2- 172.21.15.158:0/2756260439 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fe5cc03ace0 0x7fe5cc03d1f0 crc :-1 s=READY pgs=43 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:55.478 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.475+0000 7fe5eb94d700 1 -- 172.21.15.158:0/2756260439 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe5e413c980 msgr2=0x7fe5e40b3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:55.479 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.475+0000 7fe5eb94d700 1 --2- 172.21.15.158:0/2756260439 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe5e413c980 0x7fe5e40b3700 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7fe5e40adc10 tx=0x7fe5d8008c60).stop 2019-12-05T03:49:55.479 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.475+0000 7fe5eb94d700 1 -- 172.21.15.158:0/2756260439 shutdown_connections 2019-12-05T03:49:55.479 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.475+0000 7fe5eb94d700 1 --2- 172.21.15.158:0/2756260439 >> v2:172.21.15.96:3300/0 conn(0x7fe5e407d8b0 0x7fe5e407dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:55.479 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.475+0000 7fe5eb94d700 1 --2- 172.21.15.158:0/2756260439 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe5e413c980 0x7fe5e40b3700 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:55.479 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.475+0000 7fe5eb94d700 1 --2- 172.21.15.158:0/2756260439 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fe5cc03ace0 0x7fe5cc03d1f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:55.479 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.475+0000 7fe5eb94d700 1 -- 172.21.15.158:0/2756260439 shutdown_connections 2019-12-05T03:49:55.479 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.475+0000 7fe5eb94d700 1 -- 172.21.15.158:0/2756260439 wait complete. 2019-12-05T03:49:55.480 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.475+0000 7fe5eb94d700 1 -- 172.21.15.158:0/2756260439 >> 172.21.15.158:0/2756260439 conn(0x7fe5e409bb00 msgr2=0x7fe5e412e530 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:49:55.488 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2019-12-05T03:49:55.488 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2019-12-05T03:49:55.589 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.579+0000 7f158cd33700 1 Processor -- start 2019-12-05T03:49:55.589 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.579+0000 7f158cd33700 1 -- start start 2019-12-05T03:49:55.590 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.583+0000 7f158cd33700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f15880b6970 0x7f158809add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:55.590 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.583+0000 7f158cd33700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f158809ba40 0x7f158805a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:55.590 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.583+0000 7f158cd33700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1588099e30 con 0x7f158805a950 2019-12-05T03:49:55.590 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.583+0000 7f158cd33700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f158809d210 con 0x7f15880b6970 2019-12-05T03:49:55.590 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.583+0000 7f158cd33700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1588099b90 con 0x7f158809ba40 2019-12-05T03:49:55.590 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.583+0000 7f1586d9d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f15880b6970 0x7f158809add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:55.590 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.583+0000 7f1586d9d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f15880b6970 0x7f158809add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53284/0 (socket says 172.21.15.158:53284) 2019-12-05T03:49:55.591 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.583+0000 7f1586d9d700 1 -- 172.21.15.158:0/701889535 learned_addr learned my addr 172.21.15.158:0/701889535 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:49:55.591 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.583+0000 7f158659c700 1 --2- 172.21.15.158:0/701889535 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f158809ba40 0x7f158805a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:55.591 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.583+0000 7f1586d9d700 1 -- 172.21.15.158:0/701889535 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f158809ba40 msgr2=0x7f158805a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:49:55.591 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.583+0000 7f1586d9d700 1 --2- 172.21.15.158:0/701889535 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f158809ba40 0x7f158805a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:49:55.591 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.583+0000 7f1586d9d700 1 -- 172.21.15.158:0/701889535 >> v1:172.21.15.96:6789/0 conn(0x7f158805a950 legacy=0x7f1588155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:55.591 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.583+0000 7f1586d9d700 1 -- 172.21.15.158:0/701889535 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158807e960 con 0x7f15880b6970 2019-12-05T03:49:55.591 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.583+0000 7f1586d9d700 1 --2- 172.21.15.158:0/701889535 >> v2:172.21.15.158:3300/0 conn(0x7f15880b6970 0x7f158809add0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1578008790 tx=0x7f157800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.592 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.583+0000 7f1586d9d700 1 --2- 172.21.15.158:0/701889535 >> v2:172.21.15.158:3300/0 conn(0x7f15880b6970 0x7f158809add0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1578008790 tx=0x7f157800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.592 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.583+0000 7f1586d9d700 1 --2- 172.21.15.158:0/701889535 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15880b6970 0x7f158809add0 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7f1578008790 tx=0x7f157800fd30).ready entity=mon.1 client_cookie=2aa0573a5efcd56f server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:55.592 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.583+0000 7f1586d9d700 1 --2- 172.21.15.158:0/701889535 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15880b6970 0x7f158809add0 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7f1578008790 tx=0x7f157800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.592 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.583+0000 7f1585d9b700 1 -- 172.21.15.158:0/701889535 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1578008c90 con 0x7f15880b6970 2019-12-05T03:49:55.592 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.583+0000 7f1586d9d700 1 --2- 172.21.15.158:0/701889535 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15880b6970 0x7f158809add0 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7f1578008790 tx=0x7f157800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.592 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.583+0000 7f1585d9b700 1 -- 172.21.15.158:0/701889535 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15780088b0 con 0x7f15880b6970 2019-12-05T03:49:55.592 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.583+0000 7f1586d9d700 1 --2- 172.21.15.158:0/701889535 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15880b6970 0x7f158809add0 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7f1578008790 tx=0x7f157800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.593 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.583+0000 7f1585d9b700 1 -- 172.21.15.158:0/701889535 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1578011b10 con 0x7f15880b6970 2019-12-05T03:49:55.593 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.583+0000 7f158cd33700 1 -- 172.21.15.158:0/701889535 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15880b6970 msgr2=0x7f158809add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:55.593 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.583+0000 7f158cd33700 1 --2- 172.21.15.158:0/701889535 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15880b6970 0x7f158809add0 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7f1578008790 tx=0x7f157800fd30).stop 2019-12-05T03:49:55.593 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.583+0000 7f158cd33700 1 -- 172.21.15.158:0/701889535 shutdown_connections 2019-12-05T03:49:55.593 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.583+0000 7f158cd33700 1 --2- 172.21.15.158:0/701889535 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15880b6970 0x7f158809add0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:55.593 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.583+0000 7f158cd33700 1 --2- 172.21.15.158:0/701889535 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f158809ba40 0x7f158805a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:49:55.593 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.583+0000 7f158cd33700 1 -- 172.21.15.158:0/701889535 shutdown_connections 2019-12-05T03:49:55.594 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.583+0000 7f158cd33700 1 -- 172.21.15.158:0/701889535 wait complete. 2019-12-05T03:49:55.594 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.583+0000 7f158cd33700 1 -- 172.21.15.158:0/701889535 >> 172.21.15.158:0/701889535 conn(0x7f15880b7ef0 msgr2=0x7f15880b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:49:55.597 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.587+0000 7f158cd33700 1 Processor -- start 2019-12-05T03:49:55.597 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.587+0000 7f158cd33700 1 -- start start 2019-12-05T03:49:55.598 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.591+0000 7f158cd33700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f15880ae4c0 0x7f15880ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:55.598 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.591+0000 7f158cd33700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f158813dcd0 con 0x7f158812cb50 2019-12-05T03:49:55.598 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.591+0000 7f158cd33700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15880ac4f0 con 0x7f158813d8a0 2019-12-05T03:49:55.598 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.591+0000 7f158cd33700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15880ac720 con 0x7f15880ae4c0 2019-12-05T03:49:55.598 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.591+0000 7f158759e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f15880ae4c0 0x7f15880ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:55.598 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.591+0000 7f158659c700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f158813d8a0 0x7f15880b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48072/0 (socket says 172.21.15.158:48072) 2019-12-05T03:49:55.598 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.591+0000 7f158659c700 1 -- 172.21.15.158:0/1943294935 learned_addr learned my addr 172.21.15.158:0/1943294935 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:49:55.599 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.591+0000 7f158759e700 1 -- 172.21.15.158:0/1943294935 >> v1:172.21.15.158:6789/0 conn(0x7f158813d8a0 legacy=0x7f15880b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:55.599 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.591+0000 7f158759e700 1 -- 172.21.15.158:0/1943294935 >> v1:172.21.15.96:6789/0 conn(0x7f158812cb50 legacy=0x7f158813a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:55.599 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.591+0000 7f15777fe700 1 -- 172.21.15.158:0/1943294935 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 533842249 0 0) 0x7f15880ac4f0 con 0x7f158813d8a0 2019-12-05T03:49:55.599 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.591+0000 7f158759e700 1 -- 172.21.15.158:0/1943294935 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15880aee40 con 0x7f15880ae4c0 2019-12-05T03:49:55.599 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.591+0000 7f158759e700 1 --2- 172.21.15.158:0/1943294935 >> v2:172.21.15.158:3300/0 conn(0x7f15880ae4c0 0x7f15880ae8f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1580001210 tx=0x7f1580010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.599 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.591+0000 7f158759e700 1 --2- 172.21.15.158:0/1943294935 >> v2:172.21.15.158:3300/0 conn(0x7f15880ae4c0 0x7f15880ae8f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1580001210 tx=0x7f1580010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.599 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.591+0000 7f158759e700 1 --2- 172.21.15.158:0/1943294935 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15880ae4c0 0x7f15880ae8f0 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7f1580001210 tx=0x7f1580010ac0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:55.600 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.591+0000 7f158759e700 1 --2- 172.21.15.158:0/1943294935 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15880ae4c0 0x7f15880ae8f0 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f1580001210 tx=0x7f1580010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.600 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.591+0000 7f15777fe700 1 -- 172.21.15.158:0/1943294935 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1580002240 con 0x7f15880ae4c0 2019-12-05T03:49:55.600 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.591+0000 7f158759e700 1 --2- 172.21.15.158:0/1943294935 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15880ae4c0 0x7f15880ae8f0 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f1580001210 tx=0x7f1580010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.600 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.591+0000 7f158759e700 1 --2- 172.21.15.158:0/1943294935 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15880ae4c0 0x7f15880ae8f0 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f1580001210 tx=0x7f1580010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.600 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.591+0000 7f15777fe700 1 -- 172.21.15.158:0/1943294935 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1580006ad0 con 0x7f15880ae4c0 2019-12-05T03:49:55.600 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.591+0000 7f158cd33700 1 -- 172.21.15.158:0/1943294935 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15880af0b0 con 0x7f15880ae4c0 2019-12-05T03:49:55.600 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.591+0000 7f15777fe700 1 -- 172.21.15.158:0/1943294935 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1580002860 con 0x7f15880ae4c0 2019-12-05T03:49:55.601 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.591+0000 7f158cd33700 1 -- 172.21.15.158:0/1943294935 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15880593f0 con 0x7f15880ae4c0 2019-12-05T03:49:55.601 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.591+0000 7f158759e700 1 --2- 172.21.15.158:0/1943294935 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15880ae4c0 0x7f15880ae8f0 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f1580001210 tx=0x7f1580010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.601 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.591+0000 7f158759e700 1 --2- 172.21.15.158:0/1943294935 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15880ae4c0 0x7f15880ae8f0 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f1580001210 tx=0x7f1580010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.601 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.591+0000 7f15777fe700 1 -- 172.21.15.158:0/1943294935 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f1580002b70 con 0x7f15880ae4c0 2019-12-05T03:49:55.601 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.591+0000 7f15777fe700 1 --2- 172.21.15.158:0/1943294935 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f156c03abc0 0x7f156c03d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:55.601 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.591+0000 7f15777fe700 1 -- 172.21.15.158:0/1943294935 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f158004b500 con 0x7f15880ae4c0 2019-12-05T03:49:55.601 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.591+0000 7f1586d9d700 1 --2- 172.21.15.158:0/1943294935 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f156c03abc0 0x7f156c03d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:55.602 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.591+0000 7f1586d9d700 1 --2- 172.21.15.158:0/1943294935 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f156c03abc0 0x7f156c03d0d0 crc :-1 s=READY pgs=44 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:55.602 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.595+0000 7f158cd33700 1 -- 172.21.15.158:0/1943294935 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15880554e0 con 0x7f15880ae4c0 2019-12-05T03:49:55.606 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.603+0000 7f158759e700 1 --2- 172.21.15.158:0/1943294935 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15880ae4c0 0x7f15880ae8f0 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f1580001210 tx=0x7f1580010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:55.606 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.603+0000 7f15777fe700 1 -- 172.21.15.158:0/1943294935 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f1580032540 con 0x7f15880ae4c0 2019-12-05T03:49:55.767 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:55.763+0000 7f158cd33700 1 -- 172.21.15.158:0/1943294935 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7f1588066940 con 0x7f15880ae4c0 2019-12-05T03:49:56.634 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.631+0000 7f158759e700 1 --2- 172.21.15.158:0/1943294935 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15880ae4c0 0x7f15880ae8f0 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7f1580001210 tx=0x7f1580010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:56.634 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.631+0000 7f15777fe700 1 -- 172.21.15.158:0/1943294935 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v18) v1 ==== 133+0+0 (secure 0 0 0) 0x7f15800327a0 con 0x7f15880ae4c0 2019-12-05T03:49:56.682 INFO:teuthology.orchestra.run.smithi158.stderr:pool 'cephfs_metadata' created 2019-12-05T03:49:56.688 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.683+0000 7f158cd33700 1 -- 172.21.15.158:0/1943294935 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f156c03abc0 msgr2=0x7f156c03d0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:56.689 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.683+0000 7f158cd33700 1 --2- 172.21.15.158:0/1943294935 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f156c03abc0 0x7f156c03d0d0 crc :-1 s=READY pgs=44 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:56.689 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.683+0000 7f158cd33700 1 -- 172.21.15.158:0/1943294935 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15880ae4c0 msgr2=0x7f15880ae8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:56.689 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.683+0000 7f158cd33700 1 --2- 172.21.15.158:0/1943294935 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15880ae4c0 0x7f15880ae8f0 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7f1580001210 tx=0x7f1580010ac0).stop 2019-12-05T03:49:56.689 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.683+0000 7f158cd33700 1 -- 172.21.15.158:0/1943294935 shutdown_connections 2019-12-05T03:49:56.689 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.687+0000 7f158cd33700 1 --2- 172.21.15.158:0/1943294935 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15880ae4c0 0x7f15880ae8f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:56.689 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.687+0000 7f158cd33700 1 --2- 172.21.15.158:0/1943294935 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f156c03abc0 0x7f156c03d0d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:56.690 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.687+0000 7f158cd33700 1 -- 172.21.15.158:0/1943294935 shutdown_connections 2019-12-05T03:49:56.690 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.687+0000 7f158cd33700 1 -- 172.21.15.158:0/1943294935 wait complete. 2019-12-05T03:49:56.690 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.687+0000 7f158cd33700 1 -- 172.21.15.158:0/1943294935 >> 172.21.15.158:0/1943294935 conn(0x7f158807db60 msgr2=0x7f15880b5370 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:49:56.701 INFO:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2019-12-05T03:49:56.702 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data m=2 k=2 crush-failure-domain=osd 2019-12-05T03:49:56.807 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.799+0000 7fac59cbf700 1 Processor -- start 2019-12-05T03:49:56.807 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.799+0000 7fac59cbf700 1 -- start start 2019-12-05T03:49:56.808 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.803+0000 7fac59cbf700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fac540b6960 0x7fac5409adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:56.808 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.803+0000 7fac59cbf700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fac5409ba30 0x7fac5405a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:56.808 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.803+0000 7fac59cbf700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac54099e20 con 0x7fac5405a940 2019-12-05T03:49:56.808 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.803+0000 7fac59cbf700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac5409d200 con 0x7fac540b6960 2019-12-05T03:49:56.808 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.803+0000 7fac59cbf700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac54099b80 con 0x7fac5409ba30 2019-12-05T03:49:56.808 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.803+0000 7fac53fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fac540b6960 0x7fac5409adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:56.809 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.803+0000 7fac58a5d700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fac5405a940 0x7fac54155280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48082/0 (socket says 172.21.15.158:48082) 2019-12-05T03:49:56.809 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.803+0000 7fac58a5d700 1 -- 172.21.15.158:0/3379072356 learned_addr learned my addr 172.21.15.158:0/3379072356 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:49:56.809 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.803+0000 7fac537fe700 1 --2- 172.21.15.158:0/3379072356 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fac5409ba30 0x7fac5405a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:56.809 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.803+0000 7fac53fff700 1 -- 172.21.15.158:0/3379072356 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fac5409ba30 msgr2=0x7fac5405a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:49:56.809 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.803+0000 7fac53fff700 1 --2- 172.21.15.158:0/3379072356 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fac5409ba30 0x7fac5405a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:49:56.809 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.803+0000 7fac53fff700 1 -- 172.21.15.158:0/3379072356 >> v1:172.21.15.158:6789/0 conn(0x7fac5405a940 legacy=0x7fac54155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:56.810 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.803+0000 7fac52ffd700 1 -- 172.21.15.158:0/3379072356 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1570392252 0 0) 0x7fac54099e20 con 0x7fac5405a940 2019-12-05T03:49:56.810 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.803+0000 7fac53fff700 1 -- 172.21.15.158:0/3379072356 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac5407e950 con 0x7fac540b6960 2019-12-05T03:49:56.810 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.803+0000 7fac53fff700 1 --2- 172.21.15.158:0/3379072356 >> v2:172.21.15.158:3300/0 conn(0x7fac540b6960 0x7fac5409adc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fac3c008790 tx=0x7fac3c00fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:56.810 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.803+0000 7fac53fff700 1 --2- 172.21.15.158:0/3379072356 >> v2:172.21.15.158:3300/0 conn(0x7fac540b6960 0x7fac5409adc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fac3c008790 tx=0x7fac3c00fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:56.810 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.803+0000 7fac53fff700 1 --2- 172.21.15.158:0/3379072356 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fac540b6960 0x7fac5409adc0 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7fac3c008790 tx=0x7fac3c00fc70).ready entity=mon.1 client_cookie=2a252d5834f3d1f7 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:56.810 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.803+0000 7fac53fff700 1 --2- 172.21.15.158:0/3379072356 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fac540b6960 0x7fac5409adc0 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fac3c008790 tx=0x7fac3c00fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:56.811 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.803+0000 7fac52ffd700 1 -- 172.21.15.158:0/3379072356 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac3c008bb0 con 0x7fac540b6960 2019-12-05T03:49:56.811 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.803+0000 7fac53fff700 1 --2- 172.21.15.158:0/3379072356 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fac540b6960 0x7fac5409adc0 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fac3c008790 tx=0x7fac3c00fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:56.811 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.803+0000 7fac53fff700 1 --2- 172.21.15.158:0/3379072356 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fac540b6960 0x7fac5409adc0 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7fac3c008790 tx=0x7fac3c00fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:56.811 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.803+0000 7fac52ffd700 1 -- 172.21.15.158:0/3379072356 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac3c0087d0 con 0x7fac540b6960 2019-12-05T03:49:56.811 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.803+0000 7fac52ffd700 1 -- 172.21.15.158:0/3379072356 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac3c011860 con 0x7fac540b6960 2019-12-05T03:49:56.811 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.803+0000 7fac59cbf700 1 -- 172.21.15.158:0/3379072356 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fac540b6960 msgr2=0x7fac5409adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:56.811 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.803+0000 7fac59cbf700 1 --2- 172.21.15.158:0/3379072356 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fac540b6960 0x7fac5409adc0 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7fac3c008790 tx=0x7fac3c00fc70).stop 2019-12-05T03:49:56.812 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.803+0000 7fac59cbf700 1 -- 172.21.15.158:0/3379072356 shutdown_connections 2019-12-05T03:49:56.812 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.803+0000 7fac59cbf700 1 --2- 172.21.15.158:0/3379072356 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fac540b6960 0x7fac5409adc0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:56.812 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.803+0000 7fac59cbf700 1 --2- 172.21.15.158:0/3379072356 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fac5409ba30 0x7fac5405a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:49:56.812 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.803+0000 7fac59cbf700 1 -- 172.21.15.158:0/3379072356 shutdown_connections 2019-12-05T03:49:56.812 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.803+0000 7fac59cbf700 1 -- 172.21.15.158:0/3379072356 wait complete. 2019-12-05T03:49:56.812 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.803+0000 7fac59cbf700 1 -- 172.21.15.158:0/3379072356 >> 172.21.15.158:0/3379072356 conn(0x7fac540b7ee0 msgr2=0x7fac540b3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:49:56.816 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.807+0000 7fac59cbf700 1 Processor -- start 2019-12-05T03:49:56.816 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.807+0000 7fac59cbf700 1 -- start start 2019-12-05T03:49:56.817 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.807+0000 7fac59cbf700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fac540ac450 0x7fac5412cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:56.817 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.807+0000 7fac59cbf700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fac540ad410 0x7fac5413a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:56.817 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.807+0000 7fac59cbf700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac5413e4c0 con 0x7fac540acfe0 2019-12-05T03:49:56.817 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.807+0000 7fac59cbf700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac540ad840 con 0x7fac540ad410 2019-12-05T03:49:56.817 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.807+0000 7fac59cbf700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac5413e800 con 0x7fac540ac450 2019-12-05T03:49:56.817 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.807+0000 7fac537fe700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fac540acfe0 0x7fac5413dcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48084/0 (socket says 172.21.15.158:48084) 2019-12-05T03:49:56.817 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.807+0000 7fac537fe700 1 -- 172.21.15.158:0/543933412 learned_addr learned my addr 172.21.15.158:0/543933412 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:49:56.818 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.807+0000 7fac53fff700 1 --2- 172.21.15.158:0/543933412 >> v2:172.21.15.158:3300/0 conn(0x7fac540ac450 0x7fac5412cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:56.818 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.807+0000 7fac58a5d700 1 --2- 172.21.15.158:0/543933412 >> v2:172.21.15.96:3300/0 conn(0x7fac540ad410 0x7fac5413a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:56.818 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.807+0000 7fac50ff9700 1 -- 172.21.15.158:0/543933412 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 808638709 0 0) 0x7fac5413e4c0 con 0x7fac540acfe0 2019-12-05T03:49:56.818 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.807+0000 7fac50ff9700 1 -- 172.21.15.158:0/543933412 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac380030b0 con 0x7fac540acfe0 2019-12-05T03:49:56.818 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.807+0000 7fac53fff700 1 -- 172.21.15.158:0/543933412 >> v2:172.21.15.96:3300/0 conn(0x7fac540ad410 msgr2=0x7fac5413a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:56.818 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.807+0000 7fac53fff700 1 --2- 172.21.15.158:0/543933412 >> v2:172.21.15.96:3300/0 conn(0x7fac540ad410 0x7fac5413a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:56.819 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.807+0000 7fac53fff700 1 -- 172.21.15.158:0/543933412 >> v1:172.21.15.158:6789/0 conn(0x7fac540acfe0 legacy=0x7fac5413dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:56.819 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.807+0000 7fac53fff700 1 -- 172.21.15.158:0/543933412 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac540b1140 con 0x7fac540ac450 2019-12-05T03:49:56.819 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.807+0000 7fac53fff700 1 --2- 172.21.15.158:0/543933412 >> v2:172.21.15.158:3300/0 conn(0x7fac540ac450 0x7fac5412cae0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fac5412d580 tx=0x7fac3c0119c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:56.819 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.807+0000 7fac53fff700 1 --2- 172.21.15.158:0/543933412 >> v2:172.21.15.158:3300/0 conn(0x7fac540ac450 0x7fac5412cae0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fac5412d580 tx=0x7fac3c0119c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:56.819 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.807+0000 7fac53fff700 1 --2- 172.21.15.158:0/543933412 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fac540ac450 0x7fac5412cae0 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7fac5412d580 tx=0x7fac3c0119c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:56.819 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.807+0000 7fac53fff700 1 --2- 172.21.15.158:0/543933412 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fac540ac450 0x7fac5412cae0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7fac5412d580 tx=0x7fac3c0119c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:56.819 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.807+0000 7fac50ff9700 1 -- 172.21.15.158:0/543933412 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac3c00f280 con 0x7fac540ac450 2019-12-05T03:49:56.820 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.807+0000 7fac53fff700 1 --2- 172.21.15.158:0/543933412 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fac540ac450 0x7fac5412cae0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7fac5412d580 tx=0x7fac3c0119c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:56.820 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.807+0000 7fac53fff700 1 --2- 172.21.15.158:0/543933412 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fac540ac450 0x7fac5412cae0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7fac5412d580 tx=0x7fac3c0119c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:56.820 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.807+0000 7fac50ff9700 1 -- 172.21.15.158:0/543933412 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac3c008db0 con 0x7fac540ac450 2019-12-05T03:49:56.824 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.807+0000 7fac59cbf700 1 -- 172.21.15.158:0/543933412 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac5413acd0 con 0x7fac540ac450 2019-12-05T03:49:56.824 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.807+0000 7fac50ff9700 1 -- 172.21.15.158:0/543933412 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac3c005540 con 0x7fac540ac450 2019-12-05T03:49:56.824 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.807+0000 7fac59cbf700 1 -- 172.21.15.158:0/543933412 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac5413b280 con 0x7fac540ac450 2019-12-05T03:49:56.825 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.811+0000 7fac53fff700 1 --2- 172.21.15.158:0/543933412 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fac540ac450 0x7fac5412cae0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7fac5412d580 tx=0x7fac3c0119c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:56.825 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.811+0000 7fac50ff9700 1 -- 172.21.15.158:0/543933412 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fac3c005850 con 0x7fac540ac450 2019-12-05T03:49:56.825 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.811+0000 7fac53fff700 1 --2- 172.21.15.158:0/543933412 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fac540ac450 0x7fac5412cae0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7fac5412d580 tx=0x7fac3c0119c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:56.825 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.811+0000 7fac50ff9700 1 --2- 172.21.15.158:0/543933412 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fac3803b220 0x7fac3803d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:56.825 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.811+0000 7fac50ff9700 1 -- 172.21.15.158:0/543933412 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5207+0+0 (secure 0 0 0) 0x7fac3c04b710 con 0x7fac540ac450 2019-12-05T03:49:56.825 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.811+0000 7fac537fe700 1 --2- 172.21.15.158:0/543933412 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fac3803b220 0x7fac3803d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:56.826 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.811+0000 7fac537fe700 1 --2- 172.21.15.158:0/543933412 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fac3803b220 0x7fac3803d730 crc :-1 s=READY pgs=45 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:56.826 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.815+0000 7fac59cbf700 1 -- 172.21.15.158:0/543933412 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac540554d0 con 0x7fac540ac450 2019-12-05T03:49:56.826 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.823+0000 7fac53fff700 1 --2- 172.21.15.158:0/543933412 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fac540ac450 0x7fac5412cae0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7fac5412d580 tx=0x7fac3c0119c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:56.827 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.823+0000 7fac50ff9700 1 -- 172.21.15.158:0/543933412 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fac3c032790 con 0x7fac540ac450 2019-12-05T03:49:56.993 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:56.991+0000 7fac59cbf700 1 -- 172.21.15.158:0/543933412 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"profile": ["m=2", "k=2", "crush-failure-domain=osd"], "prefix": "osd erasure-code-profile set", "name": "cephfs_data"} v 0) v1 -- 0x7fac54066930 con 0x7fac540ac450 2019-12-05T03:49:57.636 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.635+0000 7fac53fff700 1 --2- 172.21.15.158:0/543933412 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fac540ac450 0x7fac5412cae0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7fac5412d580 tx=0x7fac3c0119c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:57.637 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.635+0000 7fac50ff9700 1 -- 172.21.15.158:0/543933412 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"profile": ["m=2", "k=2", "crush-failure-domain=osd"], "prefix": "osd erasure-code-profile set", "name": "cephfs_data"}]=0 v19) v1 ==== 154+0+0 (secure 0 0 0) 0x7fac3c0329f0 con 0x7fac540ac450 2019-12-05T03:49:57.663 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.659+0000 7fac59cbf700 1 -- 172.21.15.158:0/543933412 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fac3803b220 msgr2=0x7fac3803d730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:57.664 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.659+0000 7fac59cbf700 1 --2- 172.21.15.158:0/543933412 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fac3803b220 0x7fac3803d730 crc :-1 s=READY pgs=45 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:57.664 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.659+0000 7fac59cbf700 1 -- 172.21.15.158:0/543933412 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fac540ac450 msgr2=0x7fac5412cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:57.664 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.659+0000 7fac59cbf700 1 --2- 172.21.15.158:0/543933412 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fac540ac450 0x7fac5412cae0 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7fac5412d580 tx=0x7fac3c0119c0).stop 2019-12-05T03:49:57.664 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.659+0000 7fac59cbf700 1 -- 172.21.15.158:0/543933412 shutdown_connections 2019-12-05T03:49:57.665 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.659+0000 7fac59cbf700 1 --2- 172.21.15.158:0/543933412 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fac3803b220 0x7fac3803d730 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:57.665 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.659+0000 7fac59cbf700 1 --2- 172.21.15.158:0/543933412 >> v2:172.21.15.96:3300/0 conn(0x7fac540ad410 0x7fac5413a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:57.665 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.659+0000 7fac59cbf700 1 --2- 172.21.15.158:0/543933412 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fac540ac450 0x7fac5412cae0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:57.665 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.659+0000 7fac59cbf700 1 -- 172.21.15.158:0/543933412 shutdown_connections 2019-12-05T03:49:57.666 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.659+0000 7fac59cbf700 1 -- 172.21.15.158:0/543933412 wait complete. 2019-12-05T03:49:57.666 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.659+0000 7fac59cbf700 1 -- 172.21.15.158:0/543933412 >> 172.21.15.158:0/543933412 conn(0x7fac540b7ee0 msgr2=0x7fac5409a310 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:49:57.674 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 erasure cephfs_data 2019-12-05T03:49:57.728 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:49:57.731 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:49:57.774 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.767+0000 7fa174e77700 1 Processor -- start 2019-12-05T03:49:57.774 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.767+0000 7fa174e77700 1 -- start start 2019-12-05T03:49:57.775 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.771+0000 7fa174e77700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa1700b6970 0x7fa17009add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:57.775 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.771+0000 7fa174e77700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa170099e30 con 0x7fa17009ba40 2019-12-05T03:49:57.775 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.771+0000 7fa174e77700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa17007e960 con 0x7fa1700b5370 2019-12-05T03:49:57.775 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.771+0000 7fa174e77700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa17009d210 con 0x7fa1700b6970 2019-12-05T03:49:57.775 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.771+0000 7fa16ed9d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa1700b6970 0x7fa17009add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:57.775 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.771+0000 7fa16ed9d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa1700b6970 0x7fa17009add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53312/0 (socket says 172.21.15.158:53312) 2019-12-05T03:49:57.775 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.771+0000 7fa16ed9d700 1 -- 172.21.15.158:0/3731850914 learned_addr learned my addr 172.21.15.158:0/3731850914 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:49:57.776 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.771+0000 7fa16f59e700 1 --1- 172.21.15.158:0/3731850914 >> v1:172.21.15.158:6789/0 conn(0x7fa1700b5370 0x7fa1700b57a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48094/0 (socket says 172.21.15.158:48094) 2019-12-05T03:49:57.776 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.771+0000 7fa16ed9d700 1 -- 172.21.15.158:0/3731850914 >> v1:172.21.15.158:6789/0 conn(0x7fa1700b5370 legacy=0x7fa1700b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:57.776 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.771+0000 7fa16ed9d700 1 -- 172.21.15.158:0/3731850914 >> v1:172.21.15.96:6789/0 conn(0x7fa17009ba40 legacy=0x7fa17005a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:57.776 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.771+0000 7fa16ed9d700 1 -- 172.21.15.158:0/3731850914 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1700b5fa0 con 0x7fa1700b6970 2019-12-05T03:49:57.776 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.771+0000 7fa16ed9d700 1 --2- 172.21.15.158:0/3731850914 >> v2:172.21.15.158:3300/0 conn(0x7fa1700b6970 0x7fa17009add0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa158002f30 tx=0x7fa15800fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:57.776 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.771+0000 7fa16ed9d700 1 --2- 172.21.15.158:0/3731850914 >> v2:172.21.15.158:3300/0 conn(0x7fa1700b6970 0x7fa17009add0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa158002f30 tx=0x7fa15800fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:57.776 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.771+0000 7fa16ed9d700 1 --2- 172.21.15.158:0/3731850914 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1700b6970 0x7fa17009add0 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7fa158002f30 tx=0x7fa15800fcb0).ready entity=mon.1 client_cookie=2bdf0bfad19b97db server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:57.777 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.771+0000 7fa16ed9d700 1 --2- 172.21.15.158:0/3731850914 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1700b6970 0x7fa17009add0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7fa158002f30 tx=0x7fa15800fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:57.777 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.771+0000 7fa16ed9d700 1 --2- 172.21.15.158:0/3731850914 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1700b6970 0x7fa17009add0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7fa158002f30 tx=0x7fa15800fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:57.777 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.771+0000 7fa16dd9b700 1 -- 172.21.15.158:0/3731850914 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa158008c90 con 0x7fa1700b6970 2019-12-05T03:49:57.777 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.771+0000 7fa16ed9d700 1 --2- 172.21.15.158:0/3731850914 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1700b6970 0x7fa17009add0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7fa158002f30 tx=0x7fa15800fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:57.777 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.771+0000 7fa16dd9b700 1 -- 172.21.15.158:0/3731850914 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1580088b0 con 0x7fa1700b6970 2019-12-05T03:49:57.777 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.771+0000 7fa16dd9b700 1 -- 172.21.15.158:0/3731850914 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa158011b40 con 0x7fa1700b6970 2019-12-05T03:49:57.777 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.771+0000 7fa174e77700 1 -- 172.21.15.158:0/3731850914 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1700b6970 msgr2=0x7fa17009add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:57.778 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.771+0000 7fa174e77700 1 --2- 172.21.15.158:0/3731850914 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1700b6970 0x7fa17009add0 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7fa158002f30 tx=0x7fa15800fcb0).stop 2019-12-05T03:49:57.778 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.771+0000 7fa174e77700 1 -- 172.21.15.158:0/3731850914 shutdown_connections 2019-12-05T03:49:57.778 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.771+0000 7fa174e77700 1 --2- 172.21.15.158:0/3731850914 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1700b6970 0x7fa17009add0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:57.778 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.771+0000 7fa174e77700 1 -- 172.21.15.158:0/3731850914 shutdown_connections 2019-12-05T03:49:57.778 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.771+0000 7fa174e77700 1 -- 172.21.15.158:0/3731850914 wait complete. 2019-12-05T03:49:57.778 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.771+0000 7fa174e77700 1 -- 172.21.15.158:0/3731850914 >> 172.21.15.158:0/3731850914 conn(0x7fa1700b7ef0 msgr2=0x7fa1700b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:49:57.782 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.771+0000 7fa174e77700 1 Processor -- start 2019-12-05T03:49:57.783 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.771+0000 7fa174e77700 1 -- start start 2019-12-05T03:49:57.783 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.775+0000 7fa174e77700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa170059730 0x7fa1700afe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:57.783 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.775+0000 7fa174e77700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa17012e1c0 con 0x7fa17013b070 2019-12-05T03:49:57.783 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.775+0000 7fa174e77700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1700b18d0 con 0x7fa17012f230 2019-12-05T03:49:57.783 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.775+0000 7fa174e77700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1700af900 con 0x7fa170059730 2019-12-05T03:49:57.783 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.775+0000 7fa16ed9d700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fa17012f230 0x7fa17012d9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48096/0 (socket says 172.21.15.158:48096) 2019-12-05T03:49:57.784 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.775+0000 7fa16ed9d700 1 -- 172.21.15.158:0/3652324263 learned_addr learned my addr 172.21.15.158:0/3652324263 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:49:57.784 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.775+0000 7fa16f59e700 1 --2- 172.21.15.158:0/3652324263 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa170059730 0x7fa1700afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:57.784 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.775+0000 7fa1677fe700 1 -- 172.21.15.158:0/3652324263 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 848729997 0 0) 0x7fa1700b18d0 con 0x7fa17012f230 2019-12-05T03:49:57.784 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.775+0000 7fa1677fe700 1 -- 172.21.15.158:0/3652324263 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1540030b0 con 0x7fa17012f230 2019-12-05T03:49:57.784 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.775+0000 7fa1677fe700 1 -- 172.21.15.158:0/3652324263 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 564629773 0 0) 0x7fa17012e1c0 con 0x7fa17013b070 2019-12-05T03:49:57.784 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.775+0000 7fa16f59e700 1 -- 172.21.15.158:0/3652324263 >> v1:172.21.15.158:6789/0 conn(0x7fa17012f230 legacy=0x7fa17012d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:57.785 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.775+0000 7fa16f59e700 1 -- 172.21.15.158:0/3652324263 >> v1:172.21.15.96:6789/0 conn(0x7fa17013b070 legacy=0x7fa170139ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:57.785 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.775+0000 7fa16f59e700 1 -- 172.21.15.158:0/3652324263 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa170059b60 con 0x7fa170059730 2019-12-05T03:49:57.785 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.775+0000 7fa16f59e700 1 --2- 172.21.15.158:0/3652324263 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa170059730 0x7fa1700afe40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa168000f00 tx=0x7fa168010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:57.785 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.775+0000 7fa16f59e700 1 --2- 172.21.15.158:0/3652324263 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa170059730 0x7fa1700afe40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa168000f00 tx=0x7fa168010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:57.785 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.775+0000 7fa16f59e700 1 --2- 172.21.15.158:0/3652324263 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa170059730 0x7fa1700afe40 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7fa168000f00 tx=0x7fa168010aa0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:57.785 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.775+0000 7fa16f59e700 1 --2- 172.21.15.158:0/3652324263 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa170059730 0x7fa1700afe40 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fa168000f00 tx=0x7fa168010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:57.785 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.775+0000 7fa1677fe700 1 -- 172.21.15.158:0/3652324263 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa168004ad0 con 0x7fa170059730 2019-12-05T03:49:57.786 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.775+0000 7fa16f59e700 1 --2- 172.21.15.158:0/3652324263 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa170059730 0x7fa1700afe40 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fa168000f00 tx=0x7fa168010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:57.786 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.775+0000 7fa16f59e700 1 --2- 172.21.15.158:0/3652324263 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa170059730 0x7fa1700afe40 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fa168000f00 tx=0x7fa168010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:57.786 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.775+0000 7fa1677fe700 1 -- 172.21.15.158:0/3652324263 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1680046f0 con 0x7fa170059730 2019-12-05T03:49:57.786 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.775+0000 7fa174e77700 1 -- 172.21.15.158:0/3652324263 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa17013a2e0 con 0x7fa170059730 2019-12-05T03:49:57.786 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.775+0000 7fa1677fe700 1 -- 172.21.15.158:0/3652324263 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa168012740 con 0x7fa170059730 2019-12-05T03:49:57.786 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.775+0000 7fa174e77700 1 -- 172.21.15.158:0/3652324263 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1700b0390 con 0x7fa170059730 2019-12-05T03:49:57.786 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.775+0000 7fa16f59e700 1 --2- 172.21.15.158:0/3652324263 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa170059730 0x7fa1700afe40 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fa168000f00 tx=0x7fa168010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:57.787 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.775+0000 7fa16f59e700 1 --2- 172.21.15.158:0/3652324263 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa170059730 0x7fa1700afe40 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fa168000f00 tx=0x7fa168010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:57.787 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.775+0000 7fa1677fe700 1 -- 172.21.15.158:0/3652324263 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fa168012a60 con 0x7fa170059730 2019-12-05T03:49:57.787 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.775+0000 7fa1677fe700 1 --2- 172.21.15.158:0/3652324263 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa15403b210 0x7fa15403d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:57.787 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.775+0000 7fa1677fe700 1 -- 172.21.15.158:0/3652324263 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5463+0+0 (secure 0 0 0) 0x7fa16804b0f0 con 0x7fa170059730 2019-12-05T03:49:57.787 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.775+0000 7fa16ed9d700 1 --2- 172.21.15.158:0/3652324263 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa15403b210 0x7fa15403d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:57.787 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.779+0000 7fa16ed9d700 1 --2- 172.21.15.158:0/3652324263 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa15403b210 0x7fa15403d720 crc :-1 s=READY pgs=46 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:57.788 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.783+0000 7fa174e77700 1 -- 172.21.15.158:0/3652324263 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1700554e0 con 0x7fa170059730 2019-12-05T03:49:57.792 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.791+0000 7fa16f59e700 1 --2- 172.21.15.158:0/3652324263 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa170059730 0x7fa1700afe40 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fa168000f00 tx=0x7fa168010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:57.792 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.791+0000 7fa1677fe700 1 -- 172.21.15.158:0/3652324263 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fa168012d70 con 0x7fa170059730 2019-12-05T03:49:57.954 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:57.951+0000 7fa174e77700 1 -- 172.21.15.158:0/3652324263 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"pool_type": "erasure", "prefix": "osd pool create", "pg_num": 8, "erasure_code_profile": "cephfs_data", "pool": "cephfs_data"} v 0) v1 -- 0x7fa17005ab60 con 0x7fa170059730 2019-12-05T03:49:59.643 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.639+0000 7fa16f59e700 1 --2- 172.21.15.158:0/3652324263 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa170059730 0x7fa1700afe40 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fa168000f00 tx=0x7fa168010aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:59.664 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.639+0000 7fa1677fe700 1 -- 172.21.15.158:0/3652324263 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"pool_type": "erasure", "prefix": "osd pool create", "pg_num": 8, "erasure_code_profile": "cephfs_data", "pool": "cephfs_data"}]=0 pool 'cephfs_data' created v21) v1 ==== 188+0+0 (secure 0 0 0) 0x7fa1680320b0 con 0x7fa170059730 2019-12-05T03:49:59.672 INFO:teuthology.orchestra.run.smithi158.stderr:pool 'cephfs_data' created 2019-12-05T03:49:59.676 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.675+0000 7fa174e77700 1 -- 172.21.15.158:0/3652324263 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa15403b210 msgr2=0x7fa15403d720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:59.676 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.675+0000 7fa174e77700 1 --2- 172.21.15.158:0/3652324263 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa15403b210 0x7fa15403d720 crc :-1 s=READY pgs=46 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:59.677 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.675+0000 7fa174e77700 1 -- 172.21.15.158:0/3652324263 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa170059730 msgr2=0x7fa1700afe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:59.677 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.675+0000 7fa174e77700 1 --2- 172.21.15.158:0/3652324263 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa170059730 0x7fa1700afe40 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7fa168000f00 tx=0x7fa168010aa0).stop 2019-12-05T03:49:59.677 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.675+0000 7fa174e77700 1 -- 172.21.15.158:0/3652324263 shutdown_connections 2019-12-05T03:49:59.677 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.675+0000 7fa174e77700 1 --2- 172.21.15.158:0/3652324263 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa170059730 0x7fa1700afe40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:59.677 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.675+0000 7fa174e77700 1 --2- 172.21.15.158:0/3652324263 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa15403b210 0x7fa15403d720 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:59.677 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.675+0000 7fa174e77700 1 -- 172.21.15.158:0/3652324263 shutdown_connections 2019-12-05T03:49:59.678 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.675+0000 7fa174e77700 1 -- 172.21.15.158:0/3652324263 wait complete. 2019-12-05T03:49:59.678 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.675+0000 7fa174e77700 1 -- 172.21.15.158:0/3652324263 >> 172.21.15.158:0/3652324263 conn(0x7fa1700b3af0 msgr2=0x7fa17009a320 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:49:59.690 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data allow_ec_overwrites true 2019-12-05T03:49:59.859 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.851+0000 7f8e8e7e0700 1 Processor -- start 2019-12-05T03:49:59.859 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.851+0000 7f8e8e7e0700 1 -- start start 2019-12-05T03:49:59.859 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.851+0000 7f8e8e7e0700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8e8809ba40 0x7f8e8809add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:59.859 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.851+0000 7f8e8e7e0700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8e880b5370 0x7f8e880b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:49:59.860 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.851+0000 7f8e8e7e0700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e88099e30 con 0x7f8e880b6970 2019-12-05T03:49:59.860 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.851+0000 7f8e8e7e0700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e8809d210 con 0x7f8e8809ba40 2019-12-05T03:49:59.860 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.851+0000 7f8e8e7e0700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e88099b90 con 0x7f8e880b5370 2019-12-05T03:49:59.860 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.851+0000 7f8e8cd7d700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f8e880b6970 0x7f8e8805a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48104/0 (socket says 172.21.15.158:48104) 2019-12-05T03:49:59.860 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.851+0000 7f8e8cd7d700 1 -- 172.21.15.158:0/4099480920 learned_addr learned my addr 172.21.15.158:0/4099480920 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:49:59.860 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.851+0000 7f8e8d57e700 1 --2- 172.21.15.158:0/4099480920 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8e880b5370 0x7f8e880b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:59.861 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.851+0000 7f8e87fff700 1 --2- 172.21.15.158:0/4099480920 >> v2:172.21.15.96:3300/0 conn(0x7f8e8809ba40 0x7f8e8809add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:59.861 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.851+0000 7f8e877fe700 1 -- 172.21.15.158:0/4099480920 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2044636345 0 0) 0x7f8e88099e30 con 0x7f8e880b6970 2019-12-05T03:49:59.861 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.851+0000 7f8e877fe700 1 -- 172.21.15.158:0/4099480920 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e700030b0 con 0x7f8e880b6970 2019-12-05T03:49:59.861 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.855+0000 7f8e8d57e700 1 -- 172.21.15.158:0/4099480920 >> v2:172.21.15.96:3300/0 conn(0x7f8e8809ba40 msgr2=0x7f8e8809add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:49:59.861 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.855+0000 7f8e8d57e700 1 --2- 172.21.15.158:0/4099480920 >> v2:172.21.15.96:3300/0 conn(0x7f8e8809ba40 0x7f8e8809add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:49:59.861 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.855+0000 7f8e8d57e700 1 -- 172.21.15.158:0/4099480920 >> v1:172.21.15.158:6789/0 conn(0x7f8e880b6970 legacy=0x7f8e8805a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:59.861 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.855+0000 7f8e877fe700 1 -- 172.21.15.158:0/4099480920 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2240358133 0 0) 0x7f8e700030b0 con 0x7f8e880b6970 2019-12-05T03:49:59.861 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.855+0000 7f8e8d57e700 1 -- 172.21.15.158:0/4099480920 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8807e960 con 0x7f8e880b5370 2019-12-05T03:49:59.862 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.855+0000 7f8e8d57e700 1 --2- 172.21.15.158:0/4099480920 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8e880b5370 0x7f8e880b57a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8e80008b10 tx=0x7f8e780014a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:59.862 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.855+0000 7f8e8d57e700 1 --2- 172.21.15.158:0/4099480920 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8e880b5370 0x7f8e880b57a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8e80008b10 tx=0x7f8e780014a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:59.862 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.855+0000 7f8e8d57e700 1 --2- 172.21.15.158:0/4099480920 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8e880b5370 0x7f8e880b57a0 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7f8e80008b10 tx=0x7f8e780014a0).ready entity=mon.2 client_cookie=93f89fc97fa4b012 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:59.862 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.855+0000 7f8e8d57e700 1 --2- 172.21.15.158:0/4099480920 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8e880b5370 0x7f8e880b57a0 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f8e80008b10 tx=0x7f8e780014a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:59.862 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.855+0000 7f8e877fe700 1 -- 172.21.15.158:0/4099480920 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e78001750 con 0x7f8e880b5370 2019-12-05T03:49:59.862 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.855+0000 7f8e8d57e700 1 --2- 172.21.15.158:0/4099480920 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8e880b5370 0x7f8e880b57a0 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f8e80008b10 tx=0x7f8e780014a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:59.862 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.855+0000 7f8e8d57e700 1 --2- 172.21.15.158:0/4099480920 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8e880b5370 0x7f8e880b57a0 secure :-1 s=THROTTLE_DONE pgs=32 cs=0 l=1 rx=0x7f8e80008b10 tx=0x7f8e780014a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:59.863 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.855+0000 7f8e877fe700 1 -- 172.21.15.158:0/4099480920 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e78001560 con 0x7f8e880b5370 2019-12-05T03:49:59.863 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.855+0000 7f8e877fe700 1 -- 172.21.15.158:0/4099480920 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e800109f0 con 0x7f8e880b5370 2019-12-05T03:49:59.863 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.855+0000 7f8e8e7e0700 1 -- 172.21.15.158:0/4099480920 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8e880b5370 msgr2=0x7f8e880b57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:59.863 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.855+0000 7f8e8e7e0700 1 --2- 172.21.15.158:0/4099480920 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8e880b5370 0x7f8e880b57a0 secure :-1 s=READY pgs=32 cs=0 l=1 rx=0x7f8e80008b10 tx=0x7f8e780014a0).stop 2019-12-05T03:49:59.863 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.855+0000 7f8e8e7e0700 1 -- 172.21.15.158:0/4099480920 shutdown_connections 2019-12-05T03:49:59.863 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.855+0000 7f8e8e7e0700 1 --2- 172.21.15.158:0/4099480920 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8e880b5370 0x7f8e880b57a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:49:59.863 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.855+0000 7f8e8e7e0700 1 --2- 172.21.15.158:0/4099480920 >> v2:172.21.15.96:3300/0 conn(0x7f8e8809ba40 0x7f8e8809add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:49:59.864 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.855+0000 7f8e8e7e0700 1 -- 172.21.15.158:0/4099480920 shutdown_connections 2019-12-05T03:49:59.864 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.855+0000 7f8e8e7e0700 1 -- 172.21.15.158:0/4099480920 wait complete. 2019-12-05T03:49:59.864 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.855+0000 7f8e8e7e0700 1 -- 172.21.15.158:0/4099480920 >> 172.21.15.158:0/4099480920 conn(0x7f8e880b7ef0 msgr2=0x7f8e880b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:49:59.867 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.859+0000 7f8e8e7e0700 1 Processor -- start 2019-12-05T03:49:59.868 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.859+0000 7f8e8e7e0700 1 -- start start 2019-12-05T03:49:59.868 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.859+0000 7f8e8e7e0700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8e8812c5b0 0x7f8e8813d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:59.868 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.859+0000 7f8e8e7e0700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e880ac460 con 0x7f8e88153990 2019-12-05T03:49:59.868 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.859+0000 7f8e8e7e0700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e880ad860 con 0x7f8e88139490 2019-12-05T03:49:59.868 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.859+0000 7f8e8e7e0700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e8812eef0 con 0x7f8e8812c5b0 2019-12-05T03:49:59.868 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.859+0000 7f8e8cd7d700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f8e88139490 0x7f8e88153190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48110/0 (socket says 172.21.15.158:48110) 2019-12-05T03:49:59.868 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.859+0000 7f8e8cd7d700 1 -- 172.21.15.158:0/1247235604 learned_addr learned my addr 172.21.15.158:0/1247235604 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:49:59.869 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.863+0000 7f8e8d57e700 1 --2- 172.21.15.158:0/1247235604 >> v2:172.21.15.96:3300/0 conn(0x7f8e8812c5b0 0x7f8e8813d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:59.869 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.863+0000 7f8e857fa700 1 -- 172.21.15.158:0/1247235604 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1712571134 0 0) 0x7f8e880ad860 con 0x7f8e88139490 2019-12-05T03:49:59.869 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.863+0000 7f8e857fa700 1 -- 172.21.15.158:0/1247235604 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e680030b0 con 0x7f8e88139490 2019-12-05T03:49:59.869 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.863+0000 7f8e857fa700 1 -- 172.21.15.158:0/1247235604 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 700760255 0 0) 0x7f8e680030b0 con 0x7f8e88139490 2019-12-05T03:49:59.869 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.863+0000 7f8e857fa700 1 -- 172.21.15.158:0/1247235604 --> v1:172.21.15.158:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8e880ad860 con 0x7f8e88139490 2019-12-05T03:49:59.869 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.863+0000 7f8e857fa700 1 -- 172.21.15.158:0/1247235604 <== mon.1 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 828730332 0 0) 0x7f8e78001b20 con 0x7f8e88139490 2019-12-05T03:49:59.869 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.863+0000 7f8e8d57e700 1 -- 172.21.15.158:0/1247235604 >> v1:172.21.15.158:6789/0 conn(0x7f8e88139490 legacy=0x7f8e88153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:59.870 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.863+0000 7f8e8d57e700 1 -- 172.21.15.158:0/1247235604 >> v1:172.21.15.96:6789/0 conn(0x7f8e88153990 legacy=0x7f8e880ad060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:49:59.870 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.863+0000 7f8e8d57e700 1 -- 172.21.15.158:0/1247235604 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8812c9e0 con 0x7f8e8812c5b0 2019-12-05T03:49:59.870 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.863+0000 7f8e8d57e700 1 --2- 172.21.15.158:0/1247235604 >> v2:172.21.15.96:3300/0 conn(0x7f8e8812c5b0 0x7f8e8813d410 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8e7c0077a0 tx=0x7f8e7c007720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:59.870 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.863+0000 7f8e8d57e700 1 --2- 172.21.15.158:0/1247235604 >> v2:172.21.15.96:3300/0 conn(0x7f8e8812c5b0 0x7f8e8813d410 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8e7c0077a0 tx=0x7f8e7c007720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:59.870 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.863+0000 7f8e8d57e700 1 --2- 172.21.15.158:0/1247235604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e8812c5b0 0x7f8e8813d410 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f8e7c0077a0 tx=0x7f8e7c007720).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:59.870 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.863+0000 7f8e8d57e700 1 --2- 172.21.15.158:0/1247235604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e8812c5b0 0x7f8e8813d410 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f8e7c0077a0 tx=0x7f8e7c007720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:59.870 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.863+0000 7f8e857fa700 1 -- 172.21.15.158:0/1247235604 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e80010800 con 0x7f8e8812c5b0 2019-12-05T03:49:59.871 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.863+0000 7f8e8d57e700 1 --2- 172.21.15.158:0/1247235604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e8812c5b0 0x7f8e8813d410 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f8e7c0077a0 tx=0x7f8e7c007720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:59.871 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.863+0000 7f8e8d57e700 1 --2- 172.21.15.158:0/1247235604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e8812c5b0 0x7f8e8813d410 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f8e7c0077a0 tx=0x7f8e7c007720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:59.871 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.863+0000 7f8e857fa700 1 -- 172.21.15.158:0/1247235604 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e80008d40 con 0x7f8e8812c5b0 2019-12-05T03:49:59.871 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.863+0000 7f8e8e7e0700 1 -- 172.21.15.158:0/1247235604 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e880ada90 con 0x7f8e8812c5b0 2019-12-05T03:49:59.871 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.863+0000 7f8e857fa700 1 -- 172.21.15.158:0/1247235604 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e8000f7f0 con 0x7f8e8812c5b0 2019-12-05T03:49:59.871 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.863+0000 7f8e8e7e0700 1 -- 172.21.15.158:0/1247235604 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e88139ed0 con 0x7f8e8812c5b0 2019-12-05T03:49:59.871 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.863+0000 7f8e8d57e700 1 --2- 172.21.15.158:0/1247235604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e8812c5b0 0x7f8e8813d410 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f8e7c0077a0 tx=0x7f8e7c007720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:59.872 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.863+0000 7f8e857fa700 1 -- 172.21.15.158:0/1247235604 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f8e800058c0 con 0x7f8e8812c5b0 2019-12-05T03:49:59.872 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.863+0000 7f8e8d57e700 1 --2- 172.21.15.158:0/1247235604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e8812c5b0 0x7f8e8813d410 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f8e7c0077a0 tx=0x7f8e7c007720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:59.872 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.863+0000 7f8e857fa700 1 --2- 172.21.15.158:0/1247235604 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f8e6803b590 0x7f8e6803daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:49:59.872 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.863+0000 7f8e857fa700 1 -- 172.21.15.158:0/1247235604 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5915+0+0 (secure 0 0 0) 0x7f8e8004a830 con 0x7f8e8812c5b0 2019-12-05T03:49:59.872 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.863+0000 7f8e8cd7d700 1 --2- 172.21.15.158:0/1247235604 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f8e6803b590 0x7f8e6803daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:49:59.872 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.867+0000 7f8e8cd7d700 1 --2- 172.21.15.158:0/1247235604 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f8e6803b590 0x7f8e6803daa0 crc :-1 s=READY pgs=47 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:49:59.873 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.867+0000 7f8e8e7e0700 1 -- 172.21.15.158:0/1247235604 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e880554e0 con 0x7f8e8812c5b0 2019-12-05T03:49:59.877 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.875+0000 7f8e8d57e700 1 --2- 172.21.15.158:0/1247235604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e8812c5b0 0x7f8e8813d410 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f8e7c0077a0 tx=0x7f8e7c007720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:49:59.877 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:49:59.875+0000 7f8e857fa700 1 -- 172.21.15.158:0/1247235604 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f8e800318b0 con 0x7f8e8812c5b0 2019-12-05T03:50:00.041 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:00.039+0000 7f8e8e7e0700 1 -- 172.21.15.158:0/1247235604 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"var": "allow_ec_overwrites", "prefix": "osd pool set", "pool": "cephfs_data", "val": "true"} v 0) v1 -- 0x7f8e88066940 con 0x7f8e8812c5b0 2019-12-05T03:50:00.942 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:00.939+0000 7f8e8d57e700 1 --2- 172.21.15.158:0/1247235604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e8812c5b0 0x7f8e8813d410 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f8e7c0077a0 tx=0x7f8e7c007720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:00.942 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:00.939+0000 7f8e857fa700 1 -- 172.21.15.158:0/1247235604 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"var": "allow_ec_overwrites", "prefix": "osd pool set", "pool": "cephfs_data", "val": "true"}]=0 set pool 3 allow_ec_overwrites to true v22) v1 ==== 166+0+0 (secure 0 0 0) 0x7f8e800326c0 con 0x7f8e8812c5b0 2019-12-05T03:50:00.957 INFO:teuthology.orchestra.run.smithi158.stderr:set pool 3 allow_ec_overwrites to true 2019-12-05T03:50:00.962 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:00.959+0000 7f8e8e7e0700 1 -- 172.21.15.158:0/1247235604 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f8e6803b590 msgr2=0x7f8e6803daa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:00.962 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:00.959+0000 7f8e8e7e0700 1 --2- 172.21.15.158:0/1247235604 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f8e6803b590 0x7f8e6803daa0 crc :-1 s=READY pgs=47 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:00.963 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:00.959+0000 7f8e8e7e0700 1 -- 172.21.15.158:0/1247235604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e8812c5b0 msgr2=0x7f8e8813d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:00.963 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:00.959+0000 7f8e8e7e0700 1 --2- 172.21.15.158:0/1247235604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e8812c5b0 0x7f8e8813d410 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f8e7c0077a0 tx=0x7f8e7c007720).stop 2019-12-05T03:50:00.963 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:00.959+0000 7f8e8e7e0700 1 -- 172.21.15.158:0/1247235604 shutdown_connections 2019-12-05T03:50:00.963 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:00.959+0000 7f8e8e7e0700 1 --2- 172.21.15.158:0/1247235604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e8812c5b0 0x7f8e8813d410 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:00.963 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:00.959+0000 7f8e8e7e0700 1 --2- 172.21.15.158:0/1247235604 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f8e6803b590 0x7f8e6803daa0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:00.963 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:00.959+0000 7f8e8e7e0700 1 -- 172.21.15.158:0/1247235604 shutdown_connections 2019-12-05T03:50:00.964 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:00.959+0000 7f8e8e7e0700 1 -- 172.21.15.158:0/1247235604 wait complete. 2019-12-05T03:50:00.964 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:00.959+0000 7f8e8e7e0700 1 -- 172.21.15.158:0/1247235604 >> 172.21.15.158:0/1247235604 conn(0x7f8e88068c60 msgr2=0x7f8e8809a320 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:00.970 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2019-12-05T03:50:01.062 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.055+0000 7f41af514700 1 Processor -- start 2019-12-05T03:50:01.062 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.055+0000 7f41af514700 1 -- start start 2019-12-05T03:50:01.062 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.055+0000 7f41af514700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f41a80b6970 0x7f41a809add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:01.062 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.055+0000 7f41af514700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f41a80b5370 0x7f41a80b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:01.062 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.055+0000 7f41af514700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41a8099e30 con 0x7f41a809ba40 2019-12-05T03:50:01.063 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.055+0000 7f41af514700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41a809d210 con 0x7f41a80b6970 2019-12-05T03:50:01.063 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.055+0000 7f41af514700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a8099b90 con 0x7f41a80b5370 2019-12-05T03:50:01.063 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.055+0000 7f41ad2b0700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f41a809ba40 0x7f41a805a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48118/0 (socket says 172.21.15.158:48118) 2019-12-05T03:50:01.063 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.055+0000 7f41ad2b0700 1 -- 172.21.15.158:0/1301124863 learned_addr learned my addr 172.21.15.158:0/1301124863 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:01.063 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.055+0000 7f41ae2b2700 1 --2- 172.21.15.158:0/1301124863 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f41a80b5370 0x7f41a80b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:01.063 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.055+0000 7f41adab1700 1 --2- 172.21.15.158:0/1301124863 >> v2:172.21.15.96:3300/0 conn(0x7f41a80b6970 0x7f41a809add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:01.064 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.055+0000 7f41acaaf700 1 -- 172.21.15.158:0/1301124863 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 133318618 0 0) 0x7f41a8099e30 con 0x7f41a809ba40 2019-12-05T03:50:01.064 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.055+0000 7f41acaaf700 1 -- 172.21.15.158:0/1301124863 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41940030b0 con 0x7f41a809ba40 2019-12-05T03:50:01.064 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.055+0000 7f41acaaf700 1 -- 172.21.15.158:0/1301124863 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3012284948 0 0) 0x7f41940030b0 con 0x7f41a809ba40 2019-12-05T03:50:01.064 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.055+0000 7f41acaaf700 1 -- 172.21.15.158:0/1301124863 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f41a80b5370 msgr2=0x7f41a80b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:01.064 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.055+0000 7f41acaaf700 1 --2- 172.21.15.158:0/1301124863 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f41a80b5370 0x7f41a80b57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:01.064 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.055+0000 7f41acaaf700 1 -- 172.21.15.158:0/1301124863 >> v2:172.21.15.96:3300/0 conn(0x7f41a80b6970 msgr2=0x7f41a809add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:01.064 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.055+0000 7f41acaaf700 1 --2- 172.21.15.158:0/1301124863 >> v2:172.21.15.96:3300/0 conn(0x7f41a80b6970 0x7f41a809add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:01.065 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.055+0000 7f41acaaf700 1 -- 172.21.15.158:0/1301124863 --> v1:172.21.15.158:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a807e960 con 0x7f41a809ba40 2019-12-05T03:50:01.065 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.055+0000 7f41acaaf700 1 -- 172.21.15.158:0/1301124863 <== mon.1 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 828730332 0 0) 0x7f419c001750 con 0x7f41a809ba40 2019-12-05T03:50:01.065 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.055+0000 7f41acaaf700 1 -- 172.21.15.158:0/1301124863 >> v1:172.21.15.158:6789/0 conn(0x7f41a809ba40 legacy=0x7f41a805a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:01.065 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.055+0000 7f41acaaf700 1 --2- 172.21.15.158:0/1301124863 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f41940036e0 0x7f4194003b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:01.065 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.055+0000 7f41acaaf700 1 --2- 172.21.15.158:0/1301124863 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4194004420 0x7f4194004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:01.065 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.055+0000 7f41acaaf700 1 --2- 172.21.15.158:0/1301124863 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4194004da0 0x7f419404f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:01.065 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.055+0000 7f41acaaf700 1 -- 172.21.15.158:0/1301124863 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a809d210 con 0x7f4194004da0 2019-12-05T03:50:01.066 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.055+0000 7f41acaaf700 1 -- 172.21.15.158:0/1301124863 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a8099b90 con 0x7f4194004420 2019-12-05T03:50:01.066 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.055+0000 7f41acaaf700 1 -- 172.21.15.158:0/1301124863 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4194005250 con 0x7f41940036e0 2019-12-05T03:50:01.066 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.055+0000 7f41ad2b0700 1 --2- 172.21.15.158:0/1301124863 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4194004420 0x7f4194004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:01.066 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.055+0000 7f41adab1700 1 --2- 172.21.15.158:0/1301124863 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f41940036e0 0x7f4194003b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:01.066 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.059+0000 7f41ae2b2700 1 --2- 172.21.15.158:0/1301124863 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4194004da0 0x7f419404f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:01.066 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.059+0000 7f41adab1700 1 -- 172.21.15.158:0/1301124863 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4194004420 msgr2=0x7f4194004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:01.066 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.059+0000 7f41adab1700 1 --2- 172.21.15.158:0/1301124863 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4194004420 0x7f4194004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:01.067 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.059+0000 7f41adab1700 1 -- 172.21.15.158:0/1301124863 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4194004da0 msgr2=0x7f419404f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:01.067 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.059+0000 7f41adab1700 1 --2- 172.21.15.158:0/1301124863 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4194004da0 0x7f419404f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:01.067 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.059+0000 7f41adab1700 1 -- 172.21.15.158:0/1301124863 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419404fce0 con 0x7f41940036e0 2019-12-05T03:50:01.067 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.059+0000 7f41ae2b2700 1 --2- 172.21.15.158:0/1301124863 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4194004da0 0x7f419404f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-12-05T03:50:01.067 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.059+0000 7f41adab1700 1 --2- 172.21.15.158:0/1301124863 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f41940036e0 0x7f4194003b10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f41a4002f30 tx=0x7f41a400ffe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.067 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.059+0000 7f41adab1700 1 --2- 172.21.15.158:0/1301124863 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f41940036e0 0x7f4194003b10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f41a4002f30 tx=0x7f41a400ffe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.067 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.059+0000 7f41adab1700 1 --2- 172.21.15.158:0/1301124863 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f41940036e0 0x7f4194003b10 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7f41a4002f30 tx=0x7f41a400ffe0).ready entity=mon.2 client_cookie=152331c29ea3410e server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:01.068 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.059+0000 7f41adab1700 1 --2- 172.21.15.158:0/1301124863 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f41940036e0 0x7f4194003b10 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f41a4002f30 tx=0x7f41a400ffe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.068 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.059+0000 7f41adab1700 1 --2- 172.21.15.158:0/1301124863 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f41940036e0 0x7f4194003b10 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f41a4002f30 tx=0x7f41a400ffe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.068 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.059+0000 7f41adab1700 1 --2- 172.21.15.158:0/1301124863 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f41940036e0 0x7f4194003b10 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7f41a4002f30 tx=0x7f41a400ffe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.068 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.059+0000 7f41acaaf700 1 -- 172.21.15.158:0/1301124863 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41a4010d10 con 0x7f41940036e0 2019-12-05T03:50:01.068 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.059+0000 7f41acaaf700 1 -- 172.21.15.158:0/1301124863 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a4010930 con 0x7f41940036e0 2019-12-05T03:50:01.069 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.059+0000 7f41acaaf700 1 -- 172.21.15.158:0/1301124863 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41a4008bd0 con 0x7f41940036e0 2019-12-05T03:50:01.069 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.059+0000 7f41af514700 1 -- 172.21.15.158:0/1301124863 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f41940036e0 msgr2=0x7f4194003b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:01.069 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.059+0000 7f41af514700 1 --2- 172.21.15.158:0/1301124863 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f41940036e0 0x7f4194003b10 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7f41a4002f30 tx=0x7f41a400ffe0).stop 2019-12-05T03:50:01.069 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.059+0000 7f41ae2b2700 1 -- 172.21.15.158:0/1301124863 reap_dead start 2019-12-05T03:50:01.069 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.059+0000 7f41af514700 1 -- 172.21.15.158:0/1301124863 shutdown_connections 2019-12-05T03:50:01.069 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.059+0000 7f41af514700 1 -- 172.21.15.158:0/1301124863 shutdown_connections 2019-12-05T03:50:01.069 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.059+0000 7f41af514700 1 -- 172.21.15.158:0/1301124863 wait complete. 2019-12-05T03:50:01.070 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.059+0000 7f41af514700 1 -- 172.21.15.158:0/1301124863 >> 172.21.15.158:0/1301124863 conn(0x7f41a80b7ef0 msgr2=0x7f41a80b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:01.073 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.063+0000 7f41af514700 1 Processor -- start 2019-12-05T03:50:01.073 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.063+0000 7f41af514700 1 -- start start 2019-12-05T03:50:01.074 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.063+0000 7f41af514700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f41a8142870 0x7f41a80603a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:01.074 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.063+0000 7f41af514700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41a80608f0 con 0x7f41a8140180 2019-12-05T03:50:01.074 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.063+0000 7f41af514700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41a8142f90 con 0x7f41a80b0f30 2019-12-05T03:50:01.074 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.063+0000 7f41af514700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a81431c0 con 0x7f41a8142870 2019-12-05T03:50:01.074 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.063+0000 7f41ad2b0700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f41a80b0f30 0x7f41a80b35d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48130/0 (socket says 172.21.15.158:48130) 2019-12-05T03:50:01.074 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.063+0000 7f41ad2b0700 1 -- 172.21.15.158:0/1122351344 learned_addr learned my addr 172.21.15.158:0/1122351344 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:01.074 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.063+0000 7f41ae2b2700 1 --2- 172.21.15.158:0/1122351344 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f41a8142870 0x7f41a80603a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:01.075 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.063+0000 7f419a7fc700 1 -- 172.21.15.158:0/1122351344 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 357801465 0 0) 0x7f41a8142f90 con 0x7f41a80b0f30 2019-12-05T03:50:01.075 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.063+0000 7f419a7fc700 1 -- 172.21.15.158:0/1122351344 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41900030b0 con 0x7f41a80b0f30 2019-12-05T03:50:01.075 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.063+0000 7f419a7fc700 1 -- 172.21.15.158:0/1122351344 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2381207231 0 0) 0x7f41a80608f0 con 0x7f41a8140180 2019-12-05T03:50:01.075 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.063+0000 7f419a7fc700 1 -- 172.21.15.158:0/1122351344 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41a8142f90 con 0x7f41a8140180 2019-12-05T03:50:01.075 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.063+0000 7f41ae2b2700 1 -- 172.21.15.158:0/1122351344 >> v1:172.21.15.158:6789/0 conn(0x7f41a80b0f30 legacy=0x7f41a80b35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:01.075 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.063+0000 7f41ae2b2700 1 -- 172.21.15.158:0/1122351344 >> v1:172.21.15.96:6789/0 conn(0x7f41a8140180 legacy=0x7f41a80b0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:01.075 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.063+0000 7f419a7fc700 1 -- 172.21.15.158:0/1122351344 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2144195633 0 0) 0x7f41900030b0 con 0x7f41a80b0f30 2019-12-05T03:50:01.076 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.063+0000 7f41ae2b2700 1 -- 172.21.15.158:0/1122351344 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a8142ca0 con 0x7f41a8142870 2019-12-05T03:50:01.076 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.063+0000 7f41ae2b2700 1 --2- 172.21.15.158:0/1122351344 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f41a8142870 0x7f41a80603a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f419c001420 tx=0x7f41a0010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.076 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.063+0000 7f41ae2b2700 1 --2- 172.21.15.158:0/1122351344 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f41a8142870 0x7f41a80603a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f419c001420 tx=0x7f41a0010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.076 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.063+0000 7f41ae2b2700 1 --2- 172.21.15.158:0/1122351344 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f41a8142870 0x7f41a80603a0 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7f419c001420 tx=0x7f41a0010a50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:01.076 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.063+0000 7f41ae2b2700 1 --2- 172.21.15.158:0/1122351344 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f41a8142870 0x7f41a80603a0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f419c001420 tx=0x7f41a0010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.076 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.063+0000 7f419a7fc700 1 -- 172.21.15.158:0/1122351344 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41a0007350 con 0x7f41a8142870 2019-12-05T03:50:01.077 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.063+0000 7f41ae2b2700 1 --2- 172.21.15.158:0/1122351344 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f41a8142870 0x7f41a80603a0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f419c001420 tx=0x7f41a0010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.077 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.063+0000 7f41af514700 1 -- 172.21.15.158:0/1122351344 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a80b3dd0 con 0x7f41a8142870 2019-12-05T03:50:01.077 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.063+0000 7f419a7fc700 1 -- 172.21.15.158:0/1122351344 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a0005cb0 con 0x7f41a8142870 2019-12-05T03:50:01.077 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.063+0000 7f41ae2b2700 1 --2- 172.21.15.158:0/1122351344 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f41a8142870 0x7f41a80603a0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f419c001420 tx=0x7f41a0010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.077 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.063+0000 7f419a7fc700 1 -- 172.21.15.158:0/1122351344 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41a000a440 con 0x7f41a8142870 2019-12-05T03:50:01.077 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.063+0000 7f41af514700 1 -- 172.21.15.158:0/1122351344 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41a80b4320 con 0x7f41a8142870 2019-12-05T03:50:01.077 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.067+0000 7f41ae2b2700 1 --2- 172.21.15.158:0/1122351344 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f41a8142870 0x7f41a80603a0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f419c001420 tx=0x7f41a0010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.078 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.067+0000 7f419a7fc700 1 -- 172.21.15.158:0/1122351344 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f41a000d460 con 0x7f41a8142870 2019-12-05T03:50:01.078 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.067+0000 7f41ae2b2700 1 --2- 172.21.15.158:0/1122351344 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f41a8142870 0x7f41a80603a0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f419c001420 tx=0x7f41a0010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.078 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.067+0000 7f419a7fc700 1 --2- 172.21.15.158:0/1122351344 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f419003b3d0 0x7f419003d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:01.078 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.067+0000 7f419a7fc700 1 -- 172.21.15.158:0/1122351344 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5915+0+0 (secure 0 0 0) 0x7f41a004adb0 con 0x7f41a8142870 2019-12-05T03:50:01.078 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.067+0000 7f41adab1700 1 --2- 172.21.15.158:0/1122351344 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f419003b3d0 0x7f419003d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:01.078 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.067+0000 7f41adab1700 1 --2- 172.21.15.158:0/1122351344 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f419003b3d0 0x7f419003d8e0 crc :-1 s=READY pgs=48 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:01.078 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.071+0000 7f41af514700 1 -- 172.21.15.158:0/1122351344 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41a80554e0 con 0x7f41a8142870 2019-12-05T03:50:01.082 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.079+0000 7f41ae2b2700 1 --2- 172.21.15.158:0/1122351344 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f41a8142870 0x7f41a80603a0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f419c001420 tx=0x7f41a0010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.083 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.079+0000 7f419a7fc700 1 -- 172.21.15.158:0/1122351344 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f41a0031e10 con 0x7f41a8142870 2019-12-05T03:50:01.246 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.243+0000 7f41af514700 1 -- 172.21.15.158:0/1122351344 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7f41a807df40 con 0x7f41a8142870 2019-12-05T03:50:01.247 INFO:tasks.ceph.mon.b.smithi096.stderr:2019-12-05T03:50:01.249+0000 7fac1e63e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-12-05T03:50:01.259 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.259+0000 7f41ae2b2700 1 --2- 172.21.15.158:0/1122351344 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f41a8142870 0x7f41a80603a0 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7f419c001420 tx=0x7f41a0010a50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.260 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.259+0000 7f419a7fc700 1 -- 172.21.15.158:0/1122351344 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 2 and data pool 3 v2) v1 ==== 172+0+0 (secure 0 0 0) 0x7f41a0032070 con 0x7f41a8142870 2019-12-05T03:50:01.261 INFO:teuthology.orchestra.run.smithi158.stderr:new fs with metadata pool 2 and data pool 3 2019-12-05T03:50:01.263 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.259+0000 7f41af514700 1 -- 172.21.15.158:0/1122351344 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f419003b3d0 msgr2=0x7f419003d8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:01.264 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.259+0000 7f41af514700 1 --2- 172.21.15.158:0/1122351344 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f419003b3d0 0x7f419003d8e0 crc :-1 s=READY pgs=48 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:01.264 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.259+0000 7f41af514700 1 -- 172.21.15.158:0/1122351344 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f41a8142870 msgr2=0x7f41a80603a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:01.264 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.259+0000 7f41af514700 1 --2- 172.21.15.158:0/1122351344 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f41a8142870 0x7f41a80603a0 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7f419c001420 tx=0x7f41a0010a50).stop 2019-12-05T03:50:01.264 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.259+0000 7f41af514700 1 -- 172.21.15.158:0/1122351344 shutdown_connections 2019-12-05T03:50:01.264 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.263+0000 7f41af514700 1 --2- 172.21.15.158:0/1122351344 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f419003b3d0 0x7f419003d8e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:01.265 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.263+0000 7f41af514700 1 --2- 172.21.15.158:0/1122351344 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f41a8142870 0x7f41a80603a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:01.265 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.263+0000 7f41af514700 1 -- 172.21.15.158:0/1122351344 shutdown_connections 2019-12-05T03:50:01.265 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.263+0000 7f41af514700 1 -- 172.21.15.158:0/1122351344 wait complete. 2019-12-05T03:50:01.265 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.263+0000 7f41af514700 1 -- 172.21.15.158:0/1122351344 >> 172.21.15.158:0/1122351344 conn(0x7f41a809c2d0 msgr2=0x7f41a80b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:01.275 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-05T03:50:01.385 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.375+0000 7fd5afda4700 1 Processor -- start 2019-12-05T03:50:01.385 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.375+0000 7fd5afda4700 1 -- start start 2019-12-05T03:50:01.385 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.379+0000 7fd5afda4700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd5a805a740 0x7fd5a8155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:01.385 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.379+0000 7fd5afda4700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5a80accb0 con 0x7fd5a809cf60 2019-12-05T03:50:01.386 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.379+0000 7fd5afda4700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5a8156100 con 0x7fd5a809a320 2019-12-05T03:50:01.386 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.379+0000 7fd5afda4700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5a809a750 con 0x7fd5a805a740 2019-12-05T03:50:01.386 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.379+0000 7fd5aeb42700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd5a805a740 0x7fd5a8155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:01.386 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.379+0000 7fd5aeb42700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd5a805a740 0x7fd5a8155bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53362/0 (socket says 172.21.15.158:53362) 2019-12-05T03:50:01.386 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.379+0000 7fd5aeb42700 1 -- 172.21.15.158:0/3369914236 learned_addr learned my addr 172.21.15.158:0/3369914236 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:01.386 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.379+0000 7fd5aeb42700 1 -- 172.21.15.158:0/3369914236 >> v1:172.21.15.158:6789/0 conn(0x7fd5a809a320 legacy=0x7fd5a81553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:01.387 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.379+0000 7fd5aeb42700 1 -- 172.21.15.158:0/3369914236 >> v1:172.21.15.96:6789/0 conn(0x7fd5a809cf60 legacy=0x7fd5a8151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:01.387 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.379+0000 7fd5aeb42700 1 -- 172.21.15.158:0/3369914236 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a805ab70 con 0x7fd5a805a740 2019-12-05T03:50:01.387 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.379+0000 7fd5aeb42700 1 --2- 172.21.15.158:0/3369914236 >> v2:172.21.15.158:3300/0 conn(0x7fd5a805a740 0x7fd5a8155bb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd5a809c740 tx=0x7fd5a0010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.387 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.379+0000 7fd5aeb42700 1 --2- 172.21.15.158:0/3369914236 >> v2:172.21.15.158:3300/0 conn(0x7fd5a805a740 0x7fd5a8155bb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd5a809c740 tx=0x7fd5a0010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.387 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.379+0000 7fd5aeb42700 1 --2- 172.21.15.158:0/3369914236 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd5a805a740 0x7fd5a8155bb0 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7fd5a809c740 tx=0x7fd5a0010030).ready entity=mon.1 client_cookie=33a260238422ad06 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:01.387 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.379+0000 7fd5aeb42700 1 --2- 172.21.15.158:0/3369914236 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd5a805a740 0x7fd5a8155bb0 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7fd5a809c740 tx=0x7fd5a0010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.388 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.379+0000 7fd5aeb42700 1 --2- 172.21.15.158:0/3369914236 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd5a805a740 0x7fd5a8155bb0 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7fd5a809c740 tx=0x7fd5a0010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.388 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.379+0000 7fd5aeb42700 1 --2- 172.21.15.158:0/3369914236 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd5a805a740 0x7fd5a8155bb0 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7fd5a809c740 tx=0x7fd5a0010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.388 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.379+0000 7fd5ad33f700 1 -- 172.21.15.158:0/3369914236 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5a00110c0 con 0x7fd5a805a740 2019-12-05T03:50:01.388 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.379+0000 7fd5ad33f700 1 -- 172.21.15.158:0/3369914236 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a0010a30 con 0x7fd5a805a740 2019-12-05T03:50:01.388 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.379+0000 7fd5ad33f700 1 -- 172.21.15.158:0/3369914236 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5a00114b0 con 0x7fd5a805a740 2019-12-05T03:50:01.388 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.379+0000 7fd5afda4700 1 -- 172.21.15.158:0/3369914236 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd5a805a740 msgr2=0x7fd5a8155bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:01.389 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.379+0000 7fd5afda4700 1 --2- 172.21.15.158:0/3369914236 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd5a805a740 0x7fd5a8155bb0 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7fd5a809c740 tx=0x7fd5a0010030).stop 2019-12-05T03:50:01.389 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.379+0000 7fd5afda4700 1 -- 172.21.15.158:0/3369914236 shutdown_connections 2019-12-05T03:50:01.389 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.379+0000 7fd5afda4700 1 --2- 172.21.15.158:0/3369914236 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd5a805a740 0x7fd5a8155bb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:01.389 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.383+0000 7fd5afda4700 1 -- 172.21.15.158:0/3369914236 shutdown_connections 2019-12-05T03:50:01.389 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.383+0000 7fd5afda4700 1 -- 172.21.15.158:0/3369914236 wait complete. 2019-12-05T03:50:01.390 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.383+0000 7fd5afda4700 1 -- 172.21.15.158:0/3369914236 >> 172.21.15.158:0/3369914236 conn(0x7fd5a80b7e60 msgr2=0x7fd5a80b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:01.395 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.383+0000 7fd5afda4700 1 Processor -- start 2019-12-05T03:50:01.395 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.383+0000 7fd5afda4700 1 -- start start 2019-12-05T03:50:01.395 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.383+0000 7fd5afda4700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd5a80acfa0 0x7fd5a81357a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:01.396 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.383+0000 7fd5afda4700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd5a80b0740 0x7fd5a807d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:01.396 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.383+0000 7fd5afda4700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd5a807d7c0 0x7fd5a8131ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:01.396 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.383+0000 7fd5afda4700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5a8124a80 con 0x7fd5a80b0740 2019-12-05T03:50:01.396 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.383+0000 7fd5afda4700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5a8136160 con 0x7fd5a807d7c0 2019-12-05T03:50:01.396 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.383+0000 7fd5afda4700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a80b04a0 con 0x7fd5a80acfa0 2019-12-05T03:50:01.397 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.383+0000 7fd5aeb42700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd5a807d7c0 0x7fd5a8131ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:01.397 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.387+0000 7fd5aeb42700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd5a807d7c0 0x7fd5a8131ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53366/0 (socket says 172.21.15.158:53366) 2019-12-05T03:50:01.397 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.387+0000 7fd5aeb42700 1 -- 172.21.15.158:0/2185207775 learned_addr learned my addr 172.21.15.158:0/2185207775 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:01.397 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.387+0000 7fd5ae341700 1 --2- 172.21.15.158:0/2185207775 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd5a80acfa0 0x7fd5a81357a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:01.397 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.387+0000 7fd5adb40700 1 --2- 172.21.15.158:0/2185207775 >> v2:172.21.15.96:3300/0 conn(0x7fd5a80b0740 0x7fd5a807d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:01.397 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.387+0000 7fd5aeb42700 1 -- 172.21.15.158:0/2185207775 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd5a80acfa0 msgr2=0x7fd5a81357a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:01.398 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.387+0000 7fd5aeb42700 1 --2- 172.21.15.158:0/2185207775 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd5a80acfa0 0x7fd5a81357a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:01.398 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.387+0000 7fd5aeb42700 1 -- 172.21.15.158:0/2185207775 >> v2:172.21.15.96:3300/0 conn(0x7fd5a80b0740 msgr2=0x7fd5a807d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:01.398 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.387+0000 7fd5aeb42700 1 --2- 172.21.15.158:0/2185207775 >> v2:172.21.15.96:3300/0 conn(0x7fd5a80b0740 0x7fd5a807d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:01.398 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.387+0000 7fd5aeb42700 1 -- 172.21.15.158:0/2185207775 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a807dbf0 con 0x7fd5a807d7c0 2019-12-05T03:50:01.399 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.387+0000 7fd5ae341700 1 --2- 172.21.15.158:0/2185207775 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd5a80acfa0 0x7fd5a81357a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:50:01.399 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.387+0000 7fd5aeb42700 1 --2- 172.21.15.158:0/2185207775 >> v2:172.21.15.158:3300/0 conn(0x7fd5a807d7c0 0x7fd5a8131ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd5a80b0660 tx=0x7fd5a0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.399 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.387+0000 7fd5aeb42700 1 --2- 172.21.15.158:0/2185207775 >> v2:172.21.15.158:3300/0 conn(0x7fd5a807d7c0 0x7fd5a8131ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd5a80b0660 tx=0x7fd5a0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.399 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.387+0000 7fd5aeb42700 1 --2- 172.21.15.158:0/2185207775 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd5a807d7c0 0x7fd5a8131ea0 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7fd5a80b0660 tx=0x7fd5a0010d60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:01.400 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.387+0000 7fd5aeb42700 1 --2- 172.21.15.158:0/2185207775 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd5a807d7c0 0x7fd5a8131ea0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7fd5a80b0660 tx=0x7fd5a0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.400 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.387+0000 7fd5aeb42700 1 --2- 172.21.15.158:0/2185207775 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd5a807d7c0 0x7fd5a8131ea0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7fd5a80b0660 tx=0x7fd5a0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.400 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.387+0000 7fd5aeb42700 1 --2- 172.21.15.158:0/2185207775 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd5a807d7c0 0x7fd5a8131ea0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7fd5a80b0660 tx=0x7fd5a0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.400 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.387+0000 7fd59effd700 1 -- 172.21.15.158:0/2185207775 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5a0011d40 con 0x7fd5a807d7c0 2019-12-05T03:50:01.400 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.387+0000 7fd59effd700 1 -- 172.21.15.158:0/2185207775 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a0010e10 con 0x7fd5a807d7c0 2019-12-05T03:50:01.401 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.387+0000 7fd5afda4700 1 -- 172.21.15.158:0/2185207775 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5a8152d90 con 0x7fd5a807d7c0 2019-12-05T03:50:01.401 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.387+0000 7fd59effd700 1 -- 172.21.15.158:0/2185207775 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5a0005ca0 con 0x7fd5a807d7c0 2019-12-05T03:50:01.401 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.387+0000 7fd5afda4700 1 -- 172.21.15.158:0/2185207775 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a81323f0 con 0x7fd5a807d7c0 2019-12-05T03:50:01.401 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.387+0000 7fd5aeb42700 1 --2- 172.21.15.158:0/2185207775 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd5a807d7c0 0x7fd5a8131ea0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7fd5a80b0660 tx=0x7fd5a0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.401 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.387+0000 7fd59effd700 1 -- 172.21.15.158:0/2185207775 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fd5a000f280 con 0x7fd5a807d7c0 2019-12-05T03:50:01.401 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.387+0000 7fd5aeb42700 1 --2- 172.21.15.158:0/2185207775 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd5a807d7c0 0x7fd5a8131ea0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7fd5a80b0660 tx=0x7fd5a0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.401 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.387+0000 7fd59effd700 1 --2- 172.21.15.158:0/2185207775 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd59003ad70 0x7fd59003d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:01.402 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.387+0000 7fd59effd700 1 -- 172.21.15.158:0/2185207775 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fd5a004b660 con 0x7fd5a807d7c0 2019-12-05T03:50:01.402 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.387+0000 7fd5ae341700 1 --2- 172.21.15.158:0/2185207775 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd59003ad70 0x7fd59003d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:01.402 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.391+0000 7fd5ae341700 1 --2- 172.21.15.158:0/2185207775 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd59003ad70 0x7fd59003d280 crc :-1 s=READY pgs=49 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:01.402 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.391+0000 7fd5afda4700 1 -- 172.21.15.158:0/2185207775 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5a80554e0 con 0x7fd5a807d7c0 2019-12-05T03:50:01.403 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.395+0000 7fd5aeb42700 1 --2- 172.21.15.158:0/2185207775 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd5a807d7c0 0x7fd5a8131ea0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7fd5a80b0660 tx=0x7fd5a0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.403 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.395+0000 7fd59effd700 1 -- 172.21.15.158:0/2185207775 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fd5a0030360 con 0x7fd5a807d7c0 2019-12-05T03:50:01.560 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.559+0000 7fd5afda4700 1 -- 172.21.15.158:0/2185207775 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5a8066940 con 0x7fd5a807d7c0 2019-12-05T03:50:01.561 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.559+0000 7fd5aeb42700 1 --2- 172.21.15.158:0/2185207775 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd5a807d7c0 0x7fd5a8131ea0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7fd5a80b0660 tx=0x7fd5a0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.561 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.559+0000 7fd59effd700 1 -- 172.21.15.158:0/2185207775 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+14933 (secure 0 0 0) 0x7fd5a000ebf0 con 0x7fd5a807d7c0 2019-12-05T03:50:01.563 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:01.564 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":23,"fsid":"a91186ae-f496-4de1-918d-820c55ff1feb","created":"2019-12-05T03:49:39.187523+0000","modified":"2019-12-05T03:50:01.249305+0000","last_up_change":"2019-12-05T03:49:48.551934+0000","last_in_change":"2019-12-05T03:49:48.551934+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-05T03:49:52.900870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-12-05T03:49:55.801462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-12-05T03:49:58.659250+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"782c4258-e28c-4a11-9d54-3c9c7a36fba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":12192},{"type":"v1","addr":"172.21.15.158:6801","nonce":12192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":12192},{"type":"v1","addr":"172.21.15.158:6803","nonce":12192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":12192},{"type":"v1","addr":"172.21.15.158:6807","nonce":12192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":12192},{"type":"v1","addr":"172.21.15.158:6805","nonce":12192}]},"public_addr":"172.21.15.158:6801/12192","cluster_addr":"172.21.15.158:6803/12192","heartbeat_back_addr":"172.21.15.158:6807/12192","heartbeat_front_addr":"172.21.15.158:6805/12192","state":["exists","up"]},{"osd":1,"uuid":"d4426b21-b666-4158-bf34-a24b14572731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":12193},{"type":"v1","addr":"172.21.15.158:6809","nonce":12193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":12193},{"type":"v1","addr":"172.21.15.158:6811","nonce":12193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":12193},{"type":"v1","addr":"172.21.15.158:6815","nonce":12193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":12193},{"type":"v1","addr":"172.21.15.158:6813","nonce":12193}]},"public_addr":"172.21.15.158:6809/12193","cluster_addr":"172.21.15.158:6811/12193","heartbeat_back_addr":"172.21.15.158:6815/12193","heartbeat_front_addr":"172.21.15.158:6813/12193","state":["exists","up"]},{"osd":2,"uuid":"22680edd-6490-4ab0-bb15-0605830e4cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":12195},{"type":"v1","addr":"172.21.15.158:6825","nonce":12195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":12195},{"type":"v1","addr":"172.21.15.158:6827","nonce":12195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":12195},{"type":"v1","addr":"172.21.15.158:6831","nonce":12195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":12195},{"type":"v1","addr":"172.21.15.158:6829","nonce":12195}]},"public_addr":"172.21.15.158:6825/12195","cluster_addr":"172.21.15.158:6827/12195","heartbeat_back_addr":"172.21.15.158:6831/12195","heartbeat_front_addr":"172.21.15.158:6829/12195","state":["exists","up"]},{"osd":3,"uuid":"7ec999ee-ace8-4ccb-a4f9-6f5d313bbbd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":12194},{"type":"v1","addr":"172.21.15.158:6817","nonce":12194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":12194},{"type":"v1","addr":"172.21.15.158:6819","nonce":12194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":12194},{"type":"v1","addr":"172.21.15.158:6823","nonce":12194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":12194},{"type":"v1","addr":"172.21.15.158:6821","nonce":12194}]},"public_addr":"172.21.15.158:6817/12194","cluster_addr":"172.21.15.158:6819/12194","heartbeat_back_addr":"172.21.15.158:6823/12194","heartbeat_front_addr":"172.21.15.158:6821/12194","state":["exists","up"]},{"osd":4,"uuid":"186e69c4-b69f-4dd1-bb8f-faf759c60484","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":12460},{"type":"v1","addr":"172.21.15.96:6803","nonce":12460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":12460},{"type":"v1","addr":"172.21.15.96:6805","nonce":12460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":12460},{"type":"v1","addr":"172.21.15.96:6809","nonce":12460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":12460},{"type":"v1","addr":"172.21.15.96:6807","nonce":12460}]},"public_addr":"172.21.15.96:6803/12460","cluster_addr":"172.21.15.96:6805/12460","heartbeat_back_addr":"172.21.15.96:6809/12460","heartbeat_front_addr":"172.21.15.96:6807/12460","state":["exists","up"]},{"osd":5,"uuid":"86b658b2-8b40-4cea-8163-305a3982758b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":12461},{"type":"v1","addr":"172.21.15.96:6811","nonce":12461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":12461},{"type":"v1","addr":"172.21.15.96:6813","nonce":12461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":12461},{"type":"v1","addr":"172.21.15.96:6817","nonce":12461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":12461},{"type":"v1","addr":"172.21.15.96:6815","nonce":12461}]},"public_addr":"172.21.15.96:6811/12461","cluster_addr":"172.21.15.96:6813/12461","heartbeat_back_addr":"172.21.15.96:6817/12461","heartbeat_front_addr":"172.21.15.96:6815/12461","state":["exists","up"]},{"osd":6,"uuid":"bdadaea8-9296-4788-bc59-d9c9eb8defdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":12463},{"type":"v1","addr":"172.21.15.96:6827","nonce":12463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":12463},{"type":"v1","addr":"172.21.15.96:6829","nonce":12463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":12463},{"type":"v1","addr":"172.21.15.96:6833","nonce":12463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":12463},{"type":"v1","addr":"172.21.15.96:6831","nonce":12463}]},"public_addr":"172.21.15.96:6827/12463","cluster_addr":"172.21.15.96:6829/12463","heartbeat_back_addr":"172.21.15.96:6833/12463","heartbeat_front_addr":"172.21.15.96:6831/12463","state":["exists","up"]},{"osd":7,"uuid":"c6d71846-d68e-430f-ab72-0fb8ea4bf640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":12462},{"type":"v1","addr":"172.21.15.96:6819","nonce":12462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":12462},{"type":"v1","addr":"172.21.15.96:6821","nonce":12462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":12462},{"type":"v1","addr":"172.21.15.96:6825","nonce":12462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":12462},{"type":"v1","addr":"172.21.15.96:6823","nonce":12462}]},"public_addr":"172.21.15.96:6819/12462","cluster_addr":"172.21.15.96:6821/12462","heartbeat_back_addr":"172.21.15.96:6825/12462","heartbeat_front_addr":"172.21.15.96:6823/12462","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.875762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.900817+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.210347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.133973+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.864697+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.131015+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.237225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.154377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-05T03:50:01.566 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.563+0000 7fd5afda4700 1 -- 172.21.15.158:0/2185207775 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd59003ad70 msgr2=0x7fd59003d280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:01.566 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.563+0000 7fd5afda4700 1 --2- 172.21.15.158:0/2185207775 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd59003ad70 0x7fd59003d280 crc :-1 s=READY pgs=49 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:01.566 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.563+0000 7fd5afda4700 1 -- 172.21.15.158:0/2185207775 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd5a807d7c0 msgr2=0x7fd5a8131ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:01.566 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.563+0000 7fd5afda4700 1 --2- 172.21.15.158:0/2185207775 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd5a807d7c0 0x7fd5a8131ea0 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7fd5a80b0660 tx=0x7fd5a0010d60).stop 2019-12-05T03:50:01.566 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.563+0000 7fd5afda4700 1 -- 172.21.15.158:0/2185207775 shutdown_connections 2019-12-05T03:50:01.566 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.563+0000 7fd5afda4700 1 --2- 172.21.15.158:0/2185207775 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd59003ad70 0x7fd59003d280 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:01.567 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.563+0000 7fd5afda4700 1 --2- 172.21.15.158:0/2185207775 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd5a807d7c0 0x7fd5a8131ea0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:01.567 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.563+0000 7fd5afda4700 1 --2- 172.21.15.158:0/2185207775 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd5a80acfa0 0x7fd5a81357a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:01.567 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.563+0000 7fd5afda4700 1 --2- 172.21.15.158:0/2185207775 >> v2:172.21.15.96:3300/0 conn(0x7fd5a80b0740 0x7fd5a807d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:01.567 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.563+0000 7fd5afda4700 1 -- 172.21.15.158:0/2185207775 shutdown_connections 2019-12-05T03:50:01.567 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.563+0000 7fd5afda4700 1 -- 172.21.15.158:0/2185207775 wait complete. 2019-12-05T03:50:01.567 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.563+0000 7fd5afda4700 1 -- 172.21.15.158:0/2185207775 >> 172.21.15.158:0/2185207775 conn(0x7fd5a80b5c60 msgr2=0x7fd5a80ac2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:01.576 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-05T03:50:01.671 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.663+0000 7fbede520700 1 Processor -- start 2019-12-05T03:50:01.671 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.663+0000 7fbede520700 1 -- start start 2019-12-05T03:50:01.671 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.663+0000 7fbede520700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbed809cf50 0x7fbed809a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:01.671 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.663+0000 7fbede520700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fbed805a730 0x7fbed8151450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:01.671 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.663+0000 7fbede520700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed80acca0 con 0x7fbed81519a0 2019-12-05T03:50:01.671 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.663+0000 7fbede520700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbed80b1720 con 0x7fbed805a730 2019-12-05T03:50:01.672 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.663+0000 7fbede520700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed80b19c0 con 0x7fbed809cf50 2019-12-05T03:50:01.672 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.663+0000 7fbed7fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fbed805a730 0x7fbed8151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:01.672 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.663+0000 7fbedd2be700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fbed81519a0 0x7fbed80b52d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48156/0 (socket says 172.21.15.158:48156) 2019-12-05T03:50:01.672 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.663+0000 7fbedd2be700 1 -- 172.21.15.158:0/3696370615 learned_addr learned my addr 172.21.15.158:0/3696370615 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:01.672 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.663+0000 7fbedcabd700 1 --2- 172.21.15.158:0/3696370615 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbed809cf50 0x7fbed809a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:01.673 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.663+0000 7fbed7fff700 1 -- 172.21.15.158:0/3696370615 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbed809cf50 msgr2=0x7fbed809a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:01.673 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.663+0000 7fbed7fff700 1 --2- 172.21.15.158:0/3696370615 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbed809cf50 0x7fbed809a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:01.673 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.663+0000 7fbed7fff700 1 -- 172.21.15.158:0/3696370615 >> v1:172.21.15.158:6789/0 conn(0x7fbed81519a0 legacy=0x7fbed80b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:01.673 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.663+0000 7fbed77fe700 1 -- 172.21.15.158:0/3696370615 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 729212156 0 0) 0x7fbed80acca0 con 0x7fbed81519a0 2019-12-05T03:50:01.673 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.663+0000 7fbed7fff700 1 -- 172.21.15.158:0/3696370615 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed805ab60 con 0x7fbed805a730 2019-12-05T03:50:01.673 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.667+0000 7fbed7fff700 1 --2- 172.21.15.158:0/3696370615 >> v2:172.21.15.158:3300/0 conn(0x7fbed805a730 0x7fbed8151450 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbed80b18e0 tx=0x7fbecc00fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.674 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.667+0000 7fbed7fff700 1 --2- 172.21.15.158:0/3696370615 >> v2:172.21.15.158:3300/0 conn(0x7fbed805a730 0x7fbed8151450 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbed80b18e0 tx=0x7fbecc00fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.674 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.667+0000 7fbed7fff700 1 --2- 172.21.15.158:0/3696370615 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbed805a730 0x7fbed8151450 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7fbed80b18e0 tx=0x7fbecc00fc70).ready entity=mon.1 client_cookie=fffb68a1253abbe5 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:01.674 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.667+0000 7fbed7fff700 1 --2- 172.21.15.158:0/3696370615 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbed805a730 0x7fbed8151450 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7fbed80b18e0 tx=0x7fbecc00fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.674 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.667+0000 7fbed77fe700 1 -- 172.21.15.158:0/3696370615 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbecc0112f0 con 0x7fbed805a730 2019-12-05T03:50:01.674 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.667+0000 7fbed7fff700 1 --2- 172.21.15.158:0/3696370615 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbed805a730 0x7fbed8151450 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7fbed80b18e0 tx=0x7fbecc00fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.674 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.667+0000 7fbed7fff700 1 --2- 172.21.15.158:0/3696370615 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbed805a730 0x7fbed8151450 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7fbed80b18e0 tx=0x7fbecc00fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.674 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.667+0000 7fbed77fe700 1 -- 172.21.15.158:0/3696370615 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbecc008ad0 con 0x7fbed805a730 2019-12-05T03:50:01.675 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.667+0000 7fbed77fe700 1 -- 172.21.15.158:0/3696370615 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbecc0118d0 con 0x7fbed805a730 2019-12-05T03:50:01.675 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.667+0000 7fbede520700 1 -- 172.21.15.158:0/3696370615 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbed805a730 msgr2=0x7fbed8151450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:01.675 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.667+0000 7fbede520700 1 --2- 172.21.15.158:0/3696370615 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbed805a730 0x7fbed8151450 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7fbed80b18e0 tx=0x7fbecc00fc70).stop 2019-12-05T03:50:01.675 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.667+0000 7fbede520700 1 -- 172.21.15.158:0/3696370615 shutdown_connections 2019-12-05T03:50:01.675 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.667+0000 7fbede520700 1 --2- 172.21.15.158:0/3696370615 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbed809cf50 0x7fbed809a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:01.675 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.667+0000 7fbede520700 1 --2- 172.21.15.158:0/3696370615 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbed805a730 0x7fbed8151450 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:01.676 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.667+0000 7fbede520700 1 -- 172.21.15.158:0/3696370615 shutdown_connections 2019-12-05T03:50:01.676 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.667+0000 7fbede520700 1 -- 172.21.15.158:0/3696370615 wait complete. 2019-12-05T03:50:01.676 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.667+0000 7fbede520700 1 -- 172.21.15.158:0/3696370615 >> 172.21.15.158:0/3696370615 conn(0x7fbed80b7e50 msgr2=0x7fbed80b3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:01.679 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.671+0000 7fbede520700 1 Processor -- start 2019-12-05T03:50:01.680 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.671+0000 7fbede520700 1 -- start start 2019-12-05T03:50:01.680 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.671+0000 7fbede520700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbed813bf10 0x7fbed80b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:01.680 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.671+0000 7fbede520700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed813ce80 con 0x7fbed80b22e0 2019-12-05T03:50:01.680 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.671+0000 7fbede520700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed812ca70 con 0x7fbed81512b0 2019-12-05T03:50:01.680 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.671+0000 7fbede520700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbed813c3e0 con 0x7fbed813bf10 2019-12-05T03:50:01.680 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.671+0000 7fbedd2be700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fbed81512b0 0x7fbed812c270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48160/0 (socket says 172.21.15.158:48160) 2019-12-05T03:50:01.681 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.671+0000 7fbedd2be700 1 -- 172.21.15.158:0/592061862 learned_addr learned my addr 172.21.15.158:0/592061862 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:01.681 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.671+0000 7fbedcabd700 1 --2- 172.21.15.158:0/592061862 >> v2:172.21.15.96:3300/0 conn(0x7fbed813bf10 0x7fbed80b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:01.681 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.671+0000 7fbed57fa700 1 -- 172.21.15.158:0/592061862 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3687447000 0 0) 0x7fbed812ca70 con 0x7fbed81512b0 2019-12-05T03:50:01.681 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.671+0000 7fbed57fa700 1 -- 172.21.15.158:0/592061862 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbeb80030b0 con 0x7fbed81512b0 2019-12-05T03:50:01.681 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.671+0000 7fbedcabd700 1 -- 172.21.15.158:0/592061862 >> v1:172.21.15.158:6789/0 conn(0x7fbed81512b0 legacy=0x7fbed812c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:01.681 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.671+0000 7fbedcabd700 1 -- 172.21.15.158:0/592061862 >> v1:172.21.15.96:6789/0 conn(0x7fbed80b22e0 legacy=0x7fbed813c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:01.682 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.671+0000 7fbed57fa700 1 -- 172.21.15.158:0/592061862 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2158438088 0 0) 0x7fbed813ce80 con 0x7fbed80b22e0 2019-12-05T03:50:01.682 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.671+0000 7fbedcabd700 1 -- 172.21.15.158:0/592061862 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed812cca0 con 0x7fbed813bf10 2019-12-05T03:50:01.682 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.671+0000 7fbedcabd700 1 --2- 172.21.15.158:0/592061862 >> v2:172.21.15.96:3300/0 conn(0x7fbed813bf10 0x7fbed80b1d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbec8002f30 tx=0x7fbec80109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.682 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.671+0000 7fbedcabd700 1 --2- 172.21.15.158:0/592061862 >> v2:172.21.15.96:3300/0 conn(0x7fbed813bf10 0x7fbed80b1d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbec8002f30 tx=0x7fbec80109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.682 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.671+0000 7fbedcabd700 1 --2- 172.21.15.158:0/592061862 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbed813bf10 0x7fbed80b1d90 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7fbec8002f30 tx=0x7fbec80109e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:01.682 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.671+0000 7fbedcabd700 1 --2- 172.21.15.158:0/592061862 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbed813bf10 0x7fbed80b1d90 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7fbec8002f30 tx=0x7fbec80109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.682 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.671+0000 7fbed57fa700 1 -- 172.21.15.158:0/592061862 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbec8005920 con 0x7fbed813bf10 2019-12-05T03:50:01.683 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.671+0000 7fbedcabd700 1 --2- 172.21.15.158:0/592061862 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbed813bf10 0x7fbed80b1d90 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7fbec8002f30 tx=0x7fbec80109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.683 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.671+0000 7fbedcabd700 1 --2- 172.21.15.158:0/592061862 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbed813bf10 0x7fbed80b1d90 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7fbec8002f30 tx=0x7fbec80109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.683 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.675+0000 7fbed57fa700 1 -- 172.21.15.158:0/592061862 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec8005540 con 0x7fbed813bf10 2019-12-05T03:50:01.683 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.675+0000 7fbede520700 1 -- 172.21.15.158:0/592061862 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbed807b720 con 0x7fbed813bf10 2019-12-05T03:50:01.683 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.675+0000 7fbed57fa700 1 -- 172.21.15.158:0/592061862 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbec8012510 con 0x7fbed813bf10 2019-12-05T03:50:01.683 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.675+0000 7fbede520700 1 -- 172.21.15.158:0/592061862 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbed8155040 con 0x7fbed813bf10 2019-12-05T03:50:01.683 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.675+0000 7fbedcabd700 1 --2- 172.21.15.158:0/592061862 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbed813bf10 0x7fbed80b1d90 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7fbec8002f30 tx=0x7fbec80109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.684 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.675+0000 7fbedcabd700 1 --2- 172.21.15.158:0/592061862 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbed813bf10 0x7fbed80b1d90 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7fbec8002f30 tx=0x7fbec80109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.684 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.675+0000 7fbed57fa700 1 -- 172.21.15.158:0/592061862 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fbec80127e0 con 0x7fbed813bf10 2019-12-05T03:50:01.684 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.675+0000 7fbed57fa700 1 --2- 172.21.15.158:0/592061862 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fbeb803b1c0 0x7fbeb803d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:01.684 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.675+0000 7fbed57fa700 1 -- 172.21.15.158:0/592061862 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fbec804ad80 con 0x7fbed813bf10 2019-12-05T03:50:01.684 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.675+0000 7fbed7fff700 1 --2- 172.21.15.158:0/592061862 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fbeb803b1c0 0x7fbeb803d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:01.684 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.675+0000 7fbed7fff700 1 --2- 172.21.15.158:0/592061862 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fbeb803b1c0 0x7fbeb803d6d0 crc :-1 s=READY pgs=50 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:01.684 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.679+0000 7fbede520700 1 -- 172.21.15.158:0/592061862 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbed80554d0 con 0x7fbed813bf10 2019-12-05T03:50:01.688 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.687+0000 7fbedcabd700 1 --2- 172.21.15.158:0/592061862 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbed813bf10 0x7fbed80b1d90 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7fbec8002f30 tx=0x7fbec80109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.688 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.687+0000 7fbed57fa700 1 -- 172.21.15.158:0/592061862 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fbec8031dc0 con 0x7fbed813bf10 2019-12-05T03:50:01.858 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.855+0000 7fbede520700 1 -- 172.21.15.158:0/592061862 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbed8066930 con 0x7fbed813bf10 2019-12-05T03:50:01.860 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.859+0000 7fbedcabd700 1 --2- 172.21.15.158:0/592061862 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbed813bf10 0x7fbed80b1d90 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7fbec8002f30 tx=0x7fbec80109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.861 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.859+0000 7fbed57fa700 1 -- 172.21.15.158:0/592061862 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+14933 (secure 0 0 0) 0x7fbec8032020 con 0x7fbed813bf10 2019-12-05T03:50:01.862 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:01.862 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":23,"fsid":"a91186ae-f496-4de1-918d-820c55ff1feb","created":"2019-12-05T03:49:39.187523+0000","modified":"2019-12-05T03:50:01.249305+0000","last_up_change":"2019-12-05T03:49:48.551934+0000","last_in_change":"2019-12-05T03:49:48.551934+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-05T03:49:52.900870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-12-05T03:49:55.801462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-12-05T03:49:58.659250+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"782c4258-e28c-4a11-9d54-3c9c7a36fba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":12192},{"type":"v1","addr":"172.21.15.158:6801","nonce":12192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":12192},{"type":"v1","addr":"172.21.15.158:6803","nonce":12192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":12192},{"type":"v1","addr":"172.21.15.158:6807","nonce":12192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":12192},{"type":"v1","addr":"172.21.15.158:6805","nonce":12192}]},"public_addr":"172.21.15.158:6801/12192","cluster_addr":"172.21.15.158:6803/12192","heartbeat_back_addr":"172.21.15.158:6807/12192","heartbeat_front_addr":"172.21.15.158:6805/12192","state":["exists","up"]},{"osd":1,"uuid":"d4426b21-b666-4158-bf34-a24b14572731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":12193},{"type":"v1","addr":"172.21.15.158:6809","nonce":12193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":12193},{"type":"v1","addr":"172.21.15.158:6811","nonce":12193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":12193},{"type":"v1","addr":"172.21.15.158:6815","nonce":12193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":12193},{"type":"v1","addr":"172.21.15.158:6813","nonce":12193}]},"public_addr":"172.21.15.158:6809/12193","cluster_addr":"172.21.15.158:6811/12193","heartbeat_back_addr":"172.21.15.158:6815/12193","heartbeat_front_addr":"172.21.15.158:6813/12193","state":["exists","up"]},{"osd":2,"uuid":"22680edd-6490-4ab0-bb15-0605830e4cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":12195},{"type":"v1","addr":"172.21.15.158:6825","nonce":12195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":12195},{"type":"v1","addr":"172.21.15.158:6827","nonce":12195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":12195},{"type":"v1","addr":"172.21.15.158:6831","nonce":12195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":12195},{"type":"v1","addr":"172.21.15.158:6829","nonce":12195}]},"public_addr":"172.21.15.158:6825/12195","cluster_addr":"172.21.15.158:6827/12195","heartbeat_back_addr":"172.21.15.158:6831/12195","heartbeat_front_addr":"172.21.15.158:6829/12195","state":["exists","up"]},{"osd":3,"uuid":"7ec999ee-ace8-4ccb-a4f9-6f5d313bbbd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":12194},{"type":"v1","addr":"172.21.15.158:6817","nonce":12194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":12194},{"type":"v1","addr":"172.21.15.158:6819","nonce":12194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":12194},{"type":"v1","addr":"172.21.15.158:6823","nonce":12194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":12194},{"type":"v1","addr":"172.21.15.158:6821","nonce":12194}]},"public_addr":"172.21.15.158:6817/12194","cluster_addr":"172.21.15.158:6819/12194","heartbeat_back_addr":"172.21.15.158:6823/12194","heartbeat_front_addr":"172.21.15.158:6821/12194","state":["exists","up"]},{"osd":4,"uuid":"186e69c4-b69f-4dd1-bb8f-faf759c60484","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":12460},{"type":"v1","addr":"172.21.15.96:6803","nonce":12460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":12460},{"type":"v1","addr":"172.21.15.96:6805","nonce":12460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":12460},{"type":"v1","addr":"172.21.15.96:6809","nonce":12460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":12460},{"type":"v1","addr":"172.21.15.96:6807","nonce":12460}]},"public_addr":"172.21.15.96:6803/12460","cluster_addr":"172.21.15.96:6805/12460","heartbeat_back_addr":"172.21.15.96:6809/12460","heartbeat_front_addr":"172.21.15.96:6807/12460","state":["exists","up"]},{"osd":5,"uuid":"86b658b2-8b40-4cea-8163-305a3982758b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":12461},{"type":"v1","addr":"172.21.15.96:6811","nonce":12461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":12461},{"type":"v1","addr":"172.21.15.96:6813","nonce":12461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":12461},{"type":"v1","addr":"172.21.15.96:6817","nonce":12461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":12461},{"type":"v1","addr":"172.21.15.96:6815","nonce":12461}]},"public_addr":"172.21.15.96:6811/12461","cluster_addr":"172.21.15.96:6813/12461","heartbeat_back_addr":"172.21.15.96:6817/12461","heartbeat_front_addr":"172.21.15.96:6815/12461","state":["exists","up"]},{"osd":6,"uuid":"bdadaea8-9296-4788-bc59-d9c9eb8defdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":12463},{"type":"v1","addr":"172.21.15.96:6827","nonce":12463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":12463},{"type":"v1","addr":"172.21.15.96:6829","nonce":12463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":12463},{"type":"v1","addr":"172.21.15.96:6833","nonce":12463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":12463},{"type":"v1","addr":"172.21.15.96:6831","nonce":12463}]},"public_addr":"172.21.15.96:6827/12463","cluster_addr":"172.21.15.96:6829/12463","heartbeat_back_addr":"172.21.15.96:6833/12463","heartbeat_front_addr":"172.21.15.96:6831/12463","state":["exists","up"]},{"osd":7,"uuid":"c6d71846-d68e-430f-ab72-0fb8ea4bf640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":12462},{"type":"v1","addr":"172.21.15.96:6819","nonce":12462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":12462},{"type":"v1","addr":"172.21.15.96:6821","nonce":12462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":12462},{"type":"v1","addr":"172.21.15.96:6825","nonce":12462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":12462},{"type":"v1","addr":"172.21.15.96:6823","nonce":12462}]},"public_addr":"172.21.15.96:6819/12462","cluster_addr":"172.21.15.96:6821/12462","heartbeat_back_addr":"172.21.15.96:6825/12462","heartbeat_front_addr":"172.21.15.96:6823/12462","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.875762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.900817+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.210347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.133973+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.864697+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.131015+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.237225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.154377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-05T03:50:01.864 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.863+0000 7fbede520700 1 -- 172.21.15.158:0/592061862 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fbeb803b1c0 msgr2=0x7fbeb803d6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:01.864 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.863+0000 7fbede520700 1 --2- 172.21.15.158:0/592061862 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fbeb803b1c0 0x7fbeb803d6d0 crc :-1 s=READY pgs=50 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:01.865 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.863+0000 7fbede520700 1 -- 172.21.15.158:0/592061862 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbed813bf10 msgr2=0x7fbed80b1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:01.865 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.863+0000 7fbede520700 1 --2- 172.21.15.158:0/592061862 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbed813bf10 0x7fbed80b1d90 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7fbec8002f30 tx=0x7fbec80109e0).stop 2019-12-05T03:50:01.865 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.863+0000 7fbede520700 1 -- 172.21.15.158:0/592061862 shutdown_connections 2019-12-05T03:50:01.865 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.863+0000 7fbede520700 1 --2- 172.21.15.158:0/592061862 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbed813bf10 0x7fbed80b1d90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:01.865 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.863+0000 7fbede520700 1 --2- 172.21.15.158:0/592061862 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fbeb803b1c0 0x7fbeb803d6d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:01.865 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.863+0000 7fbede520700 1 -- 172.21.15.158:0/592061862 shutdown_connections 2019-12-05T03:50:01.866 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.863+0000 7fbede520700 1 -- 172.21.15.158:0/592061862 wait complete. 2019-12-05T03:50:01.866 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.863+0000 7fbede520700 1 -- 172.21.15.158:0/592061862 >> 172.21.15.158:0/592061862 conn(0x7fbed809cf50 msgr2=0x7fbed80b52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:01.876 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2019-12-05T03:50:01.973 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.963+0000 7f1e19043700 1 Processor -- start 2019-12-05T03:50:01.973 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.963+0000 7f1e19043700 1 -- start start 2019-12-05T03:50:01.973 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.967+0000 7f1e19043700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f1e140b6970 0x7f1e1409add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:01.973 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.967+0000 7f1e19043700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1e1409ba40 0x7f1e1405a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:01.973 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.967+0000 7f1e19043700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e14099e30 con 0x7f1e1405a950 2019-12-05T03:50:01.973 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.967+0000 7f1e19043700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e1409d210 con 0x7f1e140b6970 2019-12-05T03:50:01.974 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.967+0000 7f1e19043700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e14099b90 con 0x7f1e1409ba40 2019-12-05T03:50:01.974 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.967+0000 7f1e1359e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f1e140b6970 0x7f1e1409add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:01.974 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.967+0000 7f1e18842700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f1e1405a950 0x7f1e14155290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48168/0 (socket says 172.21.15.158:48168) 2019-12-05T03:50:01.974 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.967+0000 7f1e18842700 1 -- 172.21.15.158:0/3909922929 learned_addr learned my addr 172.21.15.158:0/3909922929 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:01.974 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.967+0000 7f1e12d9d700 1 --2- 172.21.15.158:0/3909922929 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1e1409ba40 0x7f1e1405a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:01.974 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.967+0000 7f1e1359e700 1 -- 172.21.15.158:0/3909922929 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1e1409ba40 msgr2=0x7f1e1405a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:01.974 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.967+0000 7f1e1359e700 1 --2- 172.21.15.158:0/3909922929 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1e1409ba40 0x7f1e1405a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:01.975 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.967+0000 7f1e1359e700 1 -- 172.21.15.158:0/3909922929 >> v1:172.21.15.158:6789/0 conn(0x7f1e1405a950 legacy=0x7f1e14155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:01.975 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.967+0000 7f1e1359e700 1 -- 172.21.15.158:0/3909922929 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1407e960 con 0x7f1e140b6970 2019-12-05T03:50:01.975 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.967+0000 7f1e1359e700 1 --2- 172.21.15.158:0/3909922929 >> v2:172.21.15.158:3300/0 conn(0x7f1e140b6970 0x7f1e1409add0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1e04008b10 tx=0x7f1e0400fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.975 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.967+0000 7f1e1359e700 1 --2- 172.21.15.158:0/3909922929 >> v2:172.21.15.158:3300/0 conn(0x7f1e140b6970 0x7f1e1409add0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1e04008b10 tx=0x7f1e0400fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.975 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.967+0000 7f1e1359e700 1 --2- 172.21.15.158:0/3909922929 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1e140b6970 0x7f1e1409add0 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f1e04008b10 tx=0x7f1e0400fff0).ready entity=mon.1 client_cookie=1cbcaf83dc5ba749 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:01.975 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.967+0000 7f1e1359e700 1 --2- 172.21.15.158:0/3909922929 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1e140b6970 0x7f1e1409add0 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f1e04008b10 tx=0x7f1e0400fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.976 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.967+0000 7f1e1259c700 1 -- 172.21.15.158:0/3909922929 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e04010900 con 0x7f1e140b6970 2019-12-05T03:50:01.976 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.967+0000 7f1e1359e700 1 --2- 172.21.15.158:0/3909922929 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1e140b6970 0x7f1e1409add0 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f1e04008b10 tx=0x7f1e0400fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.976 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.967+0000 7f1e1359e700 1 --2- 172.21.15.158:0/3909922929 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1e140b6970 0x7f1e1409add0 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f1e04008b10 tx=0x7f1e0400fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.976 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.967+0000 7f1e1259c700 1 -- 172.21.15.158:0/3909922929 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e04008b50 con 0x7f1e140b6970 2019-12-05T03:50:01.976 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.967+0000 7f1e1259c700 1 -- 172.21.15.158:0/3909922929 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e040110c0 con 0x7f1e140b6970 2019-12-05T03:50:01.976 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.967+0000 7f1e19043700 1 -- 172.21.15.158:0/3909922929 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1e140b6970 msgr2=0x7f1e1409add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:01.976 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.967+0000 7f1e19043700 1 --2- 172.21.15.158:0/3909922929 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1e140b6970 0x7f1e1409add0 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f1e04008b10 tx=0x7f1e0400fff0).stop 2019-12-05T03:50:01.977 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.967+0000 7f1e19043700 1 -- 172.21.15.158:0/3909922929 shutdown_connections 2019-12-05T03:50:01.977 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.967+0000 7f1e19043700 1 --2- 172.21.15.158:0/3909922929 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1e140b6970 0x7f1e1409add0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:01.977 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.967+0000 7f1e19043700 1 --2- 172.21.15.158:0/3909922929 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1e1409ba40 0x7f1e1405a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:01.977 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.967+0000 7f1e19043700 1 -- 172.21.15.158:0/3909922929 shutdown_connections 2019-12-05T03:50:01.977 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.967+0000 7f1e19043700 1 -- 172.21.15.158:0/3909922929 wait complete. 2019-12-05T03:50:01.977 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.967+0000 7f1e19043700 1 -- 172.21.15.158:0/3909922929 >> 172.21.15.158:0/3909922929 conn(0x7f1e140b7ef0 msgr2=0x7f1e140b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:01.977 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.971+0000 7f1e19043700 1 Processor -- start 2019-12-05T03:50:01.978 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.971+0000 7f1e19043700 1 -- start start 2019-12-05T03:50:01.982 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.971+0000 7f1e19043700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1e140af010 0x7f1e1407b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:01.983 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.971+0000 7f1e19043700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f1e14068d80 0x7f1e1407b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:01.983 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.971+0000 7f1e19043700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e14154570 con 0x7f1e1413d0a0 2019-12-05T03:50:01.983 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.971+0000 7f1e19043700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e140aead0 con 0x7f1e14068d80 2019-12-05T03:50:01.983 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.971+0000 7f1e19043700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e140aed70 con 0x7f1e140af010 2019-12-05T03:50:01.983 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.971+0000 7f1e12d9d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f1e14068d80 0x7f1e1407b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:01.984 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.971+0000 7f1e12d9d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f1e14068d80 0x7f1e1407b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53392/0 (socket says 172.21.15.158:53392) 2019-12-05T03:50:01.984 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.971+0000 7f1e12d9d700 1 -- 172.21.15.158:0/1030685743 learned_addr learned my addr 172.21.15.158:0/1030685743 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:01.984 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.971+0000 7f1e1359e700 1 --2- 172.21.15.158:0/1030685743 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1e140af010 0x7f1e1407b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:01.984 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.971+0000 7f1e12d9d700 1 -- 172.21.15.158:0/1030685743 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1e140af010 msgr2=0x7f1e1407b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:01.985 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.971+0000 7f1e12d9d700 1 --2- 172.21.15.158:0/1030685743 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1e140af010 0x7f1e1407b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:01.985 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.971+0000 7f1e12d9d700 1 -- 172.21.15.158:0/1030685743 >> v1:172.21.15.96:6789/0 conn(0x7f1e1413d0a0 legacy=0x7f1e14139820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:01.985 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.971+0000 7f1e12d9d700 1 -- 172.21.15.158:0/1030685743 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e140acfc0 con 0x7f1e14068d80 2019-12-05T03:50:01.985 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.971+0000 7f1e12d9d700 1 --2- 172.21.15.158:0/1030685743 >> v2:172.21.15.158:3300/0 conn(0x7f1e14068d80 0x7f1e1407b8b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1e140aec90 tx=0x7f1dfc010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.985 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.971+0000 7f1e12d9d700 1 --2- 172.21.15.158:0/1030685743 >> v2:172.21.15.158:3300/0 conn(0x7f1e14068d80 0x7f1e1407b8b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1e140aec90 tx=0x7f1dfc010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.985 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.971+0000 7f1e12d9d700 1 --2- 172.21.15.158:0/1030685743 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1e14068d80 0x7f1e1407b8b0 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f1e140aec90 tx=0x7f1dfc010bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:01.986 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.971+0000 7f1e12d9d700 1 --2- 172.21.15.158:0/1030685743 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1e14068d80 0x7f1e1407b8b0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f1e140aec90 tx=0x7f1dfc010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.986 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.971+0000 7f1e0bfff700 1 -- 172.21.15.158:0/1030685743 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dfc012640 con 0x7f1e14068d80 2019-12-05T03:50:01.986 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.975+0000 7f1e12d9d700 1 --2- 172.21.15.158:0/1030685743 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1e14068d80 0x7f1e1407b8b0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f1e140aec90 tx=0x7f1dfc010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.986 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.975+0000 7f1e12d9d700 1 --2- 172.21.15.158:0/1030685743 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1e14068d80 0x7f1e1407b8b0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f1e140aec90 tx=0x7f1dfc010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.986 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.975+0000 7f1e0bfff700 1 -- 172.21.15.158:0/1030685743 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dfc007150 con 0x7f1e14068d80 2019-12-05T03:50:01.986 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.975+0000 7f1e19043700 1 -- 172.21.15.158:0/1030685743 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e1413d4d0 con 0x7f1e14068d80 2019-12-05T03:50:01.987 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.975+0000 7f1e0bfff700 1 -- 172.21.15.158:0/1030685743 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dfc012c20 con 0x7f1e14068d80 2019-12-05T03:50:01.987 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.975+0000 7f1e19043700 1 -- 172.21.15.158:0/1030685743 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e1413a020 con 0x7f1e14068d80 2019-12-05T03:50:01.987 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.975+0000 7f1e12d9d700 1 --2- 172.21.15.158:0/1030685743 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1e14068d80 0x7f1e1407b8b0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f1e140aec90 tx=0x7f1dfc010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.987 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.975+0000 7f1e0bfff700 1 -- 172.21.15.158:0/1030685743 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f1dfc005540 con 0x7f1e14068d80 2019-12-05T03:50:01.988 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.975+0000 7f1e12d9d700 1 --2- 172.21.15.158:0/1030685743 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1e14068d80 0x7f1e1407b8b0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f1e140aec90 tx=0x7f1dfc010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.988 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.975+0000 7f1e0bfff700 1 --2- 172.21.15.158:0/1030685743 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f1df803ace0 0x7f1df803d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:01.988 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.975+0000 7f1e0bfff700 1 -- 172.21.15.158:0/1030685743 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f1dfc04b250 con 0x7f1e14068d80 2019-12-05T03:50:01.988 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.975+0000 7f1e1359e700 1 --2- 172.21.15.158:0/1030685743 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f1df803ace0 0x7f1df803d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:01.988 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.975+0000 7f1e1359e700 1 --2- 172.21.15.158:0/1030685743 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f1df803ace0 0x7f1df803d1f0 crc :-1 s=READY pgs=51 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:01.989 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.979+0000 7f1e19043700 1 -- 172.21.15.158:0/1030685743 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e140554e0 con 0x7f1e14068d80 2019-12-05T03:50:01.990 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.987+0000 7f1e12d9d700 1 --2- 172.21.15.158:0/1030685743 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1e14068d80 0x7f1e1407b8b0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f1e140aec90 tx=0x7f1dfc010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:01.990 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:01.987+0000 7f1e0bfff700 1 -- 172.21.15.158:0/1030685743 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f1dfc0322d0 con 0x7f1e14068d80 2019-12-05T03:50:02.155 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:02.155+0000 7f1e19043700 1 -- 172.21.15.158:0/1030685743 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"} v 0) v1 -- 0x7f1e14066940 con 0x7f1e14068d80 2019-12-05T03:50:02.964 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:02.963+0000 7f1e12d9d700 1 --2- 172.21.15.158:0/1030685743 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1e14068d80 0x7f1e1407b8b0 secure :-1 s=THROTTLE_DONE pgs=72 cs=0 l=1 rx=0x7f1e140aec90 tx=0x7f1dfc010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:02.964 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:02.963+0000 7f1e0bfff700 1 -- 172.21.15.158:0/1030685743 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"}]=0 v3) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1dfc032530 con 0x7f1e14068d80 2019-12-05T03:50:02.976 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:02.971+0000 7f1e19043700 1 -- 172.21.15.158:0/1030685743 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f1df803ace0 msgr2=0x7f1df803d1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:02.976 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:02.971+0000 7f1e19043700 1 --2- 172.21.15.158:0/1030685743 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f1df803ace0 0x7f1df803d1f0 crc :-1 s=READY pgs=51 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:02.976 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:02.971+0000 7f1e19043700 1 -- 172.21.15.158:0/1030685743 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1e14068d80 msgr2=0x7f1e1407b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:02.976 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:02.975+0000 7f1e19043700 1 --2- 172.21.15.158:0/1030685743 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1e14068d80 0x7f1e1407b8b0 secure :-1 s=READY pgs=72 cs=0 l=1 rx=0x7f1e140aec90 tx=0x7f1dfc010bd0).stop 2019-12-05T03:50:02.977 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:02.975+0000 7f1e19043700 1 -- 172.21.15.158:0/1030685743 shutdown_connections 2019-12-05T03:50:02.977 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:02.975+0000 7f1e19043700 1 --2- 172.21.15.158:0/1030685743 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f1df803ace0 0x7f1df803d1f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:02.977 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:02.975+0000 7f1e19043700 1 --2- 172.21.15.158:0/1030685743 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1e140af010 0x7f1e1407b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:02.977 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:02.975+0000 7f1e19043700 1 --2- 172.21.15.158:0/1030685743 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1e14068d80 0x7f1e1407b8b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:02.977 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:02.975+0000 7f1e19043700 1 -- 172.21.15.158:0/1030685743 shutdown_connections 2019-12-05T03:50:02.977 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:02.975+0000 7f1e19043700 1 -- 172.21.15.158:0/1030685743 wait complete. 2019-12-05T03:50:02.977 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:02.975+0000 7f1e19043700 1 -- 172.21.15.158:0/1030685743 >> 172.21.15.158:0/1030685743 conn(0x7f1e14155bf0 msgr2=0x7f1e140b5370 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:02.992 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-12-05T03:50:03.093 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.087+0000 7f6316c80700 1 Processor -- start 2019-12-05T03:50:03.093 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.087+0000 7f6316c80700 1 -- start start 2019-12-05T03:50:03.093 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.087+0000 7f6316c80700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f631009cf50 0x7f631009a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:03.093 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.087+0000 7f6316c80700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f63101553a0 0x7f63101557d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:03.094 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.087+0000 7f6316c80700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63100acca0 con 0x7f631005a730 2019-12-05T03:50:03.094 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.087+0000 7f6316c80700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63100b1720 con 0x7f63101553a0 2019-12-05T03:50:03.094 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.087+0000 7f6316c80700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63100b19c0 con 0x7f631009cf50 2019-12-05T03:50:03.094 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.087+0000 7f631521d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f631009cf50 0x7f631009a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:03.094 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.087+0000 7f631521d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f631009cf50 0x7f631009a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53398/0 (socket says 172.21.15.158:53398) 2019-12-05T03:50:03.094 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.087+0000 7f631521d700 1 -- 172.21.15.158:0/866286283 learned_addr learned my addr 172.21.15.158:0/866286283 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:03.094 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.087+0000 7f6314a1c700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f631005a730 0x7f6310151450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48180/0 (socket says 172.21.15.158:48180) 2019-12-05T03:50:03.095 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.087+0000 7f6315a1e700 1 --2- 172.21.15.158:0/866286283 >> v2:172.21.15.96:3300/0 conn(0x7f63101553a0 0x7f63101557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:03.095 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.087+0000 7f631521d700 1 -- 172.21.15.158:0/866286283 >> v2:172.21.15.96:3300/0 conn(0x7f63101553a0 msgr2=0x7f63101557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:03.095 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.087+0000 7f631521d700 1 --2- 172.21.15.158:0/866286283 >> v2:172.21.15.96:3300/0 conn(0x7f63101553a0 0x7f63101557d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:03.095 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.087+0000 7f631521d700 1 -- 172.21.15.158:0/866286283 >> v1:172.21.15.158:6789/0 conn(0x7f631005a730 legacy=0x7f6310151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:03.095 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.087+0000 7f631521d700 1 -- 172.21.15.158:0/866286283 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631005ab60 con 0x7f631009cf50 2019-12-05T03:50:03.095 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.087+0000 7f631521d700 1 --2- 172.21.15.158:0/866286283 >> v2:172.21.15.158:3300/0 conn(0x7f631009cf50 0x7f631009a310 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6300008b10 tx=0x7f63000100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.096 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.087+0000 7f631521d700 1 --2- 172.21.15.158:0/866286283 >> v2:172.21.15.158:3300/0 conn(0x7f631009cf50 0x7f631009a310 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6300008b10 tx=0x7f63000100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.096 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.087+0000 7f631521d700 1 --2- 172.21.15.158:0/866286283 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f631009cf50 0x7f631009a310 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f6300008b10 tx=0x7f63000100b0).ready entity=mon.1 client_cookie=b960793273eaab70 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:03.096 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.087+0000 7f631521d700 1 --2- 172.21.15.158:0/866286283 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f631009cf50 0x7f631009a310 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f6300008b10 tx=0x7f63000100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.096 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.087+0000 7f630ffff700 1 -- 172.21.15.158:0/866286283 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6300010d60 con 0x7f631009cf50 2019-12-05T03:50:03.096 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.087+0000 7f631521d700 1 --2- 172.21.15.158:0/866286283 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f631009cf50 0x7f631009a310 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f6300008b10 tx=0x7f63000100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.096 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.087+0000 7f631521d700 1 --2- 172.21.15.158:0/866286283 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f631009cf50 0x7f631009a310 secure :-1 s=THROTTLE_DONE pgs=74 cs=0 l=1 rx=0x7f6300008b10 tx=0x7f63000100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.097 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.087+0000 7f630ffff700 1 -- 172.21.15.158:0/866286283 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6300010980 con 0x7f631009cf50 2019-12-05T03:50:03.097 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.087+0000 7f630ffff700 1 -- 172.21.15.158:0/866286283 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63000114a0 con 0x7f631009cf50 2019-12-05T03:50:03.097 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.087+0000 7f6316c80700 1 -- 172.21.15.158:0/866286283 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f631009cf50 msgr2=0x7f631009a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:03.097 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.087+0000 7f6316c80700 1 --2- 172.21.15.158:0/866286283 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f631009cf50 0x7f631009a310 secure :-1 s=READY pgs=74 cs=0 l=1 rx=0x7f6300008b10 tx=0x7f63000100b0).stop 2019-12-05T03:50:03.097 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.091+0000 7f6316c80700 1 -- 172.21.15.158:0/866286283 shutdown_connections 2019-12-05T03:50:03.097 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.091+0000 7f6316c80700 1 --2- 172.21.15.158:0/866286283 >> v2:172.21.15.96:3300/0 conn(0x7f63101553a0 0x7f63101557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:03.098 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.091+0000 7f6316c80700 1 --2- 172.21.15.158:0/866286283 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f631009cf50 0x7f631009a310 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:03.098 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.091+0000 7f6316c80700 1 -- 172.21.15.158:0/866286283 shutdown_connections 2019-12-05T03:50:03.098 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.091+0000 7f6316c80700 1 -- 172.21.15.158:0/866286283 wait complete. 2019-12-05T03:50:03.098 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.091+0000 7f6316c80700 1 -- 172.21.15.158:0/866286283 >> 172.21.15.158:0/866286283 conn(0x7f63100b7e50 msgr2=0x7f63100b3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:03.102 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.091+0000 7f6316c80700 1 Processor -- start 2019-12-05T03:50:03.102 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.091+0000 7f6316c80700 1 -- start start 2019-12-05T03:50:03.102 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.095+0000 7f6316c80700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f631013a710 0x7f631009ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:03.102 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.095+0000 7f6316c80700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f6310151e30 0x7f6310126d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:03.102 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.095+0000 7f6316c80700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6310152260 con 0x7f6310135b70 2019-12-05T03:50:03.102 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.095+0000 7f6316c80700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6310152620 con 0x7f631013a710 2019-12-05T03:50:03.103 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.095+0000 7f6316c80700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63101367b0 con 0x7f6310151e30 2019-12-05T03:50:03.103 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.095+0000 7f6314a1c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f6310151e30 0x7f6310126d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:03.103 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.095+0000 7f6314a1c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f6310151e30 0x7f6310126d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53406/0 (socket says 172.21.15.158:53406) 2019-12-05T03:50:03.103 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.095+0000 7f6314a1c700 1 -- 172.21.15.158:0/1581475988 learned_addr learned my addr 172.21.15.158:0/1581475988 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:03.103 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.095+0000 7f631521d700 1 --2- 172.21.15.158:0/1581475988 >> v2:172.21.15.96:3300/0 conn(0x7f631013a710 0x7f631009ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:03.103 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.095+0000 7f6314a1c700 1 -- 172.21.15.158:0/1581475988 >> v2:172.21.15.96:3300/0 conn(0x7f631013a710 msgr2=0x7f631009ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:03.103 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.095+0000 7f6314a1c700 1 --2- 172.21.15.158:0/1581475988 >> v2:172.21.15.96:3300/0 conn(0x7f631013a710 0x7f631009ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:03.104 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.095+0000 7f6314a1c700 1 -- 172.21.15.158:0/1581475988 >> v1:172.21.15.96:6789/0 conn(0x7f6310135b70 legacy=0x7f6310136a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:03.104 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.095+0000 7f6314a1c700 1 -- 172.21.15.158:0/1581475988 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6310127280 con 0x7f6310151e30 2019-12-05T03:50:03.104 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.095+0000 7f6314a1c700 1 --2- 172.21.15.158:0/1581475988 >> v2:172.21.15.158:3300/0 conn(0x7f6310151e30 0x7f6310126d30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6304000e90 tx=0x7f630400c390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.104 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.095+0000 7f6314a1c700 1 --2- 172.21.15.158:0/1581475988 >> v2:172.21.15.158:3300/0 conn(0x7f6310151e30 0x7f6310126d30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6304000e90 tx=0x7f630400c390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.104 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.095+0000 7f6314a1c700 1 --2- 172.21.15.158:0/1581475988 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6310151e30 0x7f6310126d30 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7f6304000e90 tx=0x7f630400c390).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:03.105 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.095+0000 7f6314a1c700 1 --2- 172.21.15.158:0/1581475988 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6310151e30 0x7f6310126d30 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f6304000e90 tx=0x7f630400c390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.105 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.095+0000 7f6314a1c700 1 --2- 172.21.15.158:0/1581475988 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6310151e30 0x7f6310126d30 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f6304000e90 tx=0x7f630400c390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.105 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.095+0000 7f630dffb700 1 -- 172.21.15.158:0/1581475988 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6304011660 con 0x7f6310151e30 2019-12-05T03:50:03.105 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.095+0000 7f6314a1c700 1 --2- 172.21.15.158:0/1581475988 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6310151e30 0x7f6310126d30 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f6304000e90 tx=0x7f630400c390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.105 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.095+0000 7f630dffb700 1 -- 172.21.15.158:0/1581475988 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6304011280 con 0x7f6310151e30 2019-12-05T03:50:03.105 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.095+0000 7f6316c80700 1 -- 172.21.15.158:0/1581475988 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6310137250 con 0x7f6310151e30 2019-12-05T03:50:03.106 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.095+0000 7f630dffb700 1 -- 172.21.15.158:0/1581475988 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6304011c40 con 0x7f6310151e30 2019-12-05T03:50:03.106 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.095+0000 7f6316c80700 1 -- 172.21.15.158:0/1581475988 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6310135fa0 con 0x7f6310151e30 2019-12-05T03:50:03.106 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.095+0000 7f6314a1c700 1 --2- 172.21.15.158:0/1581475988 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6310151e30 0x7f6310126d30 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f6304000e90 tx=0x7f630400c390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.106 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.099+0000 7f630dffb700 1 -- 172.21.15.158:0/1581475988 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f6304006460 con 0x7f6310151e30 2019-12-05T03:50:03.106 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.099+0000 7f6314a1c700 1 --2- 172.21.15.158:0/1581475988 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6310151e30 0x7f6310126d30 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f6304000e90 tx=0x7f630400c390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.106 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.099+0000 7f630dffb700 1 --2- 172.21.15.158:0/1581475988 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f62f003acc0 0x7f62f003d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:03.106 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.099+0000 7f630dffb700 1 -- 172.21.15.158:0/1581475988 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f630404ae10 con 0x7f6310151e30 2019-12-05T03:50:03.107 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.099+0000 7f631521d700 1 --2- 172.21.15.158:0/1581475988 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f62f003acc0 0x7f62f003d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:03.107 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.099+0000 7f631521d700 1 --2- 172.21.15.158:0/1581475988 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f62f003acc0 0x7f62f003d1d0 crc :-1 s=READY pgs=52 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:03.107 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.099+0000 7f6316c80700 1 -- 172.21.15.158:0/1581475988 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63100554d0 con 0x7f6310151e30 2019-12-05T03:50:03.108 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.103+0000 7f6314a1c700 1 --2- 172.21.15.158:0/1581475988 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6310151e30 0x7f6310126d30 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f6304000e90 tx=0x7f630400c390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.108 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.103+0000 7f630dffb700 1 -- 172.21.15.158:0/1581475988 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f6304031e90 con 0x7f6310151e30 2019-12-05T03:50:03.271 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.271+0000 7f6316c80700 1 -- 172.21.15.158:0/1581475988 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f631005a940 con 0x7f6310151e30 2019-12-05T03:50:03.272 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.271+0000 7f6314a1c700 1 --2- 172.21.15.158:0/1581475988 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6310151e30 0x7f6310126d30 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f6304000e90 tx=0x7f630400c390).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.273 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.271+0000 7f630dffb700 1 -- 172.21.15.158:0/1581475988 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+1420 (secure 0 0 0) 0x7f63040320f0 con 0x7f6310151e30 2019-12-05T03:50:03.273 INFO:teuthology.orchestra.run.smithi158.stderr:dumped fsmap epoch 3 2019-12-05T03:50:03.273 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:03.273 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":3,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":3,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-12-05T03:50:01.249656+0000","modified":"2019-12-05T03:50:02.953958+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2019-12-05T03:50:03.275 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.271+0000 7f6316c80700 1 -- 172.21.15.158:0/1581475988 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f62f003acc0 msgr2=0x7f62f003d1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:03.275 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.271+0000 7f6316c80700 1 --2- 172.21.15.158:0/1581475988 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f62f003acc0 0x7f62f003d1d0 crc :-1 s=READY pgs=52 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:03.275 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.271+0000 7f6316c80700 1 -- 172.21.15.158:0/1581475988 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6310151e30 msgr2=0x7f6310126d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:03.276 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.271+0000 7f6316c80700 1 --2- 172.21.15.158:0/1581475988 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6310151e30 0x7f6310126d30 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7f6304000e90 tx=0x7f630400c390).stop 2019-12-05T03:50:03.276 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.271+0000 7f6316c80700 1 -- 172.21.15.158:0/1581475988 shutdown_connections 2019-12-05T03:50:03.276 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.271+0000 7f6316c80700 1 --2- 172.21.15.158:0/1581475988 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f62f003acc0 0x7f62f003d1d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:03.276 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.271+0000 7f6316c80700 1 --2- 172.21.15.158:0/1581475988 >> v2:172.21.15.96:3300/0 conn(0x7f631013a710 0x7f631009ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:03.276 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.271+0000 7f6316c80700 1 --2- 172.21.15.158:0/1581475988 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6310151e30 0x7f6310126d30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:03.276 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.271+0000 7f6316c80700 1 -- 172.21.15.158:0/1581475988 shutdown_connections 2019-12-05T03:50:03.276 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.271+0000 7f6316c80700 1 -- 172.21.15.158:0/1581475988 wait complete. 2019-12-05T03:50:03.277 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.271+0000 7f6316c80700 1 -- 172.21.15.158:0/1581475988 >> 172.21.15.158:0/1581475988 conn(0x7f6310155620 msgr2=0x7f63100b52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:03.285 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-05T03:50:03.387 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.379+0000 7f351b043700 1 Processor -- start 2019-12-05T03:50:03.388 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.379+0000 7f351b043700 1 -- start start 2019-12-05T03:50:03.388 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.379+0000 7f351b043700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f351405a740 0x7f3514155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:03.388 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.379+0000 7f351b043700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35140accb0 con 0x7f351409a320 2019-12-05T03:50:03.388 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.379+0000 7f351b043700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3514156100 con 0x7f351409cf60 2019-12-05T03:50:03.388 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.379+0000 7f351b043700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f351409a750 con 0x7f351405a740 2019-12-05T03:50:03.389 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.379+0000 7f35195e0700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f351409cf60 0x7f3514151460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48192/0 (socket says 172.21.15.158:48192) 2019-12-05T03:50:03.389 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.379+0000 7f35195e0700 1 -- 172.21.15.158:0/280367457 learned_addr learned my addr 172.21.15.158:0/280367457 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:03.389 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.379+0000 7f3519de1700 1 --2- 172.21.15.158:0/280367457 >> v2:172.21.15.96:3300/0 conn(0x7f351405a740 0x7f3514155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:03.389 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.383+0000 7f350bfff700 1 -- 172.21.15.158:0/280367457 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 815551007 0 0) 0x7f3514156100 con 0x7f351409cf60 2019-12-05T03:50:03.389 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.383+0000 7f350bfff700 1 -- 172.21.15.158:0/280367457 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35000030b0 con 0x7f351409cf60 2019-12-05T03:50:03.389 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.383+0000 7f3519de1700 1 -- 172.21.15.158:0/280367457 >> v1:172.21.15.158:6789/0 conn(0x7f351409cf60 legacy=0x7f3514151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:03.389 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.383+0000 7f350bfff700 1 -- 172.21.15.158:0/280367457 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2339814090 0 0) 0x7f35000030b0 con 0x7f351409cf60 2019-12-05T03:50:03.390 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.383+0000 7f3519de1700 1 -- 172.21.15.158:0/280367457 >> v1:172.21.15.96:6789/0 conn(0x7f351409a320 legacy=0x7f35141553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:03.390 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.383+0000 7f3519de1700 1 -- 172.21.15.158:0/280367457 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f351405ab70 con 0x7f351405a740 2019-12-05T03:50:03.390 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.383+0000 7f3519de1700 1 --2- 172.21.15.158:0/280367457 >> v2:172.21.15.96:3300/0 conn(0x7f351405a740 0x7f3514155bb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f35040011d0 tx=0x7f3504001150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.390 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.383+0000 7f3519de1700 1 --2- 172.21.15.158:0/280367457 >> v2:172.21.15.96:3300/0 conn(0x7f351405a740 0x7f3514155bb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f35040011d0 tx=0x7f3504001150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.390 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.383+0000 7f3519de1700 1 --2- 172.21.15.158:0/280367457 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f351405a740 0x7f3514155bb0 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7f35040011d0 tx=0x7f3504001150).ready entity=mon.0 client_cookie=8233062f3eec27ae server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:03.390 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.383+0000 7f3519de1700 1 --2- 172.21.15.158:0/280367457 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f351405a740 0x7f3514155bb0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f35040011d0 tx=0x7f3504001150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.390 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.383+0000 7f350bfff700 1 -- 172.21.15.158:0/280367457 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3510001750 con 0x7f351405a740 2019-12-05T03:50:03.390 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.383+0000 7f3519de1700 1 --2- 172.21.15.158:0/280367457 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f351405a740 0x7f3514155bb0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f35040011d0 tx=0x7f3504001150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.391 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.383+0000 7f3519de1700 1 --2- 172.21.15.158:0/280367457 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f351405a740 0x7f3514155bb0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f35040011d0 tx=0x7f3504001150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.391 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.383+0000 7f350bfff700 1 -- 172.21.15.158:0/280367457 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3510001560 con 0x7f351405a740 2019-12-05T03:50:03.391 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.383+0000 7f350bfff700 1 -- 172.21.15.158:0/280367457 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f350c0109e0 con 0x7f351405a740 2019-12-05T03:50:03.391 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.383+0000 7f351b043700 1 -- 172.21.15.158:0/280367457 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f351405a740 msgr2=0x7f3514155bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:03.391 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.383+0000 7f351b043700 1 --2- 172.21.15.158:0/280367457 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f351405a740 0x7f3514155bb0 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7f35040011d0 tx=0x7f3504001150).stop 2019-12-05T03:50:03.391 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.383+0000 7f351b043700 1 -- 172.21.15.158:0/280367457 shutdown_connections 2019-12-05T03:50:03.391 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.383+0000 7f351b043700 1 --2- 172.21.15.158:0/280367457 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f351405a740 0x7f3514155bb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:03.392 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.383+0000 7f351b043700 1 -- 172.21.15.158:0/280367457 shutdown_connections 2019-12-05T03:50:03.392 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.383+0000 7f351b043700 1 -- 172.21.15.158:0/280367457 wait complete. 2019-12-05T03:50:03.392 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.383+0000 7f351b043700 1 -- 172.21.15.158:0/280367457 >> 172.21.15.158:0/280367457 conn(0x7f35140b7e60 msgr2=0x7f35140b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:03.395 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.387+0000 7f351b043700 1 Processor -- start 2019-12-05T03:50:03.395 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.387+0000 7f351b043700 1 -- start start 2019-12-05T03:50:03.395 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.387+0000 7f351b043700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3514151190 0x7f351407cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:03.396 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.387+0000 7f351b043700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f351412c990 0x7f351412cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:03.396 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.387+0000 7f351b043700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f351412dc50 con 0x7f35141398a0 2019-12-05T03:50:03.396 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.387+0000 7f351b043700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3514138b30 con 0x7f351412c990 2019-12-05T03:50:03.396 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.387+0000 7f351b043700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f351412df60 con 0x7f3514151190 2019-12-05T03:50:03.396 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.387+0000 7f35195e0700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f35141398a0 0x7f3514138330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48198/0 (socket says 172.21.15.158:48198) 2019-12-05T03:50:03.396 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.387+0000 7f3519de1700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f351412c990 0x7f351412cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:03.397 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.387+0000 7f35195e0700 1 -- 172.21.15.158:0/361370994 learned_addr learned my addr 172.21.15.158:0/361370994 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:03.397 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.387+0000 7f3518ddf700 1 --2- 172.21.15.158:0/361370994 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3514151190 0x7f351407cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:03.397 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.387+0000 7f3519de1700 1 -- 172.21.15.158:0/361370994 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3514151190 msgr2=0x7f351407cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:03.397 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.387+0000 7f3519de1700 1 --2- 172.21.15.158:0/361370994 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3514151190 0x7f351407cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:03.397 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.387+0000 7f3519de1700 1 -- 172.21.15.158:0/361370994 >> v1:172.21.15.158:6789/0 conn(0x7f35141398a0 legacy=0x7f3514138330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:03.397 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.387+0000 7f3519de1700 1 -- 172.21.15.158:0/361370994 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3514139cd0 con 0x7f351412c990 2019-12-05T03:50:03.397 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.387+0000 7f3509ffb700 1 -- 172.21.15.158:0/361370994 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1873489170 0 0) 0x7f351412dc50 con 0x7f35141398a0 2019-12-05T03:50:03.398 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.387+0000 7f3519de1700 1 --2- 172.21.15.158:0/361370994 >> v2:172.21.15.158:3300/0 conn(0x7f351412c990 0x7f351412cdc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f351412de80 tx=0x7f350c010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.398 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.387+0000 7f3519de1700 1 --2- 172.21.15.158:0/361370994 >> v2:172.21.15.158:3300/0 conn(0x7f351412c990 0x7f351412cdc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f351412de80 tx=0x7f350c010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.398 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.387+0000 7f3519de1700 1 --2- 172.21.15.158:0/361370994 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f351412c990 0x7f351412cdc0 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f351412de80 tx=0x7f350c010f30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:03.398 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.391+0000 7f3519de1700 1 --2- 172.21.15.158:0/361370994 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f351412c990 0x7f351412cdc0 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f351412de80 tx=0x7f350c010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.398 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.391+0000 7f3509ffb700 1 -- 172.21.15.158:0/361370994 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f350c00f7f0 con 0x7f351412c990 2019-12-05T03:50:03.398 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.391+0000 7f351b043700 1 -- 172.21.15.158:0/361370994 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f351407d030 con 0x7f351412c990 2019-12-05T03:50:03.398 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.391+0000 7f3519de1700 1 --2- 172.21.15.158:0/361370994 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f351412c990 0x7f351412cdc0 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f351412de80 tx=0x7f350c010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.399 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.391+0000 7f351b043700 1 -- 172.21.15.158:0/361370994 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35141515c0 con 0x7f351412c990 2019-12-05T03:50:03.399 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.391+0000 7f3519de1700 1 --2- 172.21.15.158:0/361370994 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f351412c990 0x7f351412cdc0 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f351412de80 tx=0x7f350c010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.399 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.391+0000 7f3509ffb700 1 -- 172.21.15.158:0/361370994 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350c008d00 con 0x7f351412c990 2019-12-05T03:50:03.399 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.391+0000 7f3509ffb700 1 -- 172.21.15.158:0/361370994 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f350c005ca0 con 0x7f351412c990 2019-12-05T03:50:03.399 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.391+0000 7f3519de1700 1 --2- 172.21.15.158:0/361370994 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f351412c990 0x7f351412cdc0 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f351412de80 tx=0x7f350c010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.399 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.391+0000 7f3509ffb700 1 -- 172.21.15.158:0/361370994 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f350c007160 con 0x7f351412c990 2019-12-05T03:50:03.399 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.391+0000 7f3519de1700 1 --2- 172.21.15.158:0/361370994 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f351412c990 0x7f351412cdc0 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f351412de80 tx=0x7f350c010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.400 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.391+0000 7f3509ffb700 1 --2- 172.21.15.158:0/361370994 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f34f403ac10 0x7f34f403d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:03.400 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.391+0000 7f3509ffb700 1 -- 172.21.15.158:0/361370994 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f350c04ad60 con 0x7f351412c990 2019-12-05T03:50:03.400 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.391+0000 7f35195e0700 1 --2- 172.21.15.158:0/361370994 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f34f403ac10 0x7f34f403d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:03.400 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.391+0000 7f35195e0700 1 --2- 172.21.15.158:0/361370994 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f34f403ac10 0x7f34f403d120 crc :-1 s=READY pgs=53 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:03.400 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.395+0000 7f351b043700 1 -- 172.21.15.158:0/361370994 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35140554e0 con 0x7f351412c990 2019-12-05T03:50:03.402 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.399+0000 7f3519de1700 1 --2- 172.21.15.158:0/361370994 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f351412c990 0x7f351412cdc0 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f351412de80 tx=0x7f350c010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.402 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.399+0000 7f3509ffb700 1 -- 172.21.15.158:0/361370994 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f350c031dc0 con 0x7f351412c990 2019-12-05T03:50:03.563 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.563+0000 7f351b043700 1 -- 172.21.15.158:0/361370994 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3514066940 con 0x7f351412c990 2019-12-05T03:50:03.565 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.563+0000 7f3519de1700 1 --2- 172.21.15.158:0/361370994 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f351412c990 0x7f351412cdc0 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f351412de80 tx=0x7f350c010f30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.565 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.563+0000 7f3509ffb700 1 -- 172.21.15.158:0/361370994 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+14933 (secure 0 0 0) 0x7f350c02fa40 con 0x7f351412c990 2019-12-05T03:50:03.566 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:03.567 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":23,"fsid":"a91186ae-f496-4de1-918d-820c55ff1feb","created":"2019-12-05T03:49:39.187523+0000","modified":"2019-12-05T03:50:01.249305+0000","last_up_change":"2019-12-05T03:49:48.551934+0000","last_in_change":"2019-12-05T03:49:48.551934+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-05T03:49:52.900870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-12-05T03:49:55.801462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-12-05T03:49:58.659250+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"782c4258-e28c-4a11-9d54-3c9c7a36fba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":12192},{"type":"v1","addr":"172.21.15.158:6801","nonce":12192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":12192},{"type":"v1","addr":"172.21.15.158:6803","nonce":12192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":12192},{"type":"v1","addr":"172.21.15.158:6807","nonce":12192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":12192},{"type":"v1","addr":"172.21.15.158:6805","nonce":12192}]},"public_addr":"172.21.15.158:6801/12192","cluster_addr":"172.21.15.158:6803/12192","heartbeat_back_addr":"172.21.15.158:6807/12192","heartbeat_front_addr":"172.21.15.158:6805/12192","state":["exists","up"]},{"osd":1,"uuid":"d4426b21-b666-4158-bf34-a24b14572731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":12193},{"type":"v1","addr":"172.21.15.158:6809","nonce":12193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":12193},{"type":"v1","addr":"172.21.15.158:6811","nonce":12193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":12193},{"type":"v1","addr":"172.21.15.158:6815","nonce":12193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":12193},{"type":"v1","addr":"172.21.15.158:6813","nonce":12193}]},"public_addr":"172.21.15.158:6809/12193","cluster_addr":"172.21.15.158:6811/12193","heartbeat_back_addr":"172.21.15.158:6815/12193","heartbeat_front_addr":"172.21.15.158:6813/12193","state":["exists","up"]},{"osd":2,"uuid":"22680edd-6490-4ab0-bb15-0605830e4cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":12195},{"type":"v1","addr":"172.21.15.158:6825","nonce":12195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":12195},{"type":"v1","addr":"172.21.15.158:6827","nonce":12195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":12195},{"type":"v1","addr":"172.21.15.158:6831","nonce":12195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":12195},{"type":"v1","addr":"172.21.15.158:6829","nonce":12195}]},"public_addr":"172.21.15.158:6825/12195","cluster_addr":"172.21.15.158:6827/12195","heartbeat_back_addr":"172.21.15.158:6831/12195","heartbeat_front_addr":"172.21.15.158:6829/12195","state":["exists","up"]},{"osd":3,"uuid":"7ec999ee-ace8-4ccb-a4f9-6f5d313bbbd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":12194},{"type":"v1","addr":"172.21.15.158:6817","nonce":12194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":12194},{"type":"v1","addr":"172.21.15.158:6819","nonce":12194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":12194},{"type":"v1","addr":"172.21.15.158:6823","nonce":12194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":12194},{"type":"v1","addr":"172.21.15.158:6821","nonce":12194}]},"public_addr":"172.21.15.158:6817/12194","cluster_addr":"172.21.15.158:6819/12194","heartbeat_back_addr":"172.21.15.158:6823/12194","heartbeat_front_addr":"172.21.15.158:6821/12194","state":["exists","up"]},{"osd":4,"uuid":"186e69c4-b69f-4dd1-bb8f-faf759c60484","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":12460},{"type":"v1","addr":"172.21.15.96:6803","nonce":12460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":12460},{"type":"v1","addr":"172.21.15.96:6805","nonce":12460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":12460},{"type":"v1","addr":"172.21.15.96:6809","nonce":12460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":12460},{"type":"v1","addr":"172.21.15.96:6807","nonce":12460}]},"public_addr":"172.21.15.96:6803/12460","cluster_addr":"172.21.15.96:6805/12460","heartbeat_back_addr":"172.21.15.96:6809/12460","heartbeat_front_addr":"172.21.15.96:6807/12460","state":["exists","up"]},{"osd":5,"uuid":"86b658b2-8b40-4cea-8163-305a3982758b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":12461},{"type":"v1","addr":"172.21.15.96:6811","nonce":12461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":12461},{"type":"v1","addr":"172.21.15.96:6813","nonce":12461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":12461},{"type":"v1","addr":"172.21.15.96:6817","nonce":12461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":12461},{"type":"v1","addr":"172.21.15.96:6815","nonce":12461}]},"public_addr":"172.21.15.96:6811/12461","cluster_addr":"172.21.15.96:6813/12461","heartbeat_back_addr":"172.21.15.96:6817/12461","heartbeat_front_addr":"172.21.15.96:6815/12461","state":["exists","up"]},{"osd":6,"uuid":"bdadaea8-9296-4788-bc59-d9c9eb8defdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":12463},{"type":"v1","addr":"172.21.15.96:6827","nonce":12463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":12463},{"type":"v1","addr":"172.21.15.96:6829","nonce":12463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":12463},{"type":"v1","addr":"172.21.15.96:6833","nonce":12463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":12463},{"type":"v1","addr":"172.21.15.96:6831","nonce":12463}]},"public_addr":"172.21.15.96:6827/12463","cluster_addr":"172.21.15.96:6829/12463","heartbeat_back_addr":"172.21.15.96:6833/12463","heartbeat_front_addr":"172.21.15.96:6831/12463","state":["exists","up"]},{"osd":7,"uuid":"c6d71846-d68e-430f-ab72-0fb8ea4bf640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":12462},{"type":"v1","addr":"172.21.15.96:6819","nonce":12462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":12462},{"type":"v1","addr":"172.21.15.96:6821","nonce":12462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":12462},{"type":"v1","addr":"172.21.15.96:6825","nonce":12462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":12462},{"type":"v1","addr":"172.21.15.96:6823","nonce":12462}]},"public_addr":"172.21.15.96:6819/12462","cluster_addr":"172.21.15.96:6821/12462","heartbeat_back_addr":"172.21.15.96:6825/12462","heartbeat_front_addr":"172.21.15.96:6823/12462","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.875762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.900817+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.210347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.133973+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.864697+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.131015+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.237225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.154377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-05T03:50:03.569 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.567+0000 7f351b043700 1 -- 172.21.15.158:0/361370994 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f34f403ac10 msgr2=0x7f34f403d120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:03.569 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.567+0000 7f351b043700 1 --2- 172.21.15.158:0/361370994 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f34f403ac10 0x7f34f403d120 crc :-1 s=READY pgs=53 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:03.569 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.567+0000 7f351b043700 1 -- 172.21.15.158:0/361370994 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f351412c990 msgr2=0x7f351412cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:03.569 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.567+0000 7f351b043700 1 --2- 172.21.15.158:0/361370994 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f351412c990 0x7f351412cdc0 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f351412de80 tx=0x7f350c010f30).stop 2019-12-05T03:50:03.570 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.567+0000 7f351b043700 1 -- 172.21.15.158:0/361370994 shutdown_connections 2019-12-05T03:50:03.570 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.567+0000 7f351b043700 1 --2- 172.21.15.158:0/361370994 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f34f403ac10 0x7f34f403d120 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:03.570 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.567+0000 7f351b043700 1 --2- 172.21.15.158:0/361370994 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f351412c990 0x7f351412cdc0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:03.570 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.567+0000 7f351b043700 1 --2- 172.21.15.158:0/361370994 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3514151190 0x7f351407cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:03.570 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.567+0000 7f351b043700 1 -- 172.21.15.158:0/361370994 shutdown_connections 2019-12-05T03:50:03.570 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.567+0000 7f351b043700 1 -- 172.21.15.158:0/361370994 wait complete. 2019-12-05T03:50:03.570 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.567+0000 7f351b043700 1 -- 172.21.15.158:0/361370994 >> 172.21.15.158:0/361370994 conn(0x7f351407dee0 msgr2=0x7f351412eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:03.579 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2019-12-05T03:50:03.579 INFO:tasks.ceph.mds.a:Restarting daemon 2019-12-05T03:50:03.580 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2019-12-05T03:50:03.583 INFO:tasks.ceph.mds.a:Started 2019-12-05T03:50:03.583 INFO:tasks.ceph.mds.b:Restarting daemon 2019-12-05T03:50:03.583 INFO:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2019-12-05T03:50:03.587 INFO:tasks.ceph.mds.b:Started 2019-12-05T03:50:03.587 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-05T03:50:03.587 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2019-12-05T03:50:03.634 INFO:tasks.ceph.mds.a.smithi158.stdout:starting mds.a at 2019-12-05T03:50:03.646 INFO:tasks.ceph.mds.b.smithi096.stdout:starting mds.b at 2019-12-05T03:50:03.677 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.671+0000 7fbb2fc92700 1 Processor -- start 2019-12-05T03:50:03.677 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.671+0000 7fbb2fc92700 1 -- start start 2019-12-05T03:50:03.677 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.671+0000 7fbb2fc92700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fbb2809a320 0x7fbb2805a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:03.677 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.671+0000 7fbb2fc92700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbb281553b0 0x7fbb281557e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:03.678 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.671+0000 7fbb2fc92700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb280accb0 con 0x7fbb2809cf60 2019-12-05T03:50:03.678 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.671+0000 7fbb2fc92700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb2809a750 con 0x7fbb281553b0 2019-12-05T03:50:03.678 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.671+0000 7fbb2fc92700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb280b1730 con 0x7fbb2809a320 2019-12-05T03:50:03.678 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.671+0000 7fbb2e22f700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fbb2809cf60 0x7fbb28151460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48218/0 (socket says 172.21.15.158:48218) 2019-12-05T03:50:03.678 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.671+0000 7fbb2e22f700 1 -- 172.21.15.158:0/3521844845 learned_addr learned my addr 172.21.15.158:0/3521844845 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:03.678 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.671+0000 7fbb2da2e700 1 --2- 172.21.15.158:0/3521844845 >> v2:172.21.15.158:3300/0 conn(0x7fbb2809a320 0x7fbb2805a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:03.678 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.671+0000 7fbb2ea30700 1 --2- 172.21.15.158:0/3521844845 >> v2:172.21.15.96:3300/0 conn(0x7fbb281553b0 0x7fbb281557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:03.679 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.671+0000 7fbb2d22d700 1 -- 172.21.15.158:0/3521844845 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3783648442 0 0) 0x7fbb280accb0 con 0x7fbb2809cf60 2019-12-05T03:50:03.679 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.671+0000 7fbb2d22d700 1 -- 172.21.15.158:0/3521844845 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb100030b0 con 0x7fbb2809cf60 2019-12-05T03:50:03.679 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.671+0000 7fbb2da2e700 1 -- 172.21.15.158:0/3521844845 >> v2:172.21.15.96:3300/0 conn(0x7fbb281553b0 msgr2=0x7fbb281557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:03.679 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.671+0000 7fbb2da2e700 1 --2- 172.21.15.158:0/3521844845 >> v2:172.21.15.96:3300/0 conn(0x7fbb281553b0 0x7fbb281557e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:03.679 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.671+0000 7fbb2da2e700 1 -- 172.21.15.158:0/3521844845 >> v1:172.21.15.158:6789/0 conn(0x7fbb2809cf60 legacy=0x7fbb28151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:03.679 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.671+0000 7fbb2da2e700 1 -- 172.21.15.158:0/3521844845 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb280b6980 con 0x7fbb2809a320 2019-12-05T03:50:03.680 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.671+0000 7fbb2da2e700 1 --2- 172.21.15.158:0/3521844845 >> v2:172.21.15.158:3300/0 conn(0x7fbb2809a320 0x7fbb2805a740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbb1c008790 tx=0x7fbb1c00fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.680 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.671+0000 7fbb2da2e700 1 --2- 172.21.15.158:0/3521844845 >> v2:172.21.15.158:3300/0 conn(0x7fbb2809a320 0x7fbb2805a740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbb1c008790 tx=0x7fbb1c00fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.680 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.671+0000 7fbb2da2e700 1 --2- 172.21.15.158:0/3521844845 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbb2809a320 0x7fbb2805a740 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7fbb1c008790 tx=0x7fbb1c00fc70).ready entity=mon.1 client_cookie=ffbe9491f32180ab server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:03.680 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.675+0000 7fbb2da2e700 1 --2- 172.21.15.158:0/3521844845 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbb2809a320 0x7fbb2805a740 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7fbb1c008790 tx=0x7fbb1c00fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.680 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.675+0000 7fbb2d22d700 1 -- 172.21.15.158:0/3521844845 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb1c008bb0 con 0x7fbb2809a320 2019-12-05T03:50:03.681 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.675+0000 7fbb2da2e700 1 --2- 172.21.15.158:0/3521844845 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbb2809a320 0x7fbb2805a740 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7fbb1c008790 tx=0x7fbb1c00fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.681 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.675+0000 7fbb2d22d700 1 -- 172.21.15.158:0/3521844845 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1c0087d0 con 0x7fbb2809a320 2019-12-05T03:50:03.681 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.675+0000 7fbb2da2e700 1 --2- 172.21.15.158:0/3521844845 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbb2809a320 0x7fbb2805a740 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7fbb1c008790 tx=0x7fbb1c00fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.681 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.675+0000 7fbb2d22d700 1 -- 172.21.15.158:0/3521844845 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb1c011820 con 0x7fbb2809a320 2019-12-05T03:50:03.681 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.675+0000 7fbb2fc92700 1 -- 172.21.15.158:0/3521844845 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbb2809a320 msgr2=0x7fbb2805a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:03.681 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.675+0000 7fbb2fc92700 1 --2- 172.21.15.158:0/3521844845 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbb2809a320 0x7fbb2805a740 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7fbb1c008790 tx=0x7fbb1c00fc70).stop 2019-12-05T03:50:03.681 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.675+0000 7fbb2fc92700 1 -- 172.21.15.158:0/3521844845 shutdown_connections 2019-12-05T03:50:03.682 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.675+0000 7fbb2fc92700 1 --2- 172.21.15.158:0/3521844845 >> v2:172.21.15.96:3300/0 conn(0x7fbb281553b0 0x7fbb281557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:03.682 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.675+0000 7fbb2fc92700 1 --2- 172.21.15.158:0/3521844845 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbb2809a320 0x7fbb2805a740 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:03.682 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.675+0000 7fbb2fc92700 1 -- 172.21.15.158:0/3521844845 shutdown_connections 2019-12-05T03:50:03.682 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.675+0000 7fbb2fc92700 1 -- 172.21.15.158:0/3521844845 wait complete. 2019-12-05T03:50:03.682 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.675+0000 7fbb2fc92700 1 -- 172.21.15.158:0/3521844845 >> 172.21.15.158:0/3521844845 conn(0x7fbb280b7e60 msgr2=0x7fbb280b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:03.686 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.675+0000 7fbb2fc92700 1 Processor -- start 2019-12-05T03:50:03.686 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.675+0000 7fbb2fc92700 1 -- start start 2019-12-05T03:50:03.686 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.679+0000 7fbb2fc92700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbb2812dc10 0x7fbb280b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:03.686 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.679+0000 7fbb2fc92700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbb280adc00 0x7fbb2813f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:03.687 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.679+0000 7fbb2fc92700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb2813fa50 con 0x7fbb2807b170 2019-12-05T03:50:03.687 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.679+0000 7fbb2fc92700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb2812c420 con 0x7fbb280adc00 2019-12-05T03:50:03.687 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.679+0000 7fbb2fc92700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2812c6c0 con 0x7fbb2812dc10 2019-12-05T03:50:03.687 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.679+0000 7fbb2da2e700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbb2812dc10 0x7fbb280b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:03.687 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.679+0000 7fbb2da2e700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbb2812dc10 0x7fbb280b0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.158:36186/0 (socket says 172.21.15.158:36186) 2019-12-05T03:50:03.687 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.679+0000 7fbb2da2e700 1 -- 172.21.15.158:0/3779309210 learned_addr learned my addr 172.21.15.158:0/3779309210 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:03.688 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.679+0000 7fbb2ea30700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbb280adc00 0x7fbb2813f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:03.688 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.679+0000 7fbb2da2e700 1 -- 172.21.15.158:0/3779309210 >> v2:172.21.15.96:3300/0 conn(0x7fbb280adc00 msgr2=0x7fbb2813f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:03.688 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.679+0000 7fbb2da2e700 1 --2- 172.21.15.158:0/3779309210 >> v2:172.21.15.96:3300/0 conn(0x7fbb280adc00 0x7fbb2813f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:03.688 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.679+0000 7fbb2da2e700 1 -- 172.21.15.158:0/3779309210 >> v1:172.21.15.96:6789/0 conn(0x7fbb2807b170 legacy=0x7fbb2809a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:03.688 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.679+0000 7fbb2da2e700 1 -- 172.21.15.158:0/3779309210 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb280ae030 con 0x7fbb2812dc10 2019-12-05T03:50:03.688 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.679+0000 7fbb2ea30700 1 --2- 172.21.15.158:0/3779309210 >> v2:172.21.15.96:3300/0 conn(0x7fbb280adc00 0x7fbb2813f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:50:03.688 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.679+0000 7fbb2da2e700 1 --2- 172.21.15.158:0/3779309210 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbb2812dc10 0x7fbb280b0d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbb1c008790 tx=0x7fbb1c011960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.689 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.679+0000 7fbb2da2e700 1 --2- 172.21.15.158:0/3779309210 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbb2812dc10 0x7fbb280b0d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbb1c008790 tx=0x7fbb1c011960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.689 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.679+0000 7fbb2da2e700 1 --2- 172.21.15.158:0/3779309210 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbb2812dc10 0x7fbb280b0d40 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7fbb1c008790 tx=0x7fbb1c011960).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:03.689 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.679+0000 7fbb2da2e700 1 --2- 172.21.15.158:0/3779309210 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbb2812dc10 0x7fbb280b0d40 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fbb1c008790 tx=0x7fbb1c011960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.689 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.679+0000 7fbb26ffd700 1 -- 172.21.15.158:0/3779309210 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb1c00f280 con 0x7fbb2812dc10 2019-12-05T03:50:03.689 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.679+0000 7fbb2da2e700 1 --2- 172.21.15.158:0/3779309210 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbb2812dc10 0x7fbb280b0d40 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fbb1c008790 tx=0x7fbb1c011960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.689 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.679+0000 7fbb2da2e700 1 --2- 172.21.15.158:0/3779309210 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbb2812dc10 0x7fbb280b0d40 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fbb1c008790 tx=0x7fbb1c011960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.690 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.679+0000 7fbb26ffd700 1 -- 172.21.15.158:0/3779309210 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1c008db0 con 0x7fbb2812dc10 2019-12-05T03:50:03.690 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.679+0000 7fbb26ffd700 1 -- 172.21.15.158:0/3779309210 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb1c005540 con 0x7fbb2812dc10 2019-12-05T03:50:03.690 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.679+0000 7fbb2fc92700 1 -- 172.21.15.158:0/3779309210 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb2813fc80 con 0x7fbb2812dc10 2019-12-05T03:50:03.690 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.679+0000 7fbb2fc92700 1 -- 172.21.15.158:0/3779309210 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb281401d0 con 0x7fbb2812dc10 2019-12-05T03:50:03.690 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.683+0000 7fbb2da2e700 1 --2- 172.21.15.158:0/3779309210 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbb2812dc10 0x7fbb280b0d40 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fbb1c008790 tx=0x7fbb1c011960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.690 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.683+0000 7fbb26ffd700 1 -- 172.21.15.158:0/3779309210 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fbb1c0130b0 con 0x7fbb2812dc10 2019-12-05T03:50:03.690 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.683+0000 7fbb2da2e700 1 --2- 172.21.15.158:0/3779309210 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbb2812dc10 0x7fbb280b0d40 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fbb1c008790 tx=0x7fbb1c011960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.691 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.683+0000 7fbb26ffd700 1 --2- 172.21.15.158:0/3779309210 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fbb0803acf0 0x7fbb0803d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:03.691 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.683+0000 7fbb26ffd700 1 -- 172.21.15.158:0/3779309210 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fbb1c04b670 con 0x7fbb2812dc10 2019-12-05T03:50:03.691 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.683+0000 7fbb2e22f700 1 --2- 172.21.15.158:0/3779309210 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fbb0803acf0 0x7fbb0803d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:03.691 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.683+0000 7fbb2e22f700 1 --2- 172.21.15.158:0/3779309210 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fbb0803acf0 0x7fbb0803d200 crc :-1 s=READY pgs=54 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:03.691 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.687+0000 7fbb2fc92700 1 -- 172.21.15.158:0/3779309210 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb28155e70 con 0x7fbb2812dc10 2019-12-05T03:50:03.696 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.695+0000 7fbb2da2e700 1 --2- 172.21.15.158:0/3779309210 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbb2812dc10 0x7fbb280b0d40 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fbb1c008790 tx=0x7fbb1c011960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.697 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.695+0000 7fbb26ffd700 1 -- 172.21.15.158:0/3779309210 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fbb280ae030 con 0x7fbb2812dc10 2019-12-05T03:50:03.867 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.867+0000 7fbb2fc92700 1 -- 172.21.15.158:0/3779309210 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb280554e0 con 0x7fbb2812dc10 2019-12-05T03:50:03.869 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.867+0000 7fbb2da2e700 1 --2- 172.21.15.158:0/3779309210 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbb2812dc10 0x7fbb280b0d40 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7fbb1c008790 tx=0x7fbb1c011960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:03.869 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.867+0000 7fbb26ffd700 1 -- 172.21.15.158:0/3779309210 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+14933 (secure 0 0 0) 0x7fbb1c032950 con 0x7fbb2812dc10 2019-12-05T03:50:03.870 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:03.871 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":23,"fsid":"a91186ae-f496-4de1-918d-820c55ff1feb","created":"2019-12-05T03:49:39.187523+0000","modified":"2019-12-05T03:50:01.249305+0000","last_up_change":"2019-12-05T03:49:48.551934+0000","last_in_change":"2019-12-05T03:49:48.551934+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-05T03:49:52.900870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-12-05T03:49:55.801462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-12-05T03:49:58.659250+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"782c4258-e28c-4a11-9d54-3c9c7a36fba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":12192},{"type":"v1","addr":"172.21.15.158:6801","nonce":12192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":12192},{"type":"v1","addr":"172.21.15.158:6803","nonce":12192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":12192},{"type":"v1","addr":"172.21.15.158:6807","nonce":12192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":12192},{"type":"v1","addr":"172.21.15.158:6805","nonce":12192}]},"public_addr":"172.21.15.158:6801/12192","cluster_addr":"172.21.15.158:6803/12192","heartbeat_back_addr":"172.21.15.158:6807/12192","heartbeat_front_addr":"172.21.15.158:6805/12192","state":["exists","up"]},{"osd":1,"uuid":"d4426b21-b666-4158-bf34-a24b14572731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":12193},{"type":"v1","addr":"172.21.15.158:6809","nonce":12193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":12193},{"type":"v1","addr":"172.21.15.158:6811","nonce":12193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":12193},{"type":"v1","addr":"172.21.15.158:6815","nonce":12193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":12193},{"type":"v1","addr":"172.21.15.158:6813","nonce":12193}]},"public_addr":"172.21.15.158:6809/12193","cluster_addr":"172.21.15.158:6811/12193","heartbeat_back_addr":"172.21.15.158:6815/12193","heartbeat_front_addr":"172.21.15.158:6813/12193","state":["exists","up"]},{"osd":2,"uuid":"22680edd-6490-4ab0-bb15-0605830e4cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":12195},{"type":"v1","addr":"172.21.15.158:6825","nonce":12195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":12195},{"type":"v1","addr":"172.21.15.158:6827","nonce":12195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":12195},{"type":"v1","addr":"172.21.15.158:6831","nonce":12195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":12195},{"type":"v1","addr":"172.21.15.158:6829","nonce":12195}]},"public_addr":"172.21.15.158:6825/12195","cluster_addr":"172.21.15.158:6827/12195","heartbeat_back_addr":"172.21.15.158:6831/12195","heartbeat_front_addr":"172.21.15.158:6829/12195","state":["exists","up"]},{"osd":3,"uuid":"7ec999ee-ace8-4ccb-a4f9-6f5d313bbbd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":12194},{"type":"v1","addr":"172.21.15.158:6817","nonce":12194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":12194},{"type":"v1","addr":"172.21.15.158:6819","nonce":12194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":12194},{"type":"v1","addr":"172.21.15.158:6823","nonce":12194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":12194},{"type":"v1","addr":"172.21.15.158:6821","nonce":12194}]},"public_addr":"172.21.15.158:6817/12194","cluster_addr":"172.21.15.158:6819/12194","heartbeat_back_addr":"172.21.15.158:6823/12194","heartbeat_front_addr":"172.21.15.158:6821/12194","state":["exists","up"]},{"osd":4,"uuid":"186e69c4-b69f-4dd1-bb8f-faf759c60484","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":12460},{"type":"v1","addr":"172.21.15.96:6803","nonce":12460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":12460},{"type":"v1","addr":"172.21.15.96:6805","nonce":12460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":12460},{"type":"v1","addr":"172.21.15.96:6809","nonce":12460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":12460},{"type":"v1","addr":"172.21.15.96:6807","nonce":12460}]},"public_addr":"172.21.15.96:6803/12460","cluster_addr":"172.21.15.96:6805/12460","heartbeat_back_addr":"172.21.15.96:6809/12460","heartbeat_front_addr":"172.21.15.96:6807/12460","state":["exists","up"]},{"osd":5,"uuid":"86b658b2-8b40-4cea-8163-305a3982758b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":12461},{"type":"v1","addr":"172.21.15.96:6811","nonce":12461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":12461},{"type":"v1","addr":"172.21.15.96:6813","nonce":12461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":12461},{"type":"v1","addr":"172.21.15.96:6817","nonce":12461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":12461},{"type":"v1","addr":"172.21.15.96:6815","nonce":12461}]},"public_addr":"172.21.15.96:6811/12461","cluster_addr":"172.21.15.96:6813/12461","heartbeat_back_addr":"172.21.15.96:6817/12461","heartbeat_front_addr":"172.21.15.96:6815/12461","state":["exists","up"]},{"osd":6,"uuid":"bdadaea8-9296-4788-bc59-d9c9eb8defdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":12463},{"type":"v1","addr":"172.21.15.96:6827","nonce":12463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":12463},{"type":"v1","addr":"172.21.15.96:6829","nonce":12463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":12463},{"type":"v1","addr":"172.21.15.96:6833","nonce":12463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":12463},{"type":"v1","addr":"172.21.15.96:6831","nonce":12463}]},"public_addr":"172.21.15.96:6827/12463","cluster_addr":"172.21.15.96:6829/12463","heartbeat_back_addr":"172.21.15.96:6833/12463","heartbeat_front_addr":"172.21.15.96:6831/12463","state":["exists","up"]},{"osd":7,"uuid":"c6d71846-d68e-430f-ab72-0fb8ea4bf640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":12462},{"type":"v1","addr":"172.21.15.96:6819","nonce":12462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":12462},{"type":"v1","addr":"172.21.15.96:6821","nonce":12462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":12462},{"type":"v1","addr":"172.21.15.96:6825","nonce":12462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":12462},{"type":"v1","addr":"172.21.15.96:6823","nonce":12462}]},"public_addr":"172.21.15.96:6819/12462","cluster_addr":"172.21.15.96:6821/12462","heartbeat_back_addr":"172.21.15.96:6825/12462","heartbeat_front_addr":"172.21.15.96:6823/12462","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.875762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.900817+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.210347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.133973+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.864697+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.131015+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.237225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.154377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-05T03:50:03.873 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.871+0000 7fbb2fc92700 1 -- 172.21.15.158:0/3779309210 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fbb0803acf0 msgr2=0x7fbb0803d200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:03.873 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.871+0000 7fbb2fc92700 1 --2- 172.21.15.158:0/3779309210 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fbb0803acf0 0x7fbb0803d200 crc :-1 s=READY pgs=54 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:03.873 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.871+0000 7fbb2fc92700 1 -- 172.21.15.158:0/3779309210 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbb2812dc10 msgr2=0x7fbb280b0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:03.873 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.871+0000 7fbb2fc92700 1 --2- 172.21.15.158:0/3779309210 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbb2812dc10 0x7fbb280b0d40 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7fbb1c008790 tx=0x7fbb1c011960).stop 2019-12-05T03:50:03.873 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.871+0000 7fbb2fc92700 1 -- 172.21.15.158:0/3779309210 shutdown_connections 2019-12-05T03:50:03.874 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.871+0000 7fbb2fc92700 1 --2- 172.21.15.158:0/3779309210 >> v2:172.21.15.96:3300/0 conn(0x7fbb280adc00 0x7fbb2813f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:03.874 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.871+0000 7fbb2fc92700 1 --2- 172.21.15.158:0/3779309210 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fbb0803acf0 0x7fbb0803d200 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:03.874 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.871+0000 7fbb2fc92700 1 --2- 172.21.15.158:0/3779309210 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbb2812dc10 0x7fbb280b0d40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:03.874 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.871+0000 7fbb2fc92700 1 -- 172.21.15.158:0/3779309210 shutdown_connections 2019-12-05T03:50:03.874 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.871+0000 7fbb2fc92700 1 -- 172.21.15.158:0/3779309210 wait complete. 2019-12-05T03:50:03.874 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:03.871+0000 7fbb2fc92700 1 -- 172.21.15.158:0/3779309210 >> 172.21.15.158:0/3779309210 conn(0x7fbb2807de80 msgr2=0x7fbb280593f0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:03.883 INFO:tasks.ceph.ceph_manager.ceph:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:49:52.900870+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:49:55.801462+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:49:58.659250+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-12-05T03:50:03.884 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-12-05T03:50:04.048 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.039+0000 7f4ada59a700 1 Processor -- start 2019-12-05T03:50:04.048 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.039+0000 7f4ada59a700 1 -- start start 2019-12-05T03:50:04.048 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.039+0000 7f4ada59a700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ad40b6970 0x7f4ad409add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:04.048 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.039+0000 7f4ada59a700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4ad40b5370 0x7f4ad40b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:04.048 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.039+0000 7f4ada59a700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad4099e30 con 0x7f4ad409ba40 2019-12-05T03:50:04.048 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.039+0000 7f4ada59a700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ad409d210 con 0x7f4ad40b6970 2019-12-05T03:50:04.049 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.039+0000 7f4ada59a700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad4099b90 con 0x7f4ad40b5370 2019-12-05T03:50:04.049 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.039+0000 7f4ad8b37700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4ad40b6970 0x7f4ad409add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:04.049 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.043+0000 7f4ad3fff700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f4ad409ba40 0x7f4ad405a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48232/0 (socket says 172.21.15.158:48232) 2019-12-05T03:50:04.049 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.043+0000 7f4ad3fff700 1 -- 172.21.15.158:0/3011236209 learned_addr learned my addr 172.21.15.158:0/3011236209 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:04.049 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.043+0000 7f4ad9338700 1 --2- 172.21.15.158:0/3011236209 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4ad40b5370 0x7f4ad40b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:04.049 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.043+0000 7f4ad8b37700 1 -- 172.21.15.158:0/3011236209 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4ad40b5370 msgr2=0x7f4ad40b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:04.049 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.043+0000 7f4ad8b37700 1 --2- 172.21.15.158:0/3011236209 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4ad40b5370 0x7f4ad40b57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:04.050 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.043+0000 7f4ad8b37700 1 -- 172.21.15.158:0/3011236209 >> v1:172.21.15.158:6789/0 conn(0x7f4ad409ba40 legacy=0x7f4ad405a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:04.050 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.043+0000 7f4ad37fe700 1 -- 172.21.15.158:0/3011236209 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3083352404 0 0) 0x7f4ad4099e30 con 0x7f4ad409ba40 2019-12-05T03:50:04.050 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.043+0000 7f4ad8b37700 1 -- 172.21.15.158:0/3011236209 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad407e960 con 0x7f4ad40b6970 2019-12-05T03:50:04.050 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.043+0000 7f4ad9338700 1 --2- 172.21.15.158:0/3011236209 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4ad40b5370 0x7f4ad40b57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-12-05T03:50:04.050 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.043+0000 7f4ad8b37700 1 --2- 172.21.15.158:0/3011236209 >> v2:172.21.15.158:3300/0 conn(0x7f4ad40b6970 0x7f4ad409add0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4ac40032b0 tx=0x7f4ac400fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.050 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.043+0000 7f4ad8b37700 1 --2- 172.21.15.158:0/3011236209 >> v2:172.21.15.158:3300/0 conn(0x7f4ad40b6970 0x7f4ad409add0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4ac40032b0 tx=0x7f4ac400fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.050 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.043+0000 7f4ad8b37700 1 --2- 172.21.15.158:0/3011236209 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4ad40b6970 0x7f4ad409add0 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7f4ac40032b0 tx=0x7f4ac400fff0).ready entity=mon.1 client_cookie=b081c86e6f173daf server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:04.051 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.043+0000 7f4ad8b37700 1 --2- 172.21.15.158:0/3011236209 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4ad40b6970 0x7f4ad409add0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f4ac40032b0 tx=0x7f4ac400fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.051 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.043+0000 7f4ad37fe700 1 -- 172.21.15.158:0/3011236209 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ac40108c0 con 0x7f4ad40b6970 2019-12-05T03:50:04.051 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.043+0000 7f4ad8b37700 1 --2- 172.21.15.158:0/3011236209 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4ad40b6970 0x7f4ad409add0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f4ac40032b0 tx=0x7f4ac400fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.051 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.043+0000 7f4ad37fe700 1 -- 172.21.15.158:0/3011236209 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac4008b50 con 0x7f4ad40b6970 2019-12-05T03:50:04.052 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.043+0000 7f4ad8b37700 1 --2- 172.21.15.158:0/3011236209 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4ad40b6970 0x7f4ad409add0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f4ac40032b0 tx=0x7f4ac400fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.052 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.043+0000 7f4ada59a700 1 -- 172.21.15.158:0/3011236209 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4ad40b6970 msgr2=0x7f4ad409add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:04.052 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.043+0000 7f4ad37fe700 1 -- 172.21.15.158:0/3011236209 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ac40110c0 con 0x7f4ad40b6970 2019-12-05T03:50:04.052 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.043+0000 7f4ada59a700 1 --2- 172.21.15.158:0/3011236209 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4ad40b6970 0x7f4ad409add0 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7f4ac40032b0 tx=0x7f4ac400fff0).stop 2019-12-05T03:50:04.052 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.043+0000 7f4ada59a700 1 -- 172.21.15.158:0/3011236209 shutdown_connections 2019-12-05T03:50:04.052 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.043+0000 7f4ada59a700 1 --2- 172.21.15.158:0/3011236209 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4ad40b6970 0x7f4ad409add0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:04.052 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.043+0000 7f4ada59a700 1 --2- 172.21.15.158:0/3011236209 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4ad40b5370 0x7f4ad40b57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:04.053 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.043+0000 7f4ada59a700 1 -- 172.21.15.158:0/3011236209 shutdown_connections 2019-12-05T03:50:04.053 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.043+0000 7f4ada59a700 1 -- 172.21.15.158:0/3011236209 wait complete. 2019-12-05T03:50:04.053 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.043+0000 7f4ada59a700 1 -- 172.21.15.158:0/3011236209 >> 172.21.15.158:0/3011236209 conn(0x7f4ad40b7ef0 msgr2=0x7f4ad40b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:04.056 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.047+0000 7f4ada59a700 1 Processor -- start 2019-12-05T03:50:04.057 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.047+0000 7f4ada59a700 1 -- start start 2019-12-05T03:50:04.057 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.047+0000 7f4ada59a700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4ad40acc20 0x7f4ad40b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:04.057 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.047+0000 7f4ada59a700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad413a570 con 0x7f4ad407b340 2019-12-05T03:50:04.057 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.047+0000 7f4ada59a700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad41522f0 con 0x7f4ad413d600 2019-12-05T03:50:04.057 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.047+0000 7f4ada59a700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad4154940 con 0x7f4ad40acc20 2019-12-05T03:50:04.057 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.047+0000 7f4ad8b37700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f4ad413d600 0x7f4ad4139d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48238/0 (socket says 172.21.15.158:48238) 2019-12-05T03:50:04.058 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.047+0000 7f4ad8b37700 1 -- 172.21.15.158:0/3521829059 learned_addr learned my addr 172.21.15.158:0/3521829059 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:04.058 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.051+0000 7f4ad3fff700 1 --2- 172.21.15.158:0/3521829059 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4ad40acc20 0x7f4ad40b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:04.058 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.051+0000 7f4ad17fa700 1 -- 172.21.15.158:0/3521829059 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 190066149 0 0) 0x7f4ad41522f0 con 0x7f4ad413d600 2019-12-05T03:50:04.059 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.051+0000 7f4ad17fa700 1 -- 172.21.15.158:0/3521829059 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ab80030b0 con 0x7f4ad413d600 2019-12-05T03:50:04.060 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.051+0000 7f4ad17fa700 1 -- 172.21.15.158:0/3521829059 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1838135948 0 0) 0x7f4ad413a570 con 0x7f4ad407b340 2019-12-05T03:50:04.060 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.051+0000 7f4ad17fa700 1 -- 172.21.15.158:0/3521829059 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ad41522f0 con 0x7f4ad407b340 2019-12-05T03:50:04.060 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.051+0000 7f4ad3fff700 1 -- 172.21.15.158:0/3521829059 >> v1:172.21.15.158:6789/0 conn(0x7f4ad413d600 legacy=0x7f4ad4139d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:04.060 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.051+0000 7f4ad17fa700 1 -- 172.21.15.158:0/3521829059 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2591558816 0 0) 0x7f4ab80030b0 con 0x7f4ad413d600 2019-12-05T03:50:04.061 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.051+0000 7f4ad3fff700 1 -- 172.21.15.158:0/3521829059 >> v1:172.21.15.96:6789/0 conn(0x7f4ad407b340 legacy=0x7f4ad4151af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:04.061 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.051+0000 7f4ad3fff700 1 -- 172.21.15.158:0/3521829059 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad4152520 con 0x7f4ad40acc20 2019-12-05T03:50:04.061 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.051+0000 7f4ad3fff700 1 --2- 172.21.15.158:0/3521829059 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4ad40acc20 0x7f4ad40b29c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4ac4010580 tx=0x7f4ac4008650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.062 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.051+0000 7f4ad3fff700 1 --2- 172.21.15.158:0/3521829059 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4ad40acc20 0x7f4ad40b29c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4ac4010580 tx=0x7f4ac4008650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.062 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.051+0000 7f4ad3fff700 1 --2- 172.21.15.158:0/3521829059 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4ad40acc20 0x7f4ad40b29c0 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7f4ac4010580 tx=0x7f4ac4008650).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:04.062 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.051+0000 7f4ad3fff700 1 --2- 172.21.15.158:0/3521829059 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4ad40acc20 0x7f4ad40b29c0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f4ac4010580 tx=0x7f4ac4008650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.062 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.051+0000 7f4ad17fa700 1 -- 172.21.15.158:0/3521829059 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ac40108c0 con 0x7f4ad40acc20 2019-12-05T03:50:04.062 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.051+0000 7f4ad3fff700 1 --2- 172.21.15.158:0/3521829059 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4ad40acc20 0x7f4ad40b29c0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f4ac4010580 tx=0x7f4ac4008650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.062 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.051+0000 7f4ad3fff700 1 --2- 172.21.15.158:0/3521829059 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4ad40acc20 0x7f4ad40b29c0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f4ac4010580 tx=0x7f4ac4008650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.062 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.051+0000 7f4ad17fa700 1 -- 172.21.15.158:0/3521829059 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac4010ac0 con 0x7f4ad40acc20 2019-12-05T03:50:04.063 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.051+0000 7f4ada59a700 1 -- 172.21.15.158:0/3521829059 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad407b770 con 0x7f4ad40acc20 2019-12-05T03:50:04.063 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.051+0000 7f4ad17fa700 1 -- 172.21.15.158:0/3521829059 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4abc013900 con 0x7f4ad40acc20 2019-12-05T03:50:04.063 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.051+0000 7f4ada59a700 1 -- 172.21.15.158:0/3521829059 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad40593f0 con 0x7f4ad40acc20 2019-12-05T03:50:04.063 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.051+0000 7f4ad3fff700 1 --2- 172.21.15.158:0/3521829059 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4ad40acc20 0x7f4ad40b29c0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f4ac4010580 tx=0x7f4ac4008650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.063 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.051+0000 7f4ad17fa700 1 -- 172.21.15.158:0/3521829059 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f4abc013c10 con 0x7f4ad40acc20 2019-12-05T03:50:04.063 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.051+0000 7f4ad3fff700 1 --2- 172.21.15.158:0/3521829059 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4ad40acc20 0x7f4ad40b29c0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f4ac4010580 tx=0x7f4ac4008650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.063 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.055+0000 7f4ad17fa700 1 --2- 172.21.15.158:0/3521829059 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f4ab803b470 0x7f4ab803d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:04.064 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.055+0000 7f4ad17fa700 1 -- 172.21.15.158:0/3521829059 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f4abc04cc40 con 0x7f4ad40acc20 2019-12-05T03:50:04.064 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.055+0000 7f4ad8b37700 1 --2- 172.21.15.158:0/3521829059 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f4ab803b470 0x7f4ab803d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:04.064 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.055+0000 7f4ad8b37700 1 --2- 172.21.15.158:0/3521829059 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f4ab803b470 0x7f4ab803d980 crc :-1 s=READY pgs=55 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:04.064 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.055+0000 7f4ada59a700 1 -- 172.21.15.158:0/3521829059 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad40554e0 con 0x7f4ad40acc20 2019-12-05T03:50:04.066 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.063+0000 7f4ad3fff700 1 --2- 172.21.15.158:0/3521829059 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4ad40acc20 0x7f4ad40b29c0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f4ac4010580 tx=0x7f4ac4008650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.066 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.063+0000 7f4ad17fa700 1 -- 172.21.15.158:0/3521829059 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f4abc033cc0 con 0x7f4ad40acc20 2019-12-05T03:50:04.228 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.227+0000 7f4ada59a700 1 -- 172.21.15.158:0/3521829059 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f4ad4066940 con 0x7f4ad40acc20 2019-12-05T03:50:04.229 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.227+0000 7f4ad3fff700 1 --2- 172.21.15.158:0/3521829059 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4ad40acc20 0x7f4ad40b29c0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7f4ac4010580 tx=0x7f4ac4008650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.229 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.227+0000 7f4ad17fa700 1 -- 172.21.15.158:0/3521829059 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4abc033f20 con 0x7f4ad40acc20 2019-12-05T03:50:04.231 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:50:04.234 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.231+0000 7f4ada59a700 1 -- 172.21.15.158:0/3521829059 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f4ab803b470 msgr2=0x7f4ab803d980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:04.234 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.231+0000 7f4ada59a700 1 --2- 172.21.15.158:0/3521829059 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f4ab803b470 0x7f4ab803d980 crc :-1 s=READY pgs=55 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:04.234 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.231+0000 7f4ada59a700 1 -- 172.21.15.158:0/3521829059 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4ad40acc20 msgr2=0x7f4ad40b29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:04.234 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.231+0000 7f4ada59a700 1 --2- 172.21.15.158:0/3521829059 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4ad40acc20 0x7f4ad40b29c0 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7f4ac4010580 tx=0x7f4ac4008650).stop 2019-12-05T03:50:04.234 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.231+0000 7f4ada59a700 1 -- 172.21.15.158:0/3521829059 shutdown_connections 2019-12-05T03:50:04.234 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.231+0000 7f4ada59a700 1 --2- 172.21.15.158:0/3521829059 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f4ab803b470 0x7f4ab803d980 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:04.235 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.231+0000 7f4ada59a700 1 --2- 172.21.15.158:0/3521829059 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4ad40acc20 0x7f4ad40b29c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:04.235 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.231+0000 7f4ada59a700 1 -- 172.21.15.158:0/3521829059 shutdown_connections 2019-12-05T03:50:04.235 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.231+0000 7f4ada59a700 1 -- 172.21.15.158:0/3521829059 wait complete. 2019-12-05T03:50:04.235 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.231+0000 7f4ada59a700 1 -- 172.21.15.158:0/3521829059 >> 172.21.15.158:0/3521829059 conn(0x7f4ad40b1e80 msgr2=0x7f4ad40b5370 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:04.244 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-12-05T03:50:04.342 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.335+0000 7f2ed7b33700 1 Processor -- start 2019-12-05T03:50:04.342 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.335+0000 7f2ed7b33700 1 -- start start 2019-12-05T03:50:04.343 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.335+0000 7f2ed7b33700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f2ed009ba40 0x7f2ed009add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:04.343 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.335+0000 7f2ed7b33700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed0099e30 con 0x7f2ed00b6970 2019-12-05T03:50:04.343 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.335+0000 7f2ed7b33700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed007e960 con 0x7f2ed00b5370 2019-12-05T03:50:04.343 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.335+0000 7f2ed7b33700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed009d210 con 0x7f2ed009ba40 2019-12-05T03:50:04.343 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.339+0000 7f2ed58cf700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f2ed009ba40 0x7f2ed009add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:04.343 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.339+0000 7f2ed58cf700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f2ed009ba40 0x7f2ed009add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53468/0 (socket says 172.21.15.158:53468) 2019-12-05T03:50:04.344 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.339+0000 7f2ed60d0700 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f2ed00b6970 0x7f2ed005a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.158:43380/0 (socket says 172.21.15.158:43380) 2019-12-05T03:50:04.344 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.339+0000 7f2ed58cf700 1 -- 172.21.15.158:0/1663119743 learned_addr learned my addr 172.21.15.158:0/1663119743 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:04.344 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.339+0000 7f2ed50ce700 1 -- 172.21.15.158:0/1663119743 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2531961922 0 0) 0x7f2ed0099e30 con 0x7f2ed00b6970 2019-12-05T03:50:04.344 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.339+0000 7f2ed50ce700 1 -- 172.21.15.158:0/1663119743 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ebc0030b0 con 0x7f2ed00b6970 2019-12-05T03:50:04.344 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.339+0000 7f2ed58cf700 1 -- 172.21.15.158:0/1663119743 >> v1:172.21.15.158:6789/0 conn(0x7f2ed00b5370 legacy=0x7f2ed00b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:04.344 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.339+0000 7f2ed58cf700 1 -- 172.21.15.158:0/1663119743 >> v1:172.21.15.96:6789/0 conn(0x7f2ed00b6970 legacy=0x7f2ed005a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:04.344 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.339+0000 7f2ed58cf700 1 -- 172.21.15.158:0/1663119743 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed00b5fa0 con 0x7f2ed009ba40 2019-12-05T03:50:04.345 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.339+0000 7f2ed58cf700 1 --2- 172.21.15.158:0/1663119743 >> v2:172.21.15.158:3300/0 conn(0x7f2ed009ba40 0x7f2ed009add0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2ec0008790 tx=0x7f2ec000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.345 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.339+0000 7f2ed58cf700 1 --2- 172.21.15.158:0/1663119743 >> v2:172.21.15.158:3300/0 conn(0x7f2ed009ba40 0x7f2ed009add0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2ec0008790 tx=0x7f2ec000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.345 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.339+0000 7f2ed58cf700 1 --2- 172.21.15.158:0/1663119743 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2ed009ba40 0x7f2ed009add0 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f2ec0008790 tx=0x7f2ec000fcb0).ready entity=mon.1 client_cookie=e5849e55355f0122 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:04.345 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.339+0000 7f2ed58cf700 1 --2- 172.21.15.158:0/1663119743 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2ed009ba40 0x7f2ed009add0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f2ec0008790 tx=0x7f2ec000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.345 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.339+0000 7f2ed50ce700 1 -- 172.21.15.158:0/1663119743 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ec0008c90 con 0x7f2ed009ba40 2019-12-05T03:50:04.345 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.339+0000 7f2ed58cf700 1 --2- 172.21.15.158:0/1663119743 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2ed009ba40 0x7f2ed009add0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f2ec0008790 tx=0x7f2ec000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.346 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.339+0000 7f2ed50ce700 1 -- 172.21.15.158:0/1663119743 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec00088b0 con 0x7f2ed009ba40 2019-12-05T03:50:04.346 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.339+0000 7f2ed58cf700 1 --2- 172.21.15.158:0/1663119743 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2ed009ba40 0x7f2ed009add0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f2ec0008790 tx=0x7f2ec000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.346 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.339+0000 7f2ed7b33700 1 -- 172.21.15.158:0/1663119743 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2ed009ba40 msgr2=0x7f2ed009add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:04.346 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.339+0000 7f2ed50ce700 1 -- 172.21.15.158:0/1663119743 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ec0011b80 con 0x7f2ed009ba40 2019-12-05T03:50:04.346 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.339+0000 7f2ed7b33700 1 --2- 172.21.15.158:0/1663119743 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2ed009ba40 0x7f2ed009add0 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f2ec0008790 tx=0x7f2ec000fcb0).stop 2019-12-05T03:50:04.346 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.339+0000 7f2ed7b33700 1 -- 172.21.15.158:0/1663119743 shutdown_connections 2019-12-05T03:50:04.346 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.339+0000 7f2ed7b33700 1 --2- 172.21.15.158:0/1663119743 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2ed009ba40 0x7f2ed009add0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:04.347 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.339+0000 7f2ed7b33700 1 -- 172.21.15.158:0/1663119743 shutdown_connections 2019-12-05T03:50:04.347 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.339+0000 7f2ed7b33700 1 -- 172.21.15.158:0/1663119743 wait complete. 2019-12-05T03:50:04.347 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.339+0000 7f2ed7b33700 1 -- 172.21.15.158:0/1663119743 >> 172.21.15.158:0/1663119743 conn(0x7f2ed00b7ef0 msgr2=0x7f2ed00b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:04.351 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ed7b33700 1 Processor -- start 2019-12-05T03:50:04.352 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ed7b33700 1 -- start start 2019-12-05T03:50:04.352 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ed7b33700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2ed01545b0 0x7f2ed01552d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:04.352 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ed7b33700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2ed0065160 0x7f2ed00b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:04.353 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ed7b33700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed012cd60 con 0x7f2ed013ca70 2019-12-05T03:50:04.353 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ed7b33700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed012dd40 con 0x7f2ed0065160 2019-12-05T03:50:04.353 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ed7b33700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed012dfe0 con 0x7f2ed01545b0 2019-12-05T03:50:04.353 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ed58cf700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f2ed013ca70 0x7f2ed012c560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48254/0 (socket says 172.21.15.158:48254) 2019-12-05T03:50:04.353 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ed58cf700 1 -- 172.21.15.158:0/1604653931 learned_addr learned my addr 172.21.15.158:0/1604653931 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:04.353 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ed60d0700 1 --2- 172.21.15.158:0/1604653931 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2ed01545b0 0x7f2ed01552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:04.354 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ed68d1700 1 --2- 172.21.15.158:0/1604653931 >> v2:172.21.15.96:3300/0 conn(0x7f2ed0065160 0x7f2ed00b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:04.354 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ec6ffd700 1 -- 172.21.15.158:0/1604653931 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2161637333 0 0) 0x7f2ed012cd60 con 0x7f2ed013ca70 2019-12-05T03:50:04.354 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ec6ffd700 1 -- 172.21.15.158:0/1604653931 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2eb80030b0 con 0x7f2ed013ca70 2019-12-05T03:50:04.354 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ec6ffd700 1 -- 172.21.15.158:0/1604653931 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3007756908 0 0) 0x7f2eb80030b0 con 0x7f2ed013ca70 2019-12-05T03:50:04.354 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ec6ffd700 1 -- 172.21.15.158:0/1604653931 --> v1:172.21.15.158:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2ed012cd60 con 0x7f2ed013ca70 2019-12-05T03:50:04.354 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ec6ffd700 1 -- 172.21.15.158:0/1604653931 <== mon.1 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 828730332 0 0) 0x7f2ec0008470 con 0x7f2ed013ca70 2019-12-05T03:50:04.355 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ec6ffd700 1 -- 172.21.15.158:0/1604653931 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2ed01545b0 msgr2=0x7f2ed01552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:04.355 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ec6ffd700 1 --2- 172.21.15.158:0/1604653931 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2ed01545b0 0x7f2ed01552d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:04.355 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ec6ffd700 1 -- 172.21.15.158:0/1604653931 >> v2:172.21.15.96:3300/0 conn(0x7f2ed0065160 msgr2=0x7f2ed00b06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:04.355 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ec6ffd700 1 --2- 172.21.15.158:0/1604653931 >> v2:172.21.15.96:3300/0 conn(0x7f2ed0065160 0x7f2ed00b06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:04.355 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ec6ffd700 1 -- 172.21.15.158:0/1604653931 >> v1:172.21.15.158:6789/0 conn(0x7f2ed013ca70 legacy=0x7f2ed012c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:04.355 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ec6ffd700 1 --2- 172.21.15.158:0/1604653931 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2eb80038a0 0x7f2eb8003d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:04.355 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ec6ffd700 1 --2- 172.21.15.158:0/1604653931 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2eb8004420 0x7f2eb8004850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:04.356 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ec6ffd700 1 --2- 172.21.15.158:0/1604653931 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2eb8004e40 0x7f2eb800b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:04.356 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ec6ffd700 1 -- 172.21.15.158:0/1604653931 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed012dd40 con 0x7f2eb80038a0 2019-12-05T03:50:04.356 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ec6ffd700 1 -- 172.21.15.158:0/1604653931 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed012dfe0 con 0x7f2eb8004e40 2019-12-05T03:50:04.356 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ec6ffd700 1 -- 172.21.15.158:0/1604653931 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb800bbf0 con 0x7f2eb8004420 2019-12-05T03:50:04.356 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ed60d0700 1 --2- 172.21.15.158:0/1604653931 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2ed01545b0 0x7f2ed01552d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:50:04.356 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ed68d1700 1 --2- 172.21.15.158:0/1604653931 >> v2:172.21.15.96:3300/0 conn(0x7f2ed0065160 0x7f2ed00b06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:50:04.356 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ed68d1700 1 --2- 172.21.15.158:0/1604653931 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2eb8004e40 0x7f2eb800b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:04.357 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ed58cf700 1 --2- 172.21.15.158:0/1604653931 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2eb8004420 0x7f2eb8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:04.357 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ed60d0700 1 --2- 172.21.15.158:0/1604653931 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2eb80038a0 0x7f2eb8003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:04.357 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ed68d1700 1 -- 172.21.15.158:0/1604653931 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2eb8004420 msgr2=0x7f2eb8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:04.357 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ed68d1700 1 --2- 172.21.15.158:0/1604653931 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2eb8004420 0x7f2eb8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:04.357 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ed68d1700 1 -- 172.21.15.158:0/1604653931 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2eb80038a0 msgr2=0x7f2eb8003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:04.357 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ed68d1700 1 --2- 172.21.15.158:0/1604653931 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2eb80038a0 0x7f2eb8003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:04.357 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ed68d1700 1 -- 172.21.15.158:0/1604653931 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed012e280 con 0x7f2eb8004e40 2019-12-05T03:50:04.358 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ed7b33700 1 -- 172.21.15.158:0/1604653931 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed00b4980 con 0x7f2eb8004e40 2019-12-05T03:50:04.358 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ed7b33700 1 -- 172.21.15.158:0/1604653931 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed01547d0 con 0x7f2eb8004e40 2019-12-05T03:50:04.358 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ed68d1700 1 --2- 172.21.15.158:0/1604653931 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2eb8004e40 0x7f2eb800b670 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2ec8000b80 tx=0x7f2ec8010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.358 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ed68d1700 1 --2- 172.21.15.158:0/1604653931 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2eb8004e40 0x7f2eb800b670 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2ec8000b80 tx=0x7f2ec8010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.358 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ed68d1700 1 --2- 172.21.15.158:0/1604653931 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2eb8004e40 0x7f2eb800b670 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7f2ec8000b80 tx=0x7f2ec8010ea0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:04.358 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.343+0000 7f2ed68d1700 1 --2- 172.21.15.158:0/1604653931 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2eb8004e40 0x7f2eb800b670 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f2ec8000b80 tx=0x7f2ec8010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.359 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.347+0000 7f2ec6ffd700 1 -- 172.21.15.158:0/1604653931 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ec80114f0 con 0x7f2eb8004e40 2019-12-05T03:50:04.359 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.347+0000 7f2ed68d1700 1 --2- 172.21.15.158:0/1604653931 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2eb8004e40 0x7f2eb800b670 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f2ec8000b80 tx=0x7f2ec8010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.359 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.347+0000 7f2ec6ffd700 1 -- 172.21.15.158:0/1604653931 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec800e910 con 0x7f2eb8004e40 2019-12-05T03:50:04.359 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.347+0000 7f2ed68d1700 1 --2- 172.21.15.158:0/1604653931 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2eb8004e40 0x7f2eb800b670 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f2ec8000b80 tx=0x7f2ec8010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.359 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.347+0000 7f2ec6ffd700 1 -- 172.21.15.158:0/1604653931 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ec8011ad0 con 0x7f2eb8004e40 2019-12-05T03:50:04.359 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.347+0000 7f2ed68d1700 1 --2- 172.21.15.158:0/1604653931 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2eb8004e40 0x7f2eb800b670 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f2ec8000b80 tx=0x7f2ec8010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.359 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.347+0000 7f2ec6ffd700 1 -- 172.21.15.158:0/1604653931 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f2ec8011cd0 con 0x7f2eb8004e40 2019-12-05T03:50:04.360 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.347+0000 7f2ed68d1700 1 --2- 172.21.15.158:0/1604653931 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2eb8004e40 0x7f2eb800b670 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f2ec8000b80 tx=0x7f2ec8010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.360 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.347+0000 7f2ec6ffd700 1 --2- 172.21.15.158:0/1604653931 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f2eb8043a20 0x7f2eb8045f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:04.360 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.347+0000 7f2ec6ffd700 1 -- 172.21.15.158:0/1604653931 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f2ec804b070 con 0x7f2eb8004e40 2019-12-05T03:50:04.360 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.347+0000 7f2ed60d0700 1 --2- 172.21.15.158:0/1604653931 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f2eb8043a20 0x7f2eb8045f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:04.360 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.347+0000 7f2ed60d0700 1 --2- 172.21.15.158:0/1604653931 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f2eb8043a20 0x7f2eb8045f30 crc :-1 s=READY pgs=56 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:04.361 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.351+0000 7f2ed7b33700 1 -- 172.21.15.158:0/1604653931 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eac003200 con 0x7f2eb8004e40 2019-12-05T03:50:04.363 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.359+0000 7f2ed68d1700 1 --2- 172.21.15.158:0/1604653931 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2eb8004e40 0x7f2eb800b670 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f2ec8000b80 tx=0x7f2ec8010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.363 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.359+0000 7f2ec6ffd700 1 -- 172.21.15.158:0/1604653931 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f2ec80320d0 con 0x7f2eb8004e40 2019-12-05T03:50:04.524 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.523+0000 7f2ed7b33700 1 -- 172.21.15.158:0/1604653931 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f2eac003650 con 0x7f2eb8004e40 2019-12-05T03:50:04.524 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.523+0000 7f2ed68d1700 1 --2- 172.21.15.158:0/1604653931 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2eb8004e40 0x7f2eb800b670 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f2ec8000b80 tx=0x7f2ec8010ea0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.525 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.523+0000 7f2ec6ffd700 1 -- 172.21.15.158:0/1604653931 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7f2ec8032330 con 0x7f2eb8004e40 2019-12-05T03:50:04.525 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:50:04.527 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.523+0000 7f2ed7b33700 1 -- 172.21.15.158:0/1604653931 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f2eb8043a20 msgr2=0x7f2eb8045f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:04.527 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.523+0000 7f2ed7b33700 1 --2- 172.21.15.158:0/1604653931 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f2eb8043a20 0x7f2eb8045f30 crc :-1 s=READY pgs=56 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:04.527 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.523+0000 7f2ed7b33700 1 -- 172.21.15.158:0/1604653931 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2eb8004e40 msgr2=0x7f2eb800b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:04.527 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.523+0000 7f2ed68d1700 1 -- 172.21.15.158:0/1604653931 reap_dead start 2019-12-05T03:50:04.528 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.523+0000 7f2ed7b33700 1 --2- 172.21.15.158:0/1604653931 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2eb8004e40 0x7f2eb800b670 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7f2ec8000b80 tx=0x7f2ec8010ea0).stop 2019-12-05T03:50:04.528 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.523+0000 7f2ed7b33700 1 -- 172.21.15.158:0/1604653931 shutdown_connections 2019-12-05T03:50:04.528 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.523+0000 7f2ed7b33700 1 --2- 172.21.15.158:0/1604653931 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2eb8004e40 0x7f2eb800b670 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:04.528 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.527+0000 7f2ed7b33700 1 -- 172.21.15.158:0/1604653931 shutdown_connections 2019-12-05T03:50:04.528 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.527+0000 7f2ed7b33700 1 -- 172.21.15.158:0/1604653931 wait complete. 2019-12-05T03:50:04.528 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.527+0000 7f2ed7b33700 1 -- 172.21.15.158:0/1604653931 >> 172.21.15.158:0/1604653931 conn(0x7f2ed0099af0 msgr2=0x7f2ed009a320 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:04.537 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-12-05T03:50:04.638 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.631+0000 7f890e4b6700 1 Processor -- start 2019-12-05T03:50:04.639 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.631+0000 7f890e4b6700 1 -- start start 2019-12-05T03:50:04.639 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.631+0000 7f890e4b6700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f89080b6970 0x7f890809add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:04.639 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.631+0000 7f890e4b6700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f890809ba40 0x7f890805a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:04.639 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.631+0000 7f890e4b6700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8908099e30 con 0x7f890805a950 2019-12-05T03:50:04.639 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.631+0000 7f890e4b6700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f890809d210 con 0x7f89080b6970 2019-12-05T03:50:04.639 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.631+0000 7f890e4b6700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8908099b90 con 0x7f890809ba40 2019-12-05T03:50:04.640 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.635+0000 7f8907fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f890809ba40 0x7f890805a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:04.640 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.635+0000 7f8907fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f890809ba40 0x7f890805a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53490/0 (socket says 172.21.15.158:53490) 2019-12-05T03:50:04.640 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.635+0000 7f8907fff700 1 -- 172.21.15.158:0/4290778400 learned_addr learned my addr 172.21.15.158:0/4290778400 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:04.640 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.635+0000 7f890ca53700 1 --2- 172.21.15.158:0/4290778400 >> v2:172.21.15.96:3300/0 conn(0x7f89080b6970 0x7f890809add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:04.640 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.635+0000 7f8907fff700 1 -- 172.21.15.158:0/4290778400 >> v2:172.21.15.96:3300/0 conn(0x7f89080b6970 msgr2=0x7f890809add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:04.640 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.635+0000 7f8907fff700 1 --2- 172.21.15.158:0/4290778400 >> v2:172.21.15.96:3300/0 conn(0x7f89080b6970 0x7f890809add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:04.641 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.635+0000 7f8907fff700 1 -- 172.21.15.158:0/4290778400 >> v1:172.21.15.96:6789/0 conn(0x7f890805a950 legacy=0x7f8908155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:04.641 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.635+0000 7f8907fff700 1 -- 172.21.15.158:0/4290778400 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f890807e960 con 0x7f890809ba40 2019-12-05T03:50:04.641 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.635+0000 7f8907fff700 1 --2- 172.21.15.158:0/4290778400 >> v2:172.21.15.158:3300/0 conn(0x7f890809ba40 0x7f890805a400 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f88f4002f30 tx=0x7f88f400fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.641 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.635+0000 7f8907fff700 1 --2- 172.21.15.158:0/4290778400 >> v2:172.21.15.158:3300/0 conn(0x7f890809ba40 0x7f890805a400 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f88f4002f30 tx=0x7f88f400fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.641 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.635+0000 7f8907fff700 1 --2- 172.21.15.158:0/4290778400 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f890809ba40 0x7f890805a400 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f88f4002f30 tx=0x7f88f400fd30).ready entity=mon.1 client_cookie=4e63f3b2ce9a61c0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:04.641 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.635+0000 7f8907fff700 1 --2- 172.21.15.158:0/4290778400 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f890809ba40 0x7f890805a400 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f88f4002f30 tx=0x7f88f400fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.641 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.635+0000 7f89077fe700 1 -- 172.21.15.158:0/4290778400 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88f4008c90 con 0x7f890809ba40 2019-12-05T03:50:04.642 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.635+0000 7f8907fff700 1 --2- 172.21.15.158:0/4290778400 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f890809ba40 0x7f890805a400 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f88f4002f30 tx=0x7f88f400fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.642 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.635+0000 7f8907fff700 1 --2- 172.21.15.158:0/4290778400 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f890809ba40 0x7f890805a400 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f88f4002f30 tx=0x7f88f400fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.642 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.635+0000 7f89077fe700 1 -- 172.21.15.158:0/4290778400 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f40088b0 con 0x7f890809ba40 2019-12-05T03:50:04.642 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.635+0000 7f89077fe700 1 -- 172.21.15.158:0/4290778400 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88f4011ad0 con 0x7f890809ba40 2019-12-05T03:50:04.642 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.635+0000 7f890e4b6700 1 -- 172.21.15.158:0/4290778400 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f890809ba40 msgr2=0x7f890805a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:04.642 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.635+0000 7f890e4b6700 1 --2- 172.21.15.158:0/4290778400 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f890809ba40 0x7f890805a400 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f88f4002f30 tx=0x7f88f400fd30).stop 2019-12-05T03:50:04.642 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.635+0000 7f890e4b6700 1 -- 172.21.15.158:0/4290778400 shutdown_connections 2019-12-05T03:50:04.643 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.635+0000 7f890e4b6700 1 --2- 172.21.15.158:0/4290778400 >> v2:172.21.15.96:3300/0 conn(0x7f89080b6970 0x7f890809add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:04.643 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.635+0000 7f890e4b6700 1 --2- 172.21.15.158:0/4290778400 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f890809ba40 0x7f890805a400 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:04.643 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.635+0000 7f890e4b6700 1 -- 172.21.15.158:0/4290778400 shutdown_connections 2019-12-05T03:50:04.643 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.635+0000 7f890e4b6700 1 -- 172.21.15.158:0/4290778400 wait complete. 2019-12-05T03:50:04.643 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.635+0000 7f890e4b6700 1 -- 172.21.15.158:0/4290778400 >> 172.21.15.158:0/4290778400 conn(0x7f89080b7ef0 msgr2=0x7f89080b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:04.646 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.639+0000 7f890e4b6700 1 Processor -- start 2019-12-05T03:50:04.647 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.639+0000 7f890e4b6700 1 -- start start 2019-12-05T03:50:04.647 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.639+0000 7f890e4b6700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f89080b2b50 0x7f89080b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:04.647 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.639+0000 7f890e4b6700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8908139810 0x7f890813cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:04.647 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.639+0000 7f890e4b6700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8908152c70 con 0x7f890813d510 2019-12-05T03:50:04.647 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.639+0000 7f890e4b6700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8908152fe0 con 0x7f8908139810 2019-12-05T03:50:04.647 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.639+0000 7f890e4b6700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8908153280 con 0x7f89080b2b50 2019-12-05T03:50:04.648 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.639+0000 7f890ca53700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f89080b2b50 0x7f89080b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:04.648 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.639+0000 7f890ca53700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f89080b2b50 0x7f89080b14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53492/0 (socket says 172.21.15.158:53492) 2019-12-05T03:50:04.648 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.639+0000 7f890ca53700 1 -- 172.21.15.158:0/188614822 learned_addr learned my addr 172.21.15.158:0/188614822 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:04.648 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.639+0000 7f8907fff700 1 --2- 172.21.15.158:0/188614822 >> v2:172.21.15.96:3300/0 conn(0x7f8908139810 0x7f890813cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:04.648 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.643+0000 7f890ca53700 1 -- 172.21.15.158:0/188614822 >> v2:172.21.15.96:3300/0 conn(0x7f8908139810 msgr2=0x7f890813cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:04.648 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.643+0000 7f890ca53700 1 --2- 172.21.15.158:0/188614822 >> v2:172.21.15.96:3300/0 conn(0x7f8908139810 0x7f890813cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:04.648 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.643+0000 7f890ca53700 1 -- 172.21.15.158:0/188614822 >> v1:172.21.15.96:6789/0 conn(0x7f890813d510 legacy=0x7f890807ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:04.649 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.643+0000 7f890ca53700 1 -- 172.21.15.158:0/188614822 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89080b2f80 con 0x7f89080b2b50 2019-12-05T03:50:04.649 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.643+0000 7f8907fff700 1 --2- 172.21.15.158:0/188614822 >> v2:172.21.15.96:3300/0 conn(0x7f8908139810 0x7f890813cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-12-05T03:50:04.649 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.643+0000 7f890ca53700 1 --2- 172.21.15.158:0/188614822 >> v2:172.21.15.158:3300/0 conn(0x7f89080b2b50 0x7f89080b14e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f88f8003070 tx=0x7f88f8010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.649 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.643+0000 7f890ca53700 1 --2- 172.21.15.158:0/188614822 >> v2:172.21.15.158:3300/0 conn(0x7f89080b2b50 0x7f89080b14e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f88f8003070 tx=0x7f88f8010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.649 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.643+0000 7f890ca53700 1 --2- 172.21.15.158:0/188614822 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f89080b2b50 0x7f89080b14e0 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7f88f8003070 tx=0x7f88f8010b60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:04.649 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.643+0000 7f890ca53700 1 --2- 172.21.15.158:0/188614822 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f89080b2b50 0x7f89080b14e0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f88f8003070 tx=0x7f88f8010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.649 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.643+0000 7f890ca53700 1 --2- 172.21.15.158:0/188614822 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f89080b2b50 0x7f89080b14e0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f88f8003070 tx=0x7f88f8010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.650 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.643+0000 7f89057fa700 1 -- 172.21.15.158:0/188614822 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88f8005540 con 0x7f89080b2b50 2019-12-05T03:50:04.650 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.643+0000 7f890ca53700 1 --2- 172.21.15.158:0/188614822 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f89080b2b50 0x7f89080b14e0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f88f8003070 tx=0x7f88f8010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.650 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.643+0000 7f89057fa700 1 -- 172.21.15.158:0/188614822 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f8007150 con 0x7f89080b2b50 2019-12-05T03:50:04.650 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.643+0000 7f890e4b6700 1 -- 172.21.15.158:0/188614822 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8908151c90 con 0x7f89080b2b50 2019-12-05T03:50:04.650 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.643+0000 7f89057fa700 1 -- 172.21.15.158:0/188614822 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88f8005b20 con 0x7f89080b2b50 2019-12-05T03:50:04.650 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.643+0000 7f890e4b6700 1 -- 172.21.15.158:0/188614822 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f890813d940 con 0x7f89080b2b50 2019-12-05T03:50:04.650 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.643+0000 7f890ca53700 1 --2- 172.21.15.158:0/188614822 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f89080b2b50 0x7f89080b14e0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f88f8003070 tx=0x7f88f8010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.651 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.643+0000 7f89057fa700 1 -- 172.21.15.158:0/188614822 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f88f80123c0 con 0x7f89080b2b50 2019-12-05T03:50:04.651 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.643+0000 7f890ca53700 1 --2- 172.21.15.158:0/188614822 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f89080b2b50 0x7f89080b14e0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f88f8003070 tx=0x7f88f8010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.651 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.643+0000 7f89057fa700 1 --2- 172.21.15.158:0/188614822 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f88e403acc0 0x7f88e403d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:04.651 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.643+0000 7f89057fa700 1 -- 172.21.15.158:0/188614822 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f88f804ae60 con 0x7f89080b2b50 2019-12-05T03:50:04.651 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.643+0000 7f8907fff700 1 --2- 172.21.15.158:0/188614822 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f88e403acc0 0x7f88e403d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:04.651 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.643+0000 7f8907fff700 1 --2- 172.21.15.158:0/188614822 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f88e403acc0 0x7f88e403d1d0 crc :-1 s=READY pgs=57 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:04.652 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.647+0000 7f890e4b6700 1 -- 172.21.15.158:0/188614822 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89080554e0 con 0x7f89080b2b50 2019-12-05T03:50:04.656 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.655+0000 7f890ca53700 1 --2- 172.21.15.158:0/188614822 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f89080b2b50 0x7f89080b14e0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f88f8003070 tx=0x7f88f8010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.656 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.655+0000 7f89057fa700 1 -- 172.21.15.158:0/188614822 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f88f8067400 con 0x7f89080b2b50 2019-12-05T03:50:04.816 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.815+0000 7f890e4b6700 1 -- 172.21.15.158:0/188614822 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f8908066940 con 0x7f89080b2b50 2019-12-05T03:50:04.817 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.815+0000 7f890ca53700 1 --2- 172.21.15.158:0/188614822 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f89080b2b50 0x7f89080b14e0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7f88f8003070 tx=0x7f88f8010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.817 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.815+0000 7f89057fa700 1 -- 172.21.15.158:0/188614822 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7f88f8031ee0 con 0x7f89080b2b50 2019-12-05T03:50:04.817 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:50:04.820 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.815+0000 7f890e4b6700 1 -- 172.21.15.158:0/188614822 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f88e403acc0 msgr2=0x7f88e403d1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:04.820 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.815+0000 7f890e4b6700 1 --2- 172.21.15.158:0/188614822 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f88e403acc0 0x7f88e403d1d0 crc :-1 s=READY pgs=57 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:04.820 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.815+0000 7f890e4b6700 1 -- 172.21.15.158:0/188614822 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f89080b2b50 msgr2=0x7f89080b14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:04.820 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.815+0000 7f890e4b6700 1 --2- 172.21.15.158:0/188614822 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f89080b2b50 0x7f89080b14e0 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7f88f8003070 tx=0x7f88f8010b60).stop 2019-12-05T03:50:04.821 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.819+0000 7f890e4b6700 1 -- 172.21.15.158:0/188614822 shutdown_connections 2019-12-05T03:50:04.821 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.819+0000 7f890e4b6700 1 --2- 172.21.15.158:0/188614822 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f88e403acc0 0x7f88e403d1d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:04.821 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.819+0000 7f890e4b6700 1 --2- 172.21.15.158:0/188614822 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f89080b2b50 0x7f89080b14e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:04.821 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.819+0000 7f890e4b6700 1 --2- 172.21.15.158:0/188614822 >> v2:172.21.15.96:3300/0 conn(0x7f8908139810 0x7f890813cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:04.821 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.819+0000 7f890e4b6700 1 -- 172.21.15.158:0/188614822 shutdown_connections 2019-12-05T03:50:04.821 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.819+0000 7f890e4b6700 1 -- 172.21.15.158:0/188614822 wait complete. 2019-12-05T03:50:04.821 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.819+0000 7f890e4b6700 1 -- 172.21.15.158:0/188614822 >> 172.21.15.158:0/188614822 conn(0x7f89080b2030 msgr2=0x7f890812c720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:04.828 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2019-12-05T03:50:04.829 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2019-12-05T03:50:04.829 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2019-12-05T03:50:04.932 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.923+0000 7fbc3ffd8700 1 Processor -- start 2019-12-05T03:50:04.932 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.923+0000 7fbc3ffd8700 1 -- start start 2019-12-05T03:50:04.932 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.923+0000 7fbc3ffd8700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbc3809cf60 0x7fbc3809a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:04.932 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.923+0000 7fbc3ffd8700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbc381553b0 0x7fbc381557e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:04.933 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.923+0000 7fbc3ffd8700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc380accb0 con 0x7fbc3805a740 2019-12-05T03:50:04.933 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.923+0000 7fbc3ffd8700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc380b1730 con 0x7fbc381553b0 2019-12-05T03:50:04.933 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.923+0000 7fbc3ffd8700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc380b19d0 con 0x7fbc3809cf60 2019-12-05T03:50:04.933 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.923+0000 7fbc3dd74700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fbc3805a740 0x7fbc38151460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48280/0 (socket says 172.21.15.158:48280) 2019-12-05T03:50:04.933 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.923+0000 7fbc3dd74700 1 -- 172.21.15.158:0/3000399693 learned_addr learned my addr 172.21.15.158:0/3000399693 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:04.933 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.923+0000 7fbc3ed76700 1 --2- 172.21.15.158:0/3000399693 >> v2:172.21.15.96:3300/0 conn(0x7fbc381553b0 0x7fbc381557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:04.933 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.923+0000 7fbc3e575700 1 --2- 172.21.15.158:0/3000399693 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbc3809cf60 0x7fbc3809a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:04.934 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.923+0000 7fbc3d573700 1 -- 172.21.15.158:0/3000399693 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4125230303 0 0) 0x7fbc380accb0 con 0x7fbc3805a740 2019-12-05T03:50:04.934 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.923+0000 7fbc3d573700 1 -- 172.21.15.158:0/3000399693 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc240030b0 con 0x7fbc3805a740 2019-12-05T03:50:04.934 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.923+0000 7fbc3d573700 1 -- 172.21.15.158:0/3000399693 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3152869346 0 0) 0x7fbc240030b0 con 0x7fbc3805a740 2019-12-05T03:50:04.934 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.923+0000 7fbc3d573700 1 -- 172.21.15.158:0/3000399693 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbc3809cf60 msgr2=0x7fbc3809a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:04.934 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.923+0000 7fbc3d573700 1 --2- 172.21.15.158:0/3000399693 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbc3809cf60 0x7fbc3809a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:04.934 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.923+0000 7fbc3d573700 1 -- 172.21.15.158:0/3000399693 >> v2:172.21.15.96:3300/0 conn(0x7fbc381553b0 msgr2=0x7fbc381557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:04.934 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.923+0000 7fbc3d573700 1 --2- 172.21.15.158:0/3000399693 >> v2:172.21.15.96:3300/0 conn(0x7fbc381553b0 0x7fbc381557e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:04.935 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.923+0000 7fbc3d573700 1 -- 172.21.15.158:0/3000399693 --> v1:172.21.15.158:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3805ab70 con 0x7fbc3805a740 2019-12-05T03:50:04.935 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.923+0000 7fbc3d573700 1 -- 172.21.15.158:0/3000399693 <== mon.1 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 828730332 0 0) 0x7fbc28001750 con 0x7fbc3805a740 2019-12-05T03:50:04.935 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.923+0000 7fbc3d573700 1 -- 172.21.15.158:0/3000399693 >> v1:172.21.15.158:6789/0 conn(0x7fbc3805a740 legacy=0x7fbc38151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:04.935 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.923+0000 7fbc3d573700 1 --2- 172.21.15.158:0/3000399693 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc24003790 0x7fbc24003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:04.935 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.923+0000 7fbc3d573700 1 --2- 172.21.15.158:0/3000399693 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc24004420 0x7fbc24004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:04.935 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.927+0000 7fbc3d573700 1 --2- 172.21.15.158:0/3000399693 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbc24004da0 0x7fbc2404f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:04.936 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.927+0000 7fbc3d573700 1 -- 172.21.15.158:0/3000399693 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc380b1730 con 0x7fbc24004420 2019-12-05T03:50:04.936 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.927+0000 7fbc3d573700 1 -- 172.21.15.158:0/3000399693 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc380b19d0 con 0x7fbc24003790 2019-12-05T03:50:04.936 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.927+0000 7fbc3d573700 1 -- 172.21.15.158:0/3000399693 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2404fbd0 con 0x7fbc24004da0 2019-12-05T03:50:04.936 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.927+0000 7fbc3e575700 1 --2- 172.21.15.158:0/3000399693 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc24003790 0x7fbc24003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:04.936 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.927+0000 7fbc3dd74700 1 --2- 172.21.15.158:0/3000399693 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc24004420 0x7fbc24004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:04.936 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.927+0000 7fbc3ed76700 1 --2- 172.21.15.158:0/3000399693 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbc24004da0 0x7fbc2404f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:04.936 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.927+0000 7fbc3e575700 1 -- 172.21.15.158:0/3000399693 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbc24004da0 msgr2=0x7fbc2404f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:04.937 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.927+0000 7fbc3e575700 1 --2- 172.21.15.158:0/3000399693 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbc24004da0 0x7fbc2404f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:04.937 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.927+0000 7fbc3e575700 1 -- 172.21.15.158:0/3000399693 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc24004420 msgr2=0x7fbc24004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:04.937 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.927+0000 7fbc3e575700 1 --2- 172.21.15.158:0/3000399693 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc24004420 0x7fbc24004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:04.937 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.927+0000 7fbc3e575700 1 -- 172.21.15.158:0/3000399693 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc2404fd90 con 0x7fbc24003790 2019-12-05T03:50:04.937 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.927+0000 7fbc3e575700 1 --2- 172.21.15.158:0/3000399693 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc24003790 0x7fbc24003bc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbc20002f30 tx=0x7fbc2000ffe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.937 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.927+0000 7fbc3e575700 1 --2- 172.21.15.158:0/3000399693 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc24003790 0x7fbc24003bc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbc20002f30 tx=0x7fbc2000ffe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.937 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.927+0000 7fbc3e575700 1 --2- 172.21.15.158:0/3000399693 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc24003790 0x7fbc24003bc0 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7fbc20002f30 tx=0x7fbc2000ffe0).ready entity=mon.1 client_cookie=8ab96f8a7db07760 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:04.938 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.927+0000 7fbc3e575700 1 --2- 172.21.15.158:0/3000399693 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc24003790 0x7fbc24003bc0 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7fbc20002f30 tx=0x7fbc2000ffe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.938 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.927+0000 7fbc3d573700 1 -- 172.21.15.158:0/3000399693 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc20010d10 con 0x7fbc24003790 2019-12-05T03:50:04.938 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.927+0000 7fbc3e575700 1 --2- 172.21.15.158:0/3000399693 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc24003790 0x7fbc24003bc0 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7fbc20002f30 tx=0x7fbc2000ffe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.938 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.927+0000 7fbc3e575700 1 --2- 172.21.15.158:0/3000399693 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc24003790 0x7fbc24003bc0 secure :-1 s=THROTTLE_DONE pgs=96 cs=0 l=1 rx=0x7fbc20002f30 tx=0x7fbc2000ffe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.938 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.927+0000 7fbc3d573700 1 -- 172.21.15.158:0/3000399693 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc20010930 con 0x7fbc24003790 2019-12-05T03:50:04.938 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.927+0000 7fbc3d573700 1 -- 172.21.15.158:0/3000399693 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc20008bb0 con 0x7fbc24003790 2019-12-05T03:50:04.938 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.927+0000 7fbc3ffd8700 1 -- 172.21.15.158:0/3000399693 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc24003790 msgr2=0x7fbc24003bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:04.939 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.927+0000 7fbc3ffd8700 1 --2- 172.21.15.158:0/3000399693 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc24003790 0x7fbc24003bc0 secure :-1 s=READY pgs=96 cs=0 l=1 rx=0x7fbc20002f30 tx=0x7fbc2000ffe0).stop 2019-12-05T03:50:04.939 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.927+0000 7fbc3ed76700 1 -- 172.21.15.158:0/3000399693 reap_dead start 2019-12-05T03:50:04.939 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.927+0000 7fbc3ffd8700 1 -- 172.21.15.158:0/3000399693 shutdown_connections 2019-12-05T03:50:04.939 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.927+0000 7fbc3ffd8700 1 -- 172.21.15.158:0/3000399693 shutdown_connections 2019-12-05T03:50:04.939 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.927+0000 7fbc3ffd8700 1 -- 172.21.15.158:0/3000399693 wait complete. 2019-12-05T03:50:04.939 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.927+0000 7fbc3ffd8700 1 -- 172.21.15.158:0/3000399693 >> 172.21.15.158:0/3000399693 conn(0x7fbc380b7e60 msgr2=0x7fbc380b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:04.939 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.931+0000 7fbc3ffd8700 1 Processor -- start 2019-12-05T03:50:04.940 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.931+0000 7fbc3ffd8700 1 -- start start 2019-12-05T03:50:04.943 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.931+0000 7fbc3ffd8700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fbc38061480 0x7fbc380650e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:04.943 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.931+0000 7fbc3ffd8700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbc38143440 0x7fbc381492a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:04.943 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.931+0000 7fbc3ffd8700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc381497f0 con 0x7fbc38061df0 2019-12-05T03:50:04.943 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.931+0000 7fbc3ffd8700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc38143f90 con 0x7fbc38061480 2019-12-05T03:50:04.943 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.931+0000 7fbc3ffd8700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc38140660 con 0x7fbc38143440 2019-12-05T03:50:04.943 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.931+0000 7fbc3dd74700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fbc38061480 0x7fbc380650e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:04.943 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.931+0000 7fbc3dd74700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fbc38061480 0x7fbc380650e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53514/0 (socket says 172.21.15.158:53514) 2019-12-05T03:50:04.944 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.931+0000 7fbc3dd74700 1 -- 172.21.15.158:0/2672024295 learned_addr learned my addr 172.21.15.158:0/2672024295 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:04.944 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.931+0000 7fbc3ed76700 1 --2- 172.21.15.158:0/2672024295 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbc38143440 0x7fbc381492a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:04.944 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.931+0000 7fbc3dd74700 1 -- 172.21.15.158:0/2672024295 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbc38143440 msgr2=0x7fbc381492a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:04.944 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.931+0000 7fbc3dd74700 1 --2- 172.21.15.158:0/2672024295 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbc38143440 0x7fbc381492a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:04.944 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.931+0000 7fbc3dd74700 1 -- 172.21.15.158:0/2672024295 >> v1:172.21.15.96:6789/0 conn(0x7fbc38061df0 legacy=0x7fbc3813f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:04.944 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.931+0000 7fbc3dd74700 1 -- 172.21.15.158:0/2672024295 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc38143870 con 0x7fbc38061480 2019-12-05T03:50:04.945 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.931+0000 7fbc3dd74700 1 --2- 172.21.15.158:0/2672024295 >> v2:172.21.15.158:3300/0 conn(0x7fbc38061480 0x7fbc380650e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbc38144150 tx=0x7fbc28010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.945 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.931+0000 7fbc3dd74700 1 --2- 172.21.15.158:0/2672024295 >> v2:172.21.15.158:3300/0 conn(0x7fbc38061480 0x7fbc380650e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbc38144150 tx=0x7fbc28010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.945 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.931+0000 7fbc3dd74700 1 --2- 172.21.15.158:0/2672024295 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc38061480 0x7fbc380650e0 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7fbc38144150 tx=0x7fbc28010b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:04.945 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.931+0000 7fbc3dd74700 1 --2- 172.21.15.158:0/2672024295 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc38061480 0x7fbc380650e0 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7fbc38144150 tx=0x7fbc28010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.945 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.931+0000 7fbc36ffd700 1 -- 172.21.15.158:0/2672024295 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc28013060 con 0x7fbc38061480 2019-12-05T03:50:04.945 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.931+0000 7fbc3dd74700 1 --2- 172.21.15.158:0/2672024295 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc38061480 0x7fbc380650e0 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7fbc38144150 tx=0x7fbc28010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.945 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.931+0000 7fbc36ffd700 1 -- 172.21.15.158:0/2672024295 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc280124d0 con 0x7fbc38061480 2019-12-05T03:50:04.946 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.931+0000 7fbc3dd74700 1 --2- 172.21.15.158:0/2672024295 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc38061480 0x7fbc380650e0 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7fbc38144150 tx=0x7fbc28010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.946 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.931+0000 7fbc3ffd8700 1 -- 172.21.15.158:0/2672024295 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc38149a20 con 0x7fbc38061480 2019-12-05T03:50:04.946 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.931+0000 7fbc36ffd700 1 -- 172.21.15.158:0/2672024295 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc28012c90 con 0x7fbc38061480 2019-12-05T03:50:04.946 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.931+0000 7fbc3ffd8700 1 -- 172.21.15.158:0/2672024295 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc38149e00 con 0x7fbc38061480 2019-12-05T03:50:04.946 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.931+0000 7fbc3dd74700 1 --2- 172.21.15.158:0/2672024295 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc38061480 0x7fbc380650e0 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7fbc38144150 tx=0x7fbc28010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.946 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.935+0000 7fbc36ffd700 1 -- 172.21.15.158:0/2672024295 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fbc2800a320 con 0x7fbc38061480 2019-12-05T03:50:04.946 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.935+0000 7fbc3dd74700 1 --2- 172.21.15.158:0/2672024295 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc38061480 0x7fbc380650e0 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7fbc38144150 tx=0x7fbc28010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.946 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.935+0000 7fbc36ffd700 1 --2- 172.21.15.158:0/2672024295 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fbc1c03ad00 0x7fbc1c03d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:04.947 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.935+0000 7fbc36ffd700 1 -- 172.21.15.158:0/2672024295 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fbc2804afa0 con 0x7fbc38061480 2019-12-05T03:50:04.947 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.935+0000 7fbc3e575700 1 --2- 172.21.15.158:0/2672024295 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fbc1c03ad00 0x7fbc1c03d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:04.947 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.935+0000 7fbc3e575700 1 --2- 172.21.15.158:0/2672024295 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fbc1c03ad00 0x7fbc1c03d210 crc :-1 s=READY pgs=58 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:04.947 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.939+0000 7fbc3ffd8700 1 -- 172.21.15.158:0/2672024295 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc380554e0 con 0x7fbc38061480 2019-12-05T03:50:04.948 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.943+0000 7fbc3dd74700 1 --2- 172.21.15.158:0/2672024295 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc38061480 0x7fbc380650e0 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7fbc38144150 tx=0x7fbc28010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:04.948 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:04.943+0000 7fbc36ffd700 1 -- 172.21.15.158:0/2672024295 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fbc28032000 con 0x7fbc38061480 2019-12-05T03:50:05.151 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.151+0000 7fbc3ffd8700 1 -- 172.21.15.158:0/2672024295 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fbc38066940 con 0x7fbc38061480 2019-12-05T03:50:05.156 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.155+0000 7fbc3dd74700 1 --2- 172.21.15.158:0/2672024295 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc38061480 0x7fbc380650e0 secure :-1 s=THROTTLE_DONE pgs=97 cs=0 l=1 rx=0x7fbc38144150 tx=0x7fbc28010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.157 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.155+0000 7fbc36ffd700 1 -- 172.21.15.158:0/2672024295 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v3) v1 ==== 74+0+94024 (secure 0 0 0) 0x7fbc28032260 con 0x7fbc38061480 2019-12-05T03:50:05.160 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:05.162 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.159+0000 7fbc3ffd8700 1 -- 172.21.15.158:0/2672024295 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fbc1c03ad00 msgr2=0x7fbc1c03d210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:05.162 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.159+0000 7fbc3ffd8700 1 --2- 172.21.15.158:0/2672024295 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fbc1c03ad00 0x7fbc1c03d210 crc :-1 s=READY pgs=58 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:05.162 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.159+0000 7fbc3ffd8700 1 -- 172.21.15.158:0/2672024295 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc38061480 msgr2=0x7fbc380650e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:05.162 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.159+0000 7fbc3ffd8700 1 --2- 172.21.15.158:0/2672024295 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc38061480 0x7fbc380650e0 secure :-1 s=READY pgs=97 cs=0 l=1 rx=0x7fbc38144150 tx=0x7fbc28010b90).stop 2019-12-05T03:50:05.163 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.159+0000 7fbc3ffd8700 1 -- 172.21.15.158:0/2672024295 shutdown_connections 2019-12-05T03:50:05.163 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.159+0000 7fbc3ffd8700 1 --2- 172.21.15.158:0/2672024295 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbc38143440 0x7fbc381492a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:05.163 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.159+0000 7fbc3ffd8700 1 --2- 172.21.15.158:0/2672024295 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fbc1c03ad00 0x7fbc1c03d210 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:05.163 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.159+0000 7fbc3ffd8700 1 --2- 172.21.15.158:0/2672024295 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbc38061480 0x7fbc380650e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:05.163 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.159+0000 7fbc3ffd8700 1 -- 172.21.15.158:0/2672024295 shutdown_connections 2019-12-05T03:50:05.163 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.159+0000 7fbc3ffd8700 1 -- 172.21.15.158:0/2672024295 wait complete. 2019-12-05T03:50:05.163 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.159+0000 7fbc3ffd8700 1 -- 172.21.15.158:0/2672024295 >> 172.21.15.158:0/2672024295 conn(0x7fbc3805a740 msgr2=0x7fbc38134080 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:05.174 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":3,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":12043},{"type":"v1","addr":"172.21.15.96:6801","nonce":12043}]},"active_addr":"172.21.15.96:6801/12043","active_change":"2019-12-05T03:49:41.463800+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":4108,"name":"y","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"str","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"ca_bundle":{"name":"ca_bundle","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_location":{"name":"server_location","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"1","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"str","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"ssh","can_run":true,"error_string":"","module_options":{"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["ceph-daemon-package","root"],"desc":"mode for remote execution of ceph-daemon","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"str","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"ca_bundle":{"name":"ca_bundle","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_location":{"name":"server_location","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"1","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"str","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"ssh","can_run":true,"error_string":"","module_options":{"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["ceph-daemon-package","root"],"desc":"mode for remote execution of ceph-daemon","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator_cli","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[]}} 2019-12-05T03:50:05.179 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2019-12-05T03:50:05.179 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2019-12-05T03:50:05.180 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-05T03:50:05.280 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.275+0000 7fa50feb0700 1 Processor -- start 2019-12-05T03:50:05.280 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.275+0000 7fa50feb0700 1 -- start start 2019-12-05T03:50:05.280 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.275+0000 7fa50feb0700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa50809a310 0x7fa50805a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:05.280 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.275+0000 7fa50feb0700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa5081553a0 0x7fa5081557d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:05.281 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.275+0000 7fa50feb0700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5080acca0 con 0x7fa50809cf50 2019-12-05T03:50:05.281 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.275+0000 7fa50feb0700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa50809a740 con 0x7fa5081553a0 2019-12-05T03:50:05.281 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.275+0000 7fa50feb0700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5080b1720 con 0x7fa50809a310 2019-12-05T03:50:05.281 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.275+0000 7fa50dc4c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa50809a310 0x7fa50805a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:05.281 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.275+0000 7fa50dc4c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa50809a310 0x7fa50805a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53520/0 (socket says 172.21.15.158:53520) 2019-12-05T03:50:05.281 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.275+0000 7fa50dc4c700 1 -- 172.21.15.158:0/3296386080 learned_addr learned my addr 172.21.15.158:0/3296386080 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:05.281 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.275+0000 7fa50ec4e700 1 --2- 172.21.15.158:0/3296386080 >> v2:172.21.15.96:3300/0 conn(0x7fa5081553a0 0x7fa5081557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:05.282 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.275+0000 7fa50dc4c700 1 -- 172.21.15.158:0/3296386080 >> v2:172.21.15.96:3300/0 conn(0x7fa5081553a0 msgr2=0x7fa5081557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:05.282 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.275+0000 7fa50dc4c700 1 --2- 172.21.15.158:0/3296386080 >> v2:172.21.15.96:3300/0 conn(0x7fa5081553a0 0x7fa5081557d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:05.282 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.275+0000 7fa50dc4c700 1 -- 172.21.15.158:0/3296386080 >> v1:172.21.15.96:6789/0 conn(0x7fa50809cf50 legacy=0x7fa508151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:05.282 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.275+0000 7fa50dc4c700 1 -- 172.21.15.158:0/3296386080 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5080b6970 con 0x7fa50809a310 2019-12-05T03:50:05.282 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.275+0000 7fa50dc4c700 1 --2- 172.21.15.158:0/3296386080 >> v2:172.21.15.158:3300/0 conn(0x7fa50809a310 0x7fa50805a730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa504008790 tx=0x7fa50400fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.282 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.275+0000 7fa50dc4c700 1 --2- 172.21.15.158:0/3296386080 >> v2:172.21.15.158:3300/0 conn(0x7fa50809a310 0x7fa50805a730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa504008790 tx=0x7fa50400fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.282 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.275+0000 7fa50dc4c700 1 --2- 172.21.15.158:0/3296386080 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa50809a310 0x7fa50805a730 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7fa504008790 tx=0x7fa50400fd30).ready entity=mon.1 client_cookie=db5938a28fc8f7f5 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:05.283 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.275+0000 7fa50dc4c700 1 --2- 172.21.15.158:0/3296386080 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa50809a310 0x7fa50805a730 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7fa504008790 tx=0x7fa50400fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.283 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.275+0000 7fa50dc4c700 1 --2- 172.21.15.158:0/3296386080 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa50809a310 0x7fa50805a730 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7fa504008790 tx=0x7fa50400fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.283 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.275+0000 7fa50d44b700 1 -- 172.21.15.158:0/3296386080 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa504008c90 con 0x7fa50809a310 2019-12-05T03:50:05.283 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.275+0000 7fa50dc4c700 1 --2- 172.21.15.158:0/3296386080 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa50809a310 0x7fa50805a730 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7fa504008790 tx=0x7fa50400fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.283 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.275+0000 7fa50d44b700 1 -- 172.21.15.158:0/3296386080 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5040088b0 con 0x7fa50809a310 2019-12-05T03:50:05.283 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.275+0000 7fa50d44b700 1 -- 172.21.15.158:0/3296386080 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa504011ad0 con 0x7fa50809a310 2019-12-05T03:50:05.283 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.275+0000 7fa50feb0700 1 -- 172.21.15.158:0/3296386080 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa50809a310 msgr2=0x7fa50805a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:05.284 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.275+0000 7fa50feb0700 1 --2- 172.21.15.158:0/3296386080 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa50809a310 0x7fa50805a730 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7fa504008790 tx=0x7fa50400fd30).stop 2019-12-05T03:50:05.284 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.279+0000 7fa50feb0700 1 -- 172.21.15.158:0/3296386080 shutdown_connections 2019-12-05T03:50:05.284 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.279+0000 7fa50feb0700 1 --2- 172.21.15.158:0/3296386080 >> v2:172.21.15.96:3300/0 conn(0x7fa5081553a0 0x7fa5081557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:05.284 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.279+0000 7fa50feb0700 1 --2- 172.21.15.158:0/3296386080 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa50809a310 0x7fa50805a730 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:05.284 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.279+0000 7fa50feb0700 1 -- 172.21.15.158:0/3296386080 shutdown_connections 2019-12-05T03:50:05.284 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.279+0000 7fa50feb0700 1 -- 172.21.15.158:0/3296386080 wait complete. 2019-12-05T03:50:05.285 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.279+0000 7fa50feb0700 1 -- 172.21.15.158:0/3296386080 >> 172.21.15.158:0/3296386080 conn(0x7fa5080b7e50 msgr2=0x7fa5080b3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:05.293 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.279+0000 7fa50feb0700 1 Processor -- start 2019-12-05T03:50:05.293 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.279+0000 7fa50feb0700 1 -- start start 2019-12-05T03:50:05.293 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.279+0000 7fa50feb0700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa508152a80 0x7fa50807d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:05.293 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.279+0000 7fa50feb0700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa50807b050 0x7fa50807b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:05.293 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.279+0000 7fa50feb0700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa508151380 con 0x7fa508126390 2019-12-05T03:50:05.294 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.279+0000 7fa50feb0700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa508127f20 con 0x7fa50807b050 2019-12-05T03:50:05.294 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.279+0000 7fa50feb0700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5080ad3b0 con 0x7fa508152a80 2019-12-05T03:50:05.294 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.279+0000 7fa50e44d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa508152a80 0x7fa50807d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:05.294 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.279+0000 7fa50ec4e700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fa508126390 0x7fa5081267c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48308/0 (socket says 172.21.15.158:48308) 2019-12-05T03:50:05.294 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.279+0000 7fa50ec4e700 1 -- 172.21.15.158:0/1698244265 learned_addr learned my addr 172.21.15.158:0/1698244265 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:05.294 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.279+0000 7fa50dc4c700 1 --2- 172.21.15.158:0/1698244265 >> v2:172.21.15.96:3300/0 conn(0x7fa50807b050 0x7fa50807b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:05.294 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.279+0000 7fa50e44d700 1 -- 172.21.15.158:0/1698244265 >> v2:172.21.15.96:3300/0 conn(0x7fa50807b050 msgr2=0x7fa50807b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:05.295 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.279+0000 7fa50e44d700 1 --2- 172.21.15.158:0/1698244265 >> v2:172.21.15.96:3300/0 conn(0x7fa50807b050 0x7fa50807b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:05.295 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.279+0000 7fa50e44d700 1 -- 172.21.15.158:0/1698244265 >> v1:172.21.15.158:6789/0 conn(0x7fa508126390 legacy=0x7fa5081267c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:05.295 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.279+0000 7fa4faffd700 1 -- 172.21.15.158:0/1698244265 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1173391160 0 0) 0x7fa508151380 con 0x7fa508126390 2019-12-05T03:50:05.295 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.279+0000 7fa50e44d700 1 -- 172.21.15.158:0/1698244265 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa508127ba0 con 0x7fa508152a80 2019-12-05T03:50:05.295 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.279+0000 7fa50dc4c700 1 --2- 172.21.15.158:0/1698244265 >> v2:172.21.15.96:3300/0 conn(0x7fa50807b050 0x7fa50807b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:50:05.295 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.279+0000 7fa50e44d700 1 --2- 172.21.15.158:0/1698244265 >> v2:172.21.15.158:3300/0 conn(0x7fa508152a80 0x7fa50807d560 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa4fc002ef0 tx=0x7fa4fc010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.295 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.283+0000 7fa50e44d700 1 --2- 172.21.15.158:0/1698244265 >> v2:172.21.15.158:3300/0 conn(0x7fa508152a80 0x7fa50807d560 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa4fc002ef0 tx=0x7fa4fc010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.295 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.283+0000 7fa50e44d700 1 --2- 172.21.15.158:0/1698244265 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa508152a80 0x7fa50807d560 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7fa4fc002ef0 tx=0x7fa4fc010860).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:05.296 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.283+0000 7fa50e44d700 1 --2- 172.21.15.158:0/1698244265 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa508152a80 0x7fa50807d560 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7fa4fc002ef0 tx=0x7fa4fc010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.296 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.283+0000 7fa4faffd700 1 -- 172.21.15.158:0/1698244265 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4fc0058a0 con 0x7fa508152a80 2019-12-05T03:50:05.296 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.283+0000 7fa50e44d700 1 --2- 172.21.15.158:0/1698244265 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa508152a80 0x7fa50807d560 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7fa4fc002ef0 tx=0x7fa4fc010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.296 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.283+0000 7fa50e44d700 1 --2- 172.21.15.158:0/1698244265 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa508152a80 0x7fa50807d560 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7fa4fc002ef0 tx=0x7fa4fc010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.296 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.283+0000 7fa4faffd700 1 -- 172.21.15.158:0/1698244265 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4fc0054c0 con 0x7fa508152a80 2019-12-05T03:50:05.296 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.283+0000 7fa4faffd700 1 -- 172.21.15.158:0/1698244265 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4fc0111b0 con 0x7fa508152a80 2019-12-05T03:50:05.296 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.283+0000 7fa50feb0700 1 -- 172.21.15.158:0/1698244265 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5080ad650 con 0x7fa508152a80 2019-12-05T03:50:05.297 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.283+0000 7fa50feb0700 1 -- 172.21.15.158:0/1698244265 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa508155030 con 0x7fa508152a80 2019-12-05T03:50:05.297 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.283+0000 7fa50e44d700 1 --2- 172.21.15.158:0/1698244265 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa508152a80 0x7fa50807d560 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7fa4fc002ef0 tx=0x7fa4fc010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.303 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.283+0000 7fa4faffd700 1 -- 172.21.15.158:0/1698244265 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fa4fc011490 con 0x7fa508152a80 2019-12-05T03:50:05.303 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.283+0000 7fa50e44d700 1 --2- 172.21.15.158:0/1698244265 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa508152a80 0x7fa50807d560 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7fa4fc002ef0 tx=0x7fa4fc010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.304 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.283+0000 7fa4faffd700 1 --2- 172.21.15.158:0/1698244265 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa4f003ac40 0x7fa4f003d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:05.304 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.283+0000 7fa4faffd700 1 -- 172.21.15.158:0/1698244265 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fa4fc04ad00 con 0x7fa508152a80 2019-12-05T03:50:05.304 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.283+0000 7fa50dc4c700 1 --2- 172.21.15.158:0/1698244265 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa4f003ac40 0x7fa4f003d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:05.304 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.283+0000 7fa50dc4c700 1 --2- 172.21.15.158:0/1698244265 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa4f003ac40 0x7fa4f003d150 crc :-1 s=READY pgs=59 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:05.304 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.291+0000 7fa50feb0700 1 -- 172.21.15.158:0/1698244265 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa50807df90 con 0x7fa508152a80 2019-12-05T03:50:05.305 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.295+0000 7fa50e44d700 1 --2- 172.21.15.158:0/1698244265 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa508152a80 0x7fa50807d560 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7fa4fc002ef0 tx=0x7fa4fc010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.305 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.295+0000 7fa4faffd700 1 -- 172.21.15.158:0/1698244265 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fa4fc031d60 con 0x7fa508152a80 2019-12-05T03:50:05.460 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.459+0000 7fa50feb0700 1 -- 172.21.15.158:0/1698244265 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5080554d0 con 0x7fa508152a80 2019-12-05T03:50:05.462 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.459+0000 7fa50e44d700 1 --2- 172.21.15.158:0/1698244265 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa508152a80 0x7fa50807d560 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7fa4fc002ef0 tx=0x7fa4fc010860).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.462 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.459+0000 7fa4faffd700 1 -- 172.21.15.158:0/1698244265 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+14933 (secure 0 0 0) 0x7fa4fc031fc0 con 0x7fa508152a80 2019-12-05T03:50:05.463 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:05.463 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":23,"fsid":"a91186ae-f496-4de1-918d-820c55ff1feb","created":"2019-12-05T03:49:39.187523+0000","modified":"2019-12-05T03:50:01.249305+0000","last_up_change":"2019-12-05T03:49:48.551934+0000","last_in_change":"2019-12-05T03:49:48.551934+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-05T03:49:52.900870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-12-05T03:49:55.801462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-12-05T03:49:58.659250+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"782c4258-e28c-4a11-9d54-3c9c7a36fba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":12192},{"type":"v1","addr":"172.21.15.158:6801","nonce":12192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":12192},{"type":"v1","addr":"172.21.15.158:6803","nonce":12192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":12192},{"type":"v1","addr":"172.21.15.158:6807","nonce":12192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":12192},{"type":"v1","addr":"172.21.15.158:6805","nonce":12192}]},"public_addr":"172.21.15.158:6801/12192","cluster_addr":"172.21.15.158:6803/12192","heartbeat_back_addr":"172.21.15.158:6807/12192","heartbeat_front_addr":"172.21.15.158:6805/12192","state":["exists","up"]},{"osd":1,"uuid":"d4426b21-b666-4158-bf34-a24b14572731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":12193},{"type":"v1","addr":"172.21.15.158:6809","nonce":12193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":12193},{"type":"v1","addr":"172.21.15.158:6811","nonce":12193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":12193},{"type":"v1","addr":"172.21.15.158:6815","nonce":12193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":12193},{"type":"v1","addr":"172.21.15.158:6813","nonce":12193}]},"public_addr":"172.21.15.158:6809/12193","cluster_addr":"172.21.15.158:6811/12193","heartbeat_back_addr":"172.21.15.158:6815/12193","heartbeat_front_addr":"172.21.15.158:6813/12193","state":["exists","up"]},{"osd":2,"uuid":"22680edd-6490-4ab0-bb15-0605830e4cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":12195},{"type":"v1","addr":"172.21.15.158:6825","nonce":12195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":12195},{"type":"v1","addr":"172.21.15.158:6827","nonce":12195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":12195},{"type":"v1","addr":"172.21.15.158:6831","nonce":12195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":12195},{"type":"v1","addr":"172.21.15.158:6829","nonce":12195}]},"public_addr":"172.21.15.158:6825/12195","cluster_addr":"172.21.15.158:6827/12195","heartbeat_back_addr":"172.21.15.158:6831/12195","heartbeat_front_addr":"172.21.15.158:6829/12195","state":["exists","up"]},{"osd":3,"uuid":"7ec999ee-ace8-4ccb-a4f9-6f5d313bbbd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":12194},{"type":"v1","addr":"172.21.15.158:6817","nonce":12194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":12194},{"type":"v1","addr":"172.21.15.158:6819","nonce":12194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":12194},{"type":"v1","addr":"172.21.15.158:6823","nonce":12194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":12194},{"type":"v1","addr":"172.21.15.158:6821","nonce":12194}]},"public_addr":"172.21.15.158:6817/12194","cluster_addr":"172.21.15.158:6819/12194","heartbeat_back_addr":"172.21.15.158:6823/12194","heartbeat_front_addr":"172.21.15.158:6821/12194","state":["exists","up"]},{"osd":4,"uuid":"186e69c4-b69f-4dd1-bb8f-faf759c60484","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":12460},{"type":"v1","addr":"172.21.15.96:6803","nonce":12460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":12460},{"type":"v1","addr":"172.21.15.96:6805","nonce":12460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":12460},{"type":"v1","addr":"172.21.15.96:6809","nonce":12460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":12460},{"type":"v1","addr":"172.21.15.96:6807","nonce":12460}]},"public_addr":"172.21.15.96:6803/12460","cluster_addr":"172.21.15.96:6805/12460","heartbeat_back_addr":"172.21.15.96:6809/12460","heartbeat_front_addr":"172.21.15.96:6807/12460","state":["exists","up"]},{"osd":5,"uuid":"86b658b2-8b40-4cea-8163-305a3982758b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":12461},{"type":"v1","addr":"172.21.15.96:6811","nonce":12461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":12461},{"type":"v1","addr":"172.21.15.96:6813","nonce":12461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":12461},{"type":"v1","addr":"172.21.15.96:6817","nonce":12461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":12461},{"type":"v1","addr":"172.21.15.96:6815","nonce":12461}]},"public_addr":"172.21.15.96:6811/12461","cluster_addr":"172.21.15.96:6813/12461","heartbeat_back_addr":"172.21.15.96:6817/12461","heartbeat_front_addr":"172.21.15.96:6815/12461","state":["exists","up"]},{"osd":6,"uuid":"bdadaea8-9296-4788-bc59-d9c9eb8defdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":12463},{"type":"v1","addr":"172.21.15.96:6827","nonce":12463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":12463},{"type":"v1","addr":"172.21.15.96:6829","nonce":12463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":12463},{"type":"v1","addr":"172.21.15.96:6833","nonce":12463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":12463},{"type":"v1","addr":"172.21.15.96:6831","nonce":12463}]},"public_addr":"172.21.15.96:6827/12463","cluster_addr":"172.21.15.96:6829/12463","heartbeat_back_addr":"172.21.15.96:6833/12463","heartbeat_front_addr":"172.21.15.96:6831/12463","state":["exists","up"]},{"osd":7,"uuid":"c6d71846-d68e-430f-ab72-0fb8ea4bf640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":12462},{"type":"v1","addr":"172.21.15.96:6819","nonce":12462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":12462},{"type":"v1","addr":"172.21.15.96:6821","nonce":12462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":12462},{"type":"v1","addr":"172.21.15.96:6825","nonce":12462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":12462},{"type":"v1","addr":"172.21.15.96:6823","nonce":12462}]},"public_addr":"172.21.15.96:6819/12462","cluster_addr":"172.21.15.96:6821/12462","heartbeat_back_addr":"172.21.15.96:6825/12462","heartbeat_front_addr":"172.21.15.96:6823/12462","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.875762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.900817+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.210347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.133973+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.864697+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.131015+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.237225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.154377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-05T03:50:05.465 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.463+0000 7fa50feb0700 1 -- 172.21.15.158:0/1698244265 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa4f003ac40 msgr2=0x7fa4f003d150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:05.466 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.463+0000 7fa50feb0700 1 --2- 172.21.15.158:0/1698244265 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa4f003ac40 0x7fa4f003d150 crc :-1 s=READY pgs=59 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:05.466 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.463+0000 7fa50feb0700 1 -- 172.21.15.158:0/1698244265 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa508152a80 msgr2=0x7fa50807d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:05.466 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.463+0000 7fa50feb0700 1 --2- 172.21.15.158:0/1698244265 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa508152a80 0x7fa50807d560 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7fa4fc002ef0 tx=0x7fa4fc010860).stop 2019-12-05T03:50:05.466 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.463+0000 7fa50feb0700 1 -- 172.21.15.158:0/1698244265 shutdown_connections 2019-12-05T03:50:05.466 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.463+0000 7fa50feb0700 1 --2- 172.21.15.158:0/1698244265 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa4f003ac40 0x7fa4f003d150 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:05.466 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.463+0000 7fa50feb0700 1 --2- 172.21.15.158:0/1698244265 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa508152a80 0x7fa50807d560 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:05.467 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.463+0000 7fa50feb0700 1 --2- 172.21.15.158:0/1698244265 >> v2:172.21.15.96:3300/0 conn(0x7fa50807b050 0x7fa50807b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:05.467 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.463+0000 7fa50feb0700 1 -- 172.21.15.158:0/1698244265 shutdown_connections 2019-12-05T03:50:05.467 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.463+0000 7fa50feb0700 1 -- 172.21.15.158:0/1698244265 wait complete. 2019-12-05T03:50:05.467 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.463+0000 7fa50feb0700 1 -- 172.21.15.158:0/1698244265 >> 172.21.15.158:0/1698244265 conn(0x7fa50809cf50 msgr2=0x7fa508128740 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:05.477 INFO:tasks.ceph.ceph_manager.ceph:all up! 2019-12-05T03:50:05.478 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-05T03:50:05.573 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.567+0000 7f18e6e90700 1 Processor -- start 2019-12-05T03:50:05.573 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.567+0000 7f18e6e90700 1 -- start start 2019-12-05T03:50:05.573 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.567+0000 7f18e6e90700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f18e009cf60 0x7f18e009a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:05.574 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.567+0000 7f18e6e90700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f18e005a740 0x7f18e0151460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:05.574 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.567+0000 7f18e6e90700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e00accb0 con 0x7f18e01519b0 2019-12-05T03:50:05.574 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.567+0000 7f18e6e90700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e00b1730 con 0x7f18e005a740 2019-12-05T03:50:05.574 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.567+0000 7f18e6e90700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e00b19d0 con 0x7f18e009cf60 2019-12-05T03:50:05.574 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.567+0000 7f18e4c2c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f18e005a740 0x7f18e0151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:05.574 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.567+0000 7f18e4c2c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f18e005a740 0x7f18e0151460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53536/0 (socket says 172.21.15.158:53536) 2019-12-05T03:50:05.574 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.567+0000 7f18e4c2c700 1 -- 172.21.15.158:0/3898930181 learned_addr learned my addr 172.21.15.158:0/3898930181 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:05.575 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.567+0000 7f18e542d700 1 --2- 172.21.15.158:0/3898930181 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f18e009cf60 0x7f18e009a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:05.575 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.567+0000 7f18e4c2c700 1 -- 172.21.15.158:0/3898930181 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f18e009cf60 msgr2=0x7f18e009a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:05.575 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.567+0000 7f18e4c2c700 1 --2- 172.21.15.158:0/3898930181 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f18e009cf60 0x7f18e009a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:05.575 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.567+0000 7f18e4c2c700 1 -- 172.21.15.158:0/3898930181 >> v1:172.21.15.96:6789/0 conn(0x7f18e01519b0 legacy=0x7f18e00b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:05.575 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.567+0000 7f18e4c2c700 1 -- 172.21.15.158:0/3898930181 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e005ab70 con 0x7f18e005a740 2019-12-05T03:50:05.575 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.567+0000 7f18e4c2c700 1 --2- 172.21.15.158:0/3898930181 >> v2:172.21.15.158:3300/0 conn(0x7f18e005a740 0x7f18e0151460 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f18e00b18f0 tx=0x7f18d000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.575 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.571+0000 7f18e4c2c700 1 --2- 172.21.15.158:0/3898930181 >> v2:172.21.15.158:3300/0 conn(0x7f18e005a740 0x7f18e0151460 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f18e00b18f0 tx=0x7f18d000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.576 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.571+0000 7f18e4c2c700 1 --2- 172.21.15.158:0/3898930181 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f18e005a740 0x7f18e0151460 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f18e00b18f0 tx=0x7f18d000fd30).ready entity=mon.1 client_cookie=a6bf35c98bce60fa server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:05.576 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.571+0000 7f18e4c2c700 1 --2- 172.21.15.158:0/3898930181 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f18e005a740 0x7f18e0151460 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f18e00b18f0 tx=0x7f18d000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.576 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.571+0000 7f18d7fff700 1 -- 172.21.15.158:0/3898930181 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18d00113b0 con 0x7f18e005a740 2019-12-05T03:50:05.576 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.571+0000 7f18e4c2c700 1 --2- 172.21.15.158:0/3898930181 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f18e005a740 0x7f18e0151460 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f18e00b18f0 tx=0x7f18d000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.576 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.571+0000 7f18e4c2c700 1 --2- 172.21.15.158:0/3898930181 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f18e005a740 0x7f18e0151460 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f18e00b18f0 tx=0x7f18d000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.577 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.571+0000 7f18d7fff700 1 -- 172.21.15.158:0/3898930181 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d0008bb0 con 0x7f18e005a740 2019-12-05T03:50:05.577 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.571+0000 7f18d7fff700 1 -- 172.21.15.158:0/3898930181 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18d0011990 con 0x7f18e005a740 2019-12-05T03:50:05.577 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.571+0000 7f18e6e90700 1 -- 172.21.15.158:0/3898930181 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f18e005a740 msgr2=0x7f18e0151460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:05.577 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.571+0000 7f18e6e90700 1 --2- 172.21.15.158:0/3898930181 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f18e005a740 0x7f18e0151460 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f18e00b18f0 tx=0x7f18d000fd30).stop 2019-12-05T03:50:05.577 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.571+0000 7f18e6e90700 1 -- 172.21.15.158:0/3898930181 shutdown_connections 2019-12-05T03:50:05.578 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.571+0000 7f18e6e90700 1 --2- 172.21.15.158:0/3898930181 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f18e009cf60 0x7f18e009a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:05.578 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.571+0000 7f18e6e90700 1 --2- 172.21.15.158:0/3898930181 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f18e005a740 0x7f18e0151460 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:05.578 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.571+0000 7f18e6e90700 1 -- 172.21.15.158:0/3898930181 shutdown_connections 2019-12-05T03:50:05.578 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.571+0000 7f18e6e90700 1 -- 172.21.15.158:0/3898930181 wait complete. 2019-12-05T03:50:05.578 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.571+0000 7f18e6e90700 1 -- 172.21.15.158:0/3898930181 >> 172.21.15.158:0/3898930181 conn(0x7f18e00b7e60 msgr2=0x7f18e00b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:05.581 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.575+0000 7f18e6e90700 1 Processor -- start 2019-12-05T03:50:05.581 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.575+0000 7f18e6e90700 1 -- start start 2019-12-05T03:50:05.582 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.575+0000 7f18e6e90700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f18e007ad90 0x7f18e0154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:05.582 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.575+0000 7f18e6e90700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e0154950 con 0x7f18e0132e20 2019-12-05T03:50:05.582 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.575+0000 7f18e6e90700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e0154b80 con 0x7f18e007d3f0 2019-12-05T03:50:05.582 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.575+0000 7f18e6e90700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e0154160 con 0x7f18e007ad90 2019-12-05T03:50:05.582 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.575+0000 7f18e4c2c700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f18e007d3f0 0x7f18e007c520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48322/0 (socket says 172.21.15.158:48322) 2019-12-05T03:50:05.582 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.575+0000 7f18e4c2c700 1 -- 172.21.15.158:0/732736373 learned_addr learned my addr 172.21.15.158:0/732736373 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:05.582 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.575+0000 7f18e5c2e700 1 --2- 172.21.15.158:0/732736373 >> v2:172.21.15.96:3300/0 conn(0x7f18e007ad90 0x7f18e0154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:05.583 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.575+0000 7f18d5ffb700 1 -- 172.21.15.158:0/732736373 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1611824305 0 0) 0x7f18d0008470 con 0x7f18e007d3f0 2019-12-05T03:50:05.583 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.575+0000 7f18d5ffb700 1 -- 172.21.15.158:0/732736373 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18c00030b0 con 0x7f18e007d3f0 2019-12-05T03:50:05.583 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.575+0000 7f18d5ffb700 1 -- 172.21.15.158:0/732736373 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4140299076 0 0) 0x7f18c00030b0 con 0x7f18e007d3f0 2019-12-05T03:50:05.583 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.575+0000 7f18d5ffb700 1 -- 172.21.15.158:0/732736373 --> v1:172.21.15.158:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f18d0008470 con 0x7f18e007d3f0 2019-12-05T03:50:05.583 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.575+0000 7f18d5ffb700 1 -- 172.21.15.158:0/732736373 <== mon.1 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 828730332 0 0) 0x7f18d00113b0 con 0x7f18e007d3f0 2019-12-05T03:50:05.583 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.575+0000 7f18e5c2e700 1 -- 172.21.15.158:0/732736373 >> v1:172.21.15.158:6789/0 conn(0x7f18e007d3f0 legacy=0x7f18e007c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:05.583 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.575+0000 7f18e5c2e700 1 -- 172.21.15.158:0/732736373 >> v1:172.21.15.96:6789/0 conn(0x7f18e0132e20 legacy=0x7f18e01537a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:05.584 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.575+0000 7f18e5c2e700 1 -- 172.21.15.158:0/732736373 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e009a320 con 0x7f18e007ad90 2019-12-05T03:50:05.584 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.575+0000 7f18e5c2e700 1 --2- 172.21.15.158:0/732736373 >> v2:172.21.15.96:3300/0 conn(0x7f18e007ad90 0x7f18e0154400 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f18d8001210 tx=0x7f18d00082d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.584 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.575+0000 7f18e5c2e700 1 --2- 172.21.15.158:0/732736373 >> v2:172.21.15.96:3300/0 conn(0x7f18e007ad90 0x7f18e0154400 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f18d8001210 tx=0x7f18d00082d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.584 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.575+0000 7f18e5c2e700 1 --2- 172.21.15.158:0/732736373 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18e007ad90 0x7f18e0154400 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f18d8001210 tx=0x7f18d00082d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:05.585 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.575+0000 7f18e5c2e700 1 --2- 172.21.15.158:0/732736373 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18e007ad90 0x7f18e0154400 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f18d8001210 tx=0x7f18d00082d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.586 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.575+0000 7f18d5ffb700 1 -- 172.21.15.158:0/732736373 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18d8006ca0 con 0x7f18e007ad90 2019-12-05T03:50:05.586 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.575+0000 7f18e5c2e700 1 --2- 172.21.15.158:0/732736373 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18e007ad90 0x7f18e0154400 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f18d8001210 tx=0x7f18d00082d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.586 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.575+0000 7f18d5ffb700 1 -- 172.21.15.158:0/732736373 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d80068c0 con 0x7f18e007ad90 2019-12-05T03:50:05.586 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.575+0000 7f18e5c2e700 1 --2- 172.21.15.158:0/732736373 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18e007ad90 0x7f18e0154400 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f18d8001210 tx=0x7f18d00082d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.587 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.575+0000 7f18e6e90700 1 -- 172.21.15.158:0/732736373 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e009a5f0 con 0x7f18e007ad90 2019-12-05T03:50:05.587 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.575+0000 7f18d5ffb700 1 -- 172.21.15.158:0/732736373 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18d8002600 con 0x7f18e007ad90 2019-12-05T03:50:05.587 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.575+0000 7f18e6e90700 1 -- 172.21.15.158:0/732736373 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e009ab70 con 0x7f18e007ad90 2019-12-05T03:50:05.587 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.579+0000 7f18e5c2e700 1 --2- 172.21.15.158:0/732736373 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18e007ad90 0x7f18e0154400 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f18d8001210 tx=0x7f18d00082d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.587 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.579+0000 7f18d5ffb700 1 -- 172.21.15.158:0/732736373 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f18d8002960 con 0x7f18e007ad90 2019-12-05T03:50:05.588 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.579+0000 7f18e5c2e700 1 --2- 172.21.15.158:0/732736373 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18e007ad90 0x7f18e0154400 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f18d8001210 tx=0x7f18d00082d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.588 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.579+0000 7f18d5ffb700 1 --2- 172.21.15.158:0/732736373 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f18c003b5d0 0x7f18c003dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:05.588 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.579+0000 7f18d5ffb700 1 -- 172.21.15.158:0/732736373 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f18d804afa0 con 0x7f18e007ad90 2019-12-05T03:50:05.588 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.579+0000 7f18e542d700 1 --2- 172.21.15.158:0/732736373 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f18c003b5d0 0x7f18c003dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:05.589 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.579+0000 7f18e542d700 1 --2- 172.21.15.158:0/732736373 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f18c003b5d0 0x7f18c003dae0 crc :-1 s=READY pgs=60 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:05.589 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.583+0000 7f18e6e90700 1 -- 172.21.15.158:0/732736373 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e00554e0 con 0x7f18e007ad90 2019-12-05T03:50:05.592 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.591+0000 7f18e5c2e700 1 --2- 172.21.15.158:0/732736373 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18e007ad90 0x7f18e0154400 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f18d8001210 tx=0x7f18d00082d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.593 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.591+0000 7f18d5ffb700 1 -- 172.21.15.158:0/732736373 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f18d8032080 con 0x7f18e007ad90 2019-12-05T03:50:05.766 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.763+0000 7f18e6e90700 1 -- 172.21.15.158:0/732736373 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18e0066940 con 0x7f18e007ad90 2019-12-05T03:50:05.768 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.767+0000 7f18e5c2e700 1 --2- 172.21.15.158:0/732736373 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18e007ad90 0x7f18e0154400 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f18d8001210 tx=0x7f18d00082d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.768 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.767+0000 7f18d5ffb700 1 -- 172.21.15.158:0/732736373 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+14933 (secure 0 0 0) 0x7f18d80322e0 con 0x7f18e007ad90 2019-12-05T03:50:05.769 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:05.769 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":23,"fsid":"a91186ae-f496-4de1-918d-820c55ff1feb","created":"2019-12-05T03:49:39.187523+0000","modified":"2019-12-05T03:50:01.249305+0000","last_up_change":"2019-12-05T03:49:48.551934+0000","last_in_change":"2019-12-05T03:49:48.551934+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-05T03:49:52.900870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-12-05T03:49:55.801462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-12-05T03:49:58.659250+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"782c4258-e28c-4a11-9d54-3c9c7a36fba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":12192},{"type":"v1","addr":"172.21.15.158:6801","nonce":12192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":12192},{"type":"v1","addr":"172.21.15.158:6803","nonce":12192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":12192},{"type":"v1","addr":"172.21.15.158:6807","nonce":12192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":12192},{"type":"v1","addr":"172.21.15.158:6805","nonce":12192}]},"public_addr":"172.21.15.158:6801/12192","cluster_addr":"172.21.15.158:6803/12192","heartbeat_back_addr":"172.21.15.158:6807/12192","heartbeat_front_addr":"172.21.15.158:6805/12192","state":["exists","up"]},{"osd":1,"uuid":"d4426b21-b666-4158-bf34-a24b14572731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":12193},{"type":"v1","addr":"172.21.15.158:6809","nonce":12193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":12193},{"type":"v1","addr":"172.21.15.158:6811","nonce":12193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":12193},{"type":"v1","addr":"172.21.15.158:6815","nonce":12193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":12193},{"type":"v1","addr":"172.21.15.158:6813","nonce":12193}]},"public_addr":"172.21.15.158:6809/12193","cluster_addr":"172.21.15.158:6811/12193","heartbeat_back_addr":"172.21.15.158:6815/12193","heartbeat_front_addr":"172.21.15.158:6813/12193","state":["exists","up"]},{"osd":2,"uuid":"22680edd-6490-4ab0-bb15-0605830e4cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":12195},{"type":"v1","addr":"172.21.15.158:6825","nonce":12195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":12195},{"type":"v1","addr":"172.21.15.158:6827","nonce":12195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":12195},{"type":"v1","addr":"172.21.15.158:6831","nonce":12195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":12195},{"type":"v1","addr":"172.21.15.158:6829","nonce":12195}]},"public_addr":"172.21.15.158:6825/12195","cluster_addr":"172.21.15.158:6827/12195","heartbeat_back_addr":"172.21.15.158:6831/12195","heartbeat_front_addr":"172.21.15.158:6829/12195","state":["exists","up"]},{"osd":3,"uuid":"7ec999ee-ace8-4ccb-a4f9-6f5d313bbbd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":12194},{"type":"v1","addr":"172.21.15.158:6817","nonce":12194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":12194},{"type":"v1","addr":"172.21.15.158:6819","nonce":12194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":12194},{"type":"v1","addr":"172.21.15.158:6823","nonce":12194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":12194},{"type":"v1","addr":"172.21.15.158:6821","nonce":12194}]},"public_addr":"172.21.15.158:6817/12194","cluster_addr":"172.21.15.158:6819/12194","heartbeat_back_addr":"172.21.15.158:6823/12194","heartbeat_front_addr":"172.21.15.158:6821/12194","state":["exists","up"]},{"osd":4,"uuid":"186e69c4-b69f-4dd1-bb8f-faf759c60484","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":12460},{"type":"v1","addr":"172.21.15.96:6803","nonce":12460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":12460},{"type":"v1","addr":"172.21.15.96:6805","nonce":12460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":12460},{"type":"v1","addr":"172.21.15.96:6809","nonce":12460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":12460},{"type":"v1","addr":"172.21.15.96:6807","nonce":12460}]},"public_addr":"172.21.15.96:6803/12460","cluster_addr":"172.21.15.96:6805/12460","heartbeat_back_addr":"172.21.15.96:6809/12460","heartbeat_front_addr":"172.21.15.96:6807/12460","state":["exists","up"]},{"osd":5,"uuid":"86b658b2-8b40-4cea-8163-305a3982758b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":12461},{"type":"v1","addr":"172.21.15.96:6811","nonce":12461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":12461},{"type":"v1","addr":"172.21.15.96:6813","nonce":12461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":12461},{"type":"v1","addr":"172.21.15.96:6817","nonce":12461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":12461},{"type":"v1","addr":"172.21.15.96:6815","nonce":12461}]},"public_addr":"172.21.15.96:6811/12461","cluster_addr":"172.21.15.96:6813/12461","heartbeat_back_addr":"172.21.15.96:6817/12461","heartbeat_front_addr":"172.21.15.96:6815/12461","state":["exists","up"]},{"osd":6,"uuid":"bdadaea8-9296-4788-bc59-d9c9eb8defdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":12463},{"type":"v1","addr":"172.21.15.96:6827","nonce":12463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":12463},{"type":"v1","addr":"172.21.15.96:6829","nonce":12463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":12463},{"type":"v1","addr":"172.21.15.96:6833","nonce":12463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":12463},{"type":"v1","addr":"172.21.15.96:6831","nonce":12463}]},"public_addr":"172.21.15.96:6827/12463","cluster_addr":"172.21.15.96:6829/12463","heartbeat_back_addr":"172.21.15.96:6833/12463","heartbeat_front_addr":"172.21.15.96:6831/12463","state":["exists","up"]},{"osd":7,"uuid":"c6d71846-d68e-430f-ab72-0fb8ea4bf640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":12462},{"type":"v1","addr":"172.21.15.96:6819","nonce":12462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":12462},{"type":"v1","addr":"172.21.15.96:6821","nonce":12462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":12462},{"type":"v1","addr":"172.21.15.96:6825","nonce":12462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":12462},{"type":"v1","addr":"172.21.15.96:6823","nonce":12462}]},"public_addr":"172.21.15.96:6819/12462","cluster_addr":"172.21.15.96:6821/12462","heartbeat_back_addr":"172.21.15.96:6825/12462","heartbeat_front_addr":"172.21.15.96:6823/12462","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.875762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.900817+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.210347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.133973+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.864697+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.131015+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.237225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.154377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-05T03:50:05.772 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.767+0000 7f18e6e90700 1 -- 172.21.15.158:0/732736373 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f18c003b5d0 msgr2=0x7f18c003dae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:05.772 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.767+0000 7f18e6e90700 1 --2- 172.21.15.158:0/732736373 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f18c003b5d0 0x7f18c003dae0 crc :-1 s=READY pgs=60 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:05.772 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.767+0000 7f18e6e90700 1 -- 172.21.15.158:0/732736373 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18e007ad90 msgr2=0x7f18e0154400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:05.772 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.767+0000 7f18e6e90700 1 --2- 172.21.15.158:0/732736373 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18e007ad90 0x7f18e0154400 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f18d8001210 tx=0x7f18d00082d0).stop 2019-12-05T03:50:05.772 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.771+0000 7f18e6e90700 1 -- 172.21.15.158:0/732736373 shutdown_connections 2019-12-05T03:50:05.772 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.771+0000 7f18e6e90700 1 --2- 172.21.15.158:0/732736373 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18e007ad90 0x7f18e0154400 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:05.772 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.771+0000 7f18e6e90700 1 --2- 172.21.15.158:0/732736373 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f18c003b5d0 0x7f18c003dae0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:05.773 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.771+0000 7f18e6e90700 1 -- 172.21.15.158:0/732736373 shutdown_connections 2019-12-05T03:50:05.773 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.771+0000 7f18e6e90700 1 -- 172.21.15.158:0/732736373 wait complete. 2019-12-05T03:50:05.773 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.771+0000 7f18e6e90700 1 -- 172.21.15.158:0/732736373 >> 172.21.15.158:0/732736373 conn(0x7f18e0155320 msgr2=0x7f18e00b2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:05.783 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2019-12-05T03:50:05.882 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.875+0000 7f790784b700 1 Processor -- start 2019-12-05T03:50:05.882 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.875+0000 7f790784b700 1 -- start start 2019-12-05T03:50:05.882 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.875+0000 7f790784b700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f790009a320 0x7f790005a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:05.883 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.875+0000 7f790784b700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79000accb0 con 0x7f79001553b0 2019-12-05T03:50:05.883 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.875+0000 7f790784b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79000b6980 con 0x7f790009cf60 2019-12-05T03:50:05.883 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.875+0000 7f790784b700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f790009a750 con 0x7f790009a320 2019-12-05T03:50:05.883 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.875+0000 7f7905de8700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f790009cf60 0x7f7900151460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48328/0 (socket says 172.21.15.158:48328) 2019-12-05T03:50:05.884 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.875+0000 7f7905de8700 1 -- 172.21.15.158:0/2781845785 learned_addr learned my addr 172.21.15.158:0/2781845785 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:05.884 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.875+0000 7f79055e7700 1 --2- 172.21.15.158:0/2781845785 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f790009a320 0x7f790005a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:05.884 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.875+0000 7f7904de6700 1 -- 172.21.15.158:0/2781845785 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1077251585 0 0) 0x7f79000b6980 con 0x7f790009cf60 2019-12-05T03:50:05.884 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.875+0000 7f7904de6700 1 -- 172.21.15.158:0/2781845785 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78ec0030b0 con 0x7f790009cf60 2019-12-05T03:50:05.884 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.875+0000 7f7904de6700 1 -- 172.21.15.158:0/2781845785 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 493557765 0 0) 0x7f79000accb0 con 0x7f79001553b0 2019-12-05T03:50:05.885 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.875+0000 7f7904de6700 1 -- 172.21.15.158:0/2781845785 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79000b6980 con 0x7f79001553b0 2019-12-05T03:50:05.885 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.875+0000 7f7904de6700 1 -- 172.21.15.158:0/2781845785 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 577685095 0 0) 0x7f78ec0030b0 con 0x7f790009cf60 2019-12-05T03:50:05.885 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.875+0000 7f7904de6700 1 -- 172.21.15.158:0/2781845785 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f790009a320 msgr2=0x7f790005a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:05.885 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.875+0000 7f7904de6700 1 --2- 172.21.15.158:0/2781845785 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f790009a320 0x7f790005a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:05.886 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.875+0000 7f7904de6700 1 -- 172.21.15.158:0/2781845785 >> v1:172.21.15.96:6789/0 conn(0x7f79001553b0 legacy=0x7f79001557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:05.886 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.875+0000 7f7904de6700 1 -- 172.21.15.158:0/2781845785 --> v1:172.21.15.158:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7900155fe0 con 0x7f790009cf60 2019-12-05T03:50:05.886 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.875+0000 7f7904de6700 1 -- 172.21.15.158:0/2781845785 <== mon.1 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 828730332 0 0) 0x7f78fc001750 con 0x7f790009cf60 2019-12-05T03:50:05.886 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.875+0000 7f7904de6700 1 -- 172.21.15.158:0/2781845785 >> v1:172.21.15.158:6789/0 conn(0x7f790009cf60 legacy=0x7f7900151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:05.887 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.875+0000 7f7904de6700 1 --2- 172.21.15.158:0/2781845785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78ec003940 0x7f78ec003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:05.887 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.875+0000 7f7904de6700 1 --2- 172.21.15.158:0/2781845785 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f78ec004470 0x7f78ec004920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:05.887 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.875+0000 7f7904de6700 1 --2- 172.21.15.158:0/2781845785 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f78ec004f80 0x7f78ec04f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:05.887 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.875+0000 7f79055e7700 1 --2- 172.21.15.158:0/2781845785 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f78ec004470 0x7f78ec004920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:05.887 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.875+0000 7f7904de6700 1 -- 172.21.15.158:0/2781845785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790009a750 con 0x7f78ec003940 2019-12-05T03:50:05.888 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.875+0000 7f7904de6700 1 -- 172.21.15.158:0/2781845785 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec04fc00 con 0x7f78ec004470 2019-12-05T03:50:05.888 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.875+0000 7f7904de6700 1 -- 172.21.15.158:0/2781845785 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec04fe40 con 0x7f78ec004f80 2019-12-05T03:50:05.888 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.875+0000 7f7905de8700 1 --2- 172.21.15.158:0/2781845785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78ec003940 0x7f78ec003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:05.888 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.879+0000 7f79065e9700 1 --2- 172.21.15.158:0/2781845785 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f78ec004f80 0x7f78ec04f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:05.888 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.879+0000 7f79055e7700 1 -- 172.21.15.158:0/2781845785 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f78ec004f80 msgr2=0x7f78ec04f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:05.888 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.879+0000 7f79055e7700 1 --2- 172.21.15.158:0/2781845785 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f78ec004f80 0x7f78ec04f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:05.888 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.879+0000 7f79055e7700 1 -- 172.21.15.158:0/2781845785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78ec003940 msgr2=0x7f78ec003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:05.889 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.879+0000 7f79055e7700 1 --2- 172.21.15.158:0/2781845785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78ec003940 0x7f78ec003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:05.889 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.879+0000 7f79055e7700 1 -- 172.21.15.158:0/2781845785 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ec050140 con 0x7f78ec004470 2019-12-05T03:50:05.889 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.879+0000 7f7905de8700 1 --2- 172.21.15.158:0/2781845785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78ec003940 0x7f78ec003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-12-05T03:50:05.889 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.879+0000 7f79055e7700 1 --2- 172.21.15.158:0/2781845785 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f78ec004470 0x7f78ec004920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f78f0002f30 tx=0x7f78f000ffd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.889 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.879+0000 7f79055e7700 1 --2- 172.21.15.158:0/2781845785 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f78ec004470 0x7f78ec004920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f78f0002f30 tx=0x7f78f000ffd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.889 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.879+0000 7f79055e7700 1 --2- 172.21.15.158:0/2781845785 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f78ec004470 0x7f78ec004920 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7f78f0002f30 tx=0x7f78f000ffd0).ready entity=mon.1 client_cookie=9e32d755bee5aead server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:05.889 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.879+0000 7f79055e7700 1 --2- 172.21.15.158:0/2781845785 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f78ec004470 0x7f78ec004920 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f78f0002f30 tx=0x7f78f000ffd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.890 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.879+0000 7f79055e7700 1 --2- 172.21.15.158:0/2781845785 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f78ec004470 0x7f78ec004920 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f78f0002f30 tx=0x7f78f000ffd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.890 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.879+0000 7f7904de6700 1 -- 172.21.15.158:0/2781845785 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78f0010d00 con 0x7f78ec004470 2019-12-05T03:50:05.890 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.879+0000 7f79055e7700 1 --2- 172.21.15.158:0/2781845785 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f78ec004470 0x7f78ec004920 secure :-1 s=THROTTLE_DONE pgs=104 cs=0 l=1 rx=0x7f78f0002f30 tx=0x7f78f000ffd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.890 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.879+0000 7f7904de6700 1 -- 172.21.15.158:0/2781845785 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f0010920 con 0x7f78ec004470 2019-12-05T03:50:05.890 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.879+0000 7f7904de6700 1 -- 172.21.15.158:0/2781845785 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78f0008bb0 con 0x7f78ec004470 2019-12-05T03:50:05.890 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.879+0000 7f790784b700 1 -- 172.21.15.158:0/2781845785 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f78ec004470 msgr2=0x7f78ec004920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:05.890 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.879+0000 7f790784b700 1 --2- 172.21.15.158:0/2781845785 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f78ec004470 0x7f78ec004920 secure :-1 s=READY pgs=104 cs=0 l=1 rx=0x7f78f0002f30 tx=0x7f78f000ffd0).stop 2019-12-05T03:50:05.890 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.879+0000 7f79065e9700 1 -- 172.21.15.158:0/2781845785 reap_dead start 2019-12-05T03:50:05.891 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.879+0000 7f790784b700 1 -- 172.21.15.158:0/2781845785 shutdown_connections 2019-12-05T03:50:05.891 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.879+0000 7f790784b700 1 -- 172.21.15.158:0/2781845785 shutdown_connections 2019-12-05T03:50:05.891 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.879+0000 7f790784b700 1 -- 172.21.15.158:0/2781845785 wait complete. 2019-12-05T03:50:05.891 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.879+0000 7f790784b700 1 -- 172.21.15.158:0/2781845785 >> 172.21.15.158:0/2781845785 conn(0x7f79000b7e60 msgr2=0x7f79000b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:05.895 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.879+0000 7f790784b700 1 Processor -- start 2019-12-05T03:50:05.895 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.879+0000 7f790784b700 1 -- start start 2019-12-05T03:50:05.895 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.883+0000 7f790784b700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f790007b530 0x7f790013d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:05.895 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.883+0000 7f790784b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f790005f5b0 0x7f790005f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:05.896 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.883+0000 7f790784b700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7900142080 con 0x7f79001314c0 2019-12-05T03:50:05.896 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.883+0000 7f790784b700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7900141de0 con 0x7f790007b530 2019-12-05T03:50:05.896 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.883+0000 7f790784b700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7900131d40 con 0x7f790005f5b0 2019-12-05T03:50:05.896 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.883+0000 7f79065e9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f790005f5b0 0x7f790005f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:05.896 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.883+0000 7f79065e9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f790005f5b0 0x7f790005f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53564/0 (socket says 172.21.15.158:53564) 2019-12-05T03:50:05.896 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.883+0000 7f79065e9700 1 -- 172.21.15.158:0/296756901 learned_addr learned my addr 172.21.15.158:0/296756901 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:05.897 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.883+0000 7f7905de8700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f790007b530 0x7f790013d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:05.897 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.883+0000 7f79065e9700 1 -- 172.21.15.158:0/296756901 >> v2:172.21.15.96:3300/0 conn(0x7f790007b530 msgr2=0x7f790013d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:05.897 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.883+0000 7f79065e9700 1 --2- 172.21.15.158:0/296756901 >> v2:172.21.15.96:3300/0 conn(0x7f790007b530 0x7f790013d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:05.897 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.883+0000 7f79065e9700 1 -- 172.21.15.158:0/296756901 >> v1:172.21.15.96:6789/0 conn(0x7f79001314c0 legacy=0x7f79000b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:05.897 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.883+0000 7f78f67fc700 1 -- 172.21.15.158:0/296756901 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2176532746 0 0) 0x7f7900142080 con 0x7f79001314c0 2019-12-05T03:50:05.897 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.883+0000 7f79065e9700 1 -- 172.21.15.158:0/296756901 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7900131fe0 con 0x7f790005f5b0 2019-12-05T03:50:05.898 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.883+0000 7f79065e9700 1 --2- 172.21.15.158:0/296756901 >> v2:172.21.15.158:3300/0 conn(0x7f790005f5b0 0x7f790005f9e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f78f8001550 tx=0x7f78f8010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.898 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.883+0000 7f79065e9700 1 --2- 172.21.15.158:0/296756901 >> v2:172.21.15.158:3300/0 conn(0x7f790005f5b0 0x7f790005f9e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f78f8001550 tx=0x7f78f8010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.898 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.883+0000 7f79065e9700 1 --2- 172.21.15.158:0/296756901 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f790005f5b0 0x7f790005f9e0 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7f78f8001550 tx=0x7f78f8010b60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:05.898 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.883+0000 7f79065e9700 1 --2- 172.21.15.158:0/296756901 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f790005f5b0 0x7f790005f9e0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f78f8001550 tx=0x7f78f8010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.898 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.883+0000 7f78f67fc700 1 -- 172.21.15.158:0/296756901 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78f8006ac0 con 0x7f790005f5b0 2019-12-05T03:50:05.898 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.883+0000 7f79065e9700 1 --2- 172.21.15.158:0/296756901 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f790005f5b0 0x7f790005f9e0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f78f8001550 tx=0x7f78f8010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.898 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.883+0000 7f78f67fc700 1 -- 172.21.15.158:0/296756901 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f80066e0 con 0x7f790005f5b0 2019-12-05T03:50:05.899 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.883+0000 7f79065e9700 1 --2- 172.21.15.158:0/296756901 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f790005f5b0 0x7f790005f9e0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f78f8001550 tx=0x7f78f8010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.899 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.883+0000 7f790784b700 1 -- 172.21.15.158:0/296756901 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f790005ff30 con 0x7f790005f5b0 2019-12-05T03:50:05.899 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.883+0000 7f78f67fc700 1 -- 172.21.15.158:0/296756901 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78f8002730 con 0x7f790005f5b0 2019-12-05T03:50:05.899 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.883+0000 7f790784b700 1 -- 172.21.15.158:0/296756901 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79000604b0 con 0x7f790005f5b0 2019-12-05T03:50:05.899 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.883+0000 7f79065e9700 1 --2- 172.21.15.158:0/296756901 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f790005f5b0 0x7f790005f9e0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f78f8001550 tx=0x7f78f8010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.899 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.883+0000 7f78f67fc700 1 -- 172.21.15.158:0/296756901 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f78f8002930 con 0x7f790005f5b0 2019-12-05T03:50:05.899 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.883+0000 7f79065e9700 1 --2- 172.21.15.158:0/296756901 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f790005f5b0 0x7f790005f9e0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f78f8001550 tx=0x7f78f8010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:05.900 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.883+0000 7f78f67fc700 1 --2- 172.21.15.158:0/296756901 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f78e803ac70 0x7f78e803d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:05.900 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.883+0000 7f78f67fc700 1 -- 172.21.15.158:0/296756901 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f78f804af10 con 0x7f790005f5b0 2019-12-05T03:50:05.900 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.883+0000 7f7905de8700 1 --2- 172.21.15.158:0/296756901 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f78e803ac70 0x7f78e803d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:05.900 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.887+0000 7f7905de8700 1 --2- 172.21.15.158:0/296756901 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f78e803ac70 0x7f78e803d180 crc :-1 s=READY pgs=61 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:05.900 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.887+0000 7f790784b700 1 --2- 172.21.15.158:0/296756901 >> [v2:172.21.15.158:6800/12192,v1:172.21.15.158:6801/12192] conn(0x7f7900054260 0x7f7900054690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:05.900 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.887+0000 7f790784b700 1 -- 172.21.15.158:0/296756901 --> [v2:172.21.15.158:6800/12192,v1:172.21.15.158:6801/12192] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f79000554e0 con 0x7f7900054260 2019-12-05T03:50:05.900 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.887+0000 7f79055e7700 1 --2- 172.21.15.158:0/296756901 >> [v2:172.21.15.158:6800/12192,v1:172.21.15.158:6801/12192] conn(0x7f7900054260 0x7f7900054690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:05.901 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.887+0000 7f79055e7700 1 --2- 172.21.15.158:0/296756901 >> [v2:172.21.15.158:6800/12192,v1:172.21.15.158:6801/12192] conn(0x7f7900054260 0x7f7900054690 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:05.901 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.891+0000 7f78f67fc700 1 -- 172.21.15.158:0/296756901 <== osd.0 v2:172.21.15.158:6800/12192 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23014 (crc 0 0 0) 0x7f79000554e0 con 0x7f7900054260 2019-12-05T03:50:05.914 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.911+0000 7f790784b700 1 -- 172.21.15.158:0/296756901 --> [v2:172.21.15.158:6800/12192,v1:172.21.15.158:6801/12192] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7900066940 con 0x7f7900054260 2019-12-05T03:50:05.915 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.911+0000 7f78f67fc700 1 -- 172.21.15.158:0/296756901 <== osd.0 v2:172.21.15.158:6800/12192 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7900066940 con 0x7f7900054260 2019-12-05T03:50:05.917 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.915+0000 7f790784b700 1 -- 172.21.15.158:0/296756901 >> [v2:172.21.15.158:6800/12192,v1:172.21.15.158:6801/12192] conn(0x7f7900054260 msgr2=0x7f7900054690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:05.917 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.915+0000 7f790784b700 1 --2- 172.21.15.158:0/296756901 >> [v2:172.21.15.158:6800/12192,v1:172.21.15.158:6801/12192] conn(0x7f7900054260 0x7f7900054690 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:05.918 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.915+0000 7f790784b700 1 -- 172.21.15.158:0/296756901 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f78e803ac70 msgr2=0x7f78e803d180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:05.918 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.915+0000 7f790784b700 1 --2- 172.21.15.158:0/296756901 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f78e803ac70 0x7f78e803d180 crc :-1 s=READY pgs=61 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:05.918 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.915+0000 7f790784b700 1 -- 172.21.15.158:0/296756901 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f790005f5b0 msgr2=0x7f790005f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:05.918 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.915+0000 7f790784b700 1 --2- 172.21.15.158:0/296756901 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f790005f5b0 0x7f790005f9e0 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7f78f8001550 tx=0x7f78f8010b60).stop 2019-12-05T03:50:05.919 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.915+0000 7f79065e9700 1 -- 172.21.15.158:0/296756901 reap_dead start 2019-12-05T03:50:05.919 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.915+0000 7f790784b700 1 -- 172.21.15.158:0/296756901 shutdown_connections 2019-12-05T03:50:05.919 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.915+0000 7f790784b700 1 --2- 172.21.15.158:0/296756901 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f790005f5b0 0x7f790005f9e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:05.919 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.915+0000 7f790784b700 1 -- 172.21.15.158:0/296756901 shutdown_connections 2019-12-05T03:50:05.919 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.915+0000 7f790784b700 1 -- 172.21.15.158:0/296756901 wait complete. 2019-12-05T03:50:05.920 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:05.915+0000 7f790784b700 1 -- 172.21.15.158:0/296756901 >> 172.21.15.158:0/296756901 conn(0x7f79000b53c0 msgr2=0x7f79000b5900 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:05.926 INFO:teuthology.orchestra.run.smithi158.stdout:55834574854 2019-12-05T03:50:05.926 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2019-12-05T03:50:06.029 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.023+0000 7fd3da32c700 1 Processor -- start 2019-12-05T03:50:06.029 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.023+0000 7fd3da32c700 1 -- start start 2019-12-05T03:50:06.029 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.023+0000 7fd3da32c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd3d409cf50 0x7fd3d409a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:06.029 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.023+0000 7fd3da32c700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3d40acca0 con 0x7fd3d405a730 2019-12-05T03:50:06.029 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.023+0000 7fd3da32c700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3d40b6970 con 0x7fd3d41553a0 2019-12-05T03:50:06.030 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.023+0000 7fd3da32c700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3d40b1720 con 0x7fd3d409cf50 2019-12-05T03:50:06.030 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.023+0000 7fd3d88c9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd3d409cf50 0x7fd3d409a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.030 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.023+0000 7fd3d90ca700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fd3d41553a0 0x7fd3d41557d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48354/0 (socket says 172.21.15.158:48354) 2019-12-05T03:50:06.030 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.023+0000 7fd3d90ca700 1 -- 172.21.15.158:0/3337847593 learned_addr learned my addr 172.21.15.158:0/3337847593 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:06.030 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.023+0000 7fd3d88c9700 1 -- 172.21.15.158:0/3337847593 >> v1:172.21.15.158:6789/0 conn(0x7fd3d41553a0 legacy=0x7fd3d41557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.030 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.023+0000 7fd3d88c9700 1 -- 172.21.15.158:0/3337847593 >> v1:172.21.15.96:6789/0 conn(0x7fd3d405a730 legacy=0x7fd3d4151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.030 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.023+0000 7fd3d37fe700 1 -- 172.21.15.158:0/3337847593 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 570381374 0 0) 0x7fd3d40acca0 con 0x7fd3d405a730 2019-12-05T03:50:06.031 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.023+0000 7fd3d88c9700 1 -- 172.21.15.158:0/3337847593 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d405ab60 con 0x7fd3d409cf50 2019-12-05T03:50:06.031 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.023+0000 7fd3d88c9700 1 --2- 172.21.15.158:0/3337847593 >> v2:172.21.15.158:3300/0 conn(0x7fd3d409cf50 0x7fd3d409a310 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd3d409c730 tx=0x7fd3c400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.031 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.023+0000 7fd3d88c9700 1 --2- 172.21.15.158:0/3337847593 >> v2:172.21.15.158:3300/0 conn(0x7fd3d409cf50 0x7fd3d409a310 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd3d409c730 tx=0x7fd3c400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.031 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.023+0000 7fd3d88c9700 1 --2- 172.21.15.158:0/3337847593 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3d409cf50 0x7fd3d409a310 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7fd3d409c730 tx=0x7fd3c400fbf0).ready entity=mon.1 client_cookie=2d01c9a6ecb570bd server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:06.031 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.023+0000 7fd3d88c9700 1 --2- 172.21.15.158:0/3337847593 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3d409cf50 0x7fd3d409a310 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7fd3d409c730 tx=0x7fd3c400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.031 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.023+0000 7fd3d37fe700 1 -- 172.21.15.158:0/3337847593 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3c4011270 con 0x7fd3d409cf50 2019-12-05T03:50:06.031 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.023+0000 7fd3d88c9700 1 --2- 172.21.15.158:0/3337847593 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3d409cf50 0x7fd3d409a310 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7fd3d409c730 tx=0x7fd3c400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.032 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.023+0000 7fd3d37fe700 1 -- 172.21.15.158:0/3337847593 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c4008bc0 con 0x7fd3d409cf50 2019-12-05T03:50:06.032 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.023+0000 7fd3d88c9700 1 --2- 172.21.15.158:0/3337847593 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3d409cf50 0x7fd3d409a310 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7fd3d409c730 tx=0x7fd3c400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.032 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.023+0000 7fd3da32c700 1 -- 172.21.15.158:0/3337847593 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3d409cf50 msgr2=0x7fd3d409a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.032 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.023+0000 7fd3d37fe700 1 -- 172.21.15.158:0/3337847593 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3c4011850 con 0x7fd3d409cf50 2019-12-05T03:50:06.032 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.023+0000 7fd3da32c700 1 --2- 172.21.15.158:0/3337847593 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3d409cf50 0x7fd3d409a310 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7fd3d409c730 tx=0x7fd3c400fbf0).stop 2019-12-05T03:50:06.032 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.027+0000 7fd3da32c700 1 -- 172.21.15.158:0/3337847593 shutdown_connections 2019-12-05T03:50:06.032 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.027+0000 7fd3da32c700 1 --2- 172.21.15.158:0/3337847593 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3d409cf50 0x7fd3d409a310 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:06.033 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.027+0000 7fd3da32c700 1 -- 172.21.15.158:0/3337847593 shutdown_connections 2019-12-05T03:50:06.033 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.027+0000 7fd3da32c700 1 -- 172.21.15.158:0/3337847593 wait complete. 2019-12-05T03:50:06.033 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.027+0000 7fd3da32c700 1 -- 172.21.15.158:0/3337847593 >> 172.21.15.158:0/3337847593 conn(0x7fd3d40b7e50 msgr2=0x7fd3d40b3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:06.036 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.027+0000 7fd3da32c700 1 Processor -- start 2019-12-05T03:50:06.036 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.027+0000 7fd3da32c700 1 -- start start 2019-12-05T03:50:06.036 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.027+0000 7fd3da32c700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd3d4139c00 0x7fd3d412db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:06.036 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.027+0000 7fd3da32c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd3d4138ee0 0x7fd3d407cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:06.037 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.027+0000 7fd3da32c700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd3d407ac40 0x7fd3d407b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:06.037 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.027+0000 7fd3da32c700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3d407d5e0 con 0x7fd3d4139c00 2019-12-05T03:50:06.037 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.031+0000 7fd3da32c700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3d4139420 con 0x7fd3d4138ee0 2019-12-05T03:50:06.037 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.031+0000 7fd3da32c700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d41396c0 con 0x7fd3d407ac40 2019-12-05T03:50:06.037 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.031+0000 7fd3d3fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd3d4138ee0 0x7fd3d407cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.037 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.031+0000 7fd3d88c9700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd3d4139c00 0x7fd3d412db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.037 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.031+0000 7fd3d3fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd3d4138ee0 0x7fd3d407cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53578/0 (socket says 172.21.15.158:53578) 2019-12-05T03:50:06.038 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.031+0000 7fd3d3fff700 1 -- 172.21.15.158:0/3082649413 learned_addr learned my addr 172.21.15.158:0/3082649413 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:06.038 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.031+0000 7fd3d90ca700 1 --2- 172.21.15.158:0/3082649413 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd3d407ac40 0x7fd3d407b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.038 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.031+0000 7fd3d3fff700 1 -- 172.21.15.158:0/3082649413 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd3d407ac40 msgr2=0x7fd3d407b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.038 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.031+0000 7fd3d3fff700 1 --2- 172.21.15.158:0/3082649413 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd3d407ac40 0x7fd3d407b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:06.038 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.031+0000 7fd3d3fff700 1 -- 172.21.15.158:0/3082649413 >> v2:172.21.15.96:3300/0 conn(0x7fd3d4139c00 msgr2=0x7fd3d412db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.038 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.031+0000 7fd3d3fff700 1 --2- 172.21.15.158:0/3082649413 >> v2:172.21.15.96:3300/0 conn(0x7fd3d4139c00 0x7fd3d412db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:06.038 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.031+0000 7fd3d3fff700 1 -- 172.21.15.158:0/3082649413 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d407b5c0 con 0x7fd3d4138ee0 2019-12-05T03:50:06.039 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.031+0000 7fd3d3fff700 1 --2- 172.21.15.158:0/3082649413 >> v2:172.21.15.158:3300/0 conn(0x7fd3d4138ee0 0x7fd3d407cf30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd3d41395e0 tx=0x7fd3bc012fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.039 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.031+0000 7fd3d3fff700 1 --2- 172.21.15.158:0/3082649413 >> v2:172.21.15.158:3300/0 conn(0x7fd3d4138ee0 0x7fd3d407cf30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd3d41395e0 tx=0x7fd3bc012fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.039 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.031+0000 7fd3d3fff700 1 --2- 172.21.15.158:0/3082649413 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3d4138ee0 0x7fd3d407cf30 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7fd3d41395e0 tx=0x7fd3bc012fb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:06.039 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.031+0000 7fd3d3fff700 1 --2- 172.21.15.158:0/3082649413 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3d4138ee0 0x7fd3d407cf30 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7fd3d41395e0 tx=0x7fd3bc012fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.039 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.031+0000 7fd3d3fff700 1 --2- 172.21.15.158:0/3082649413 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3d4138ee0 0x7fd3d407cf30 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7fd3d41395e0 tx=0x7fd3bc012fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.039 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.031+0000 7fd3d3fff700 1 --2- 172.21.15.158:0/3082649413 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3d4138ee0 0x7fd3d407cf30 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7fd3d41395e0 tx=0x7fd3bc012fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.039 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.031+0000 7fd3d17fa700 1 -- 172.21.15.158:0/3082649413 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3bc00ca40 con 0x7fd3d4138ee0 2019-12-05T03:50:06.040 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.031+0000 7fd3d17fa700 1 -- 172.21.15.158:0/3082649413 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3bc0101c0 con 0x7fd3d4138ee0 2019-12-05T03:50:06.040 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.031+0000 7fd3da32c700 1 -- 172.21.15.158:0/3082649413 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3d413c4a0 con 0x7fd3d4138ee0 2019-12-05T03:50:06.040 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.031+0000 7fd3d17fa700 1 -- 172.21.15.158:0/3082649413 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3bc0147e0 con 0x7fd3d4138ee0 2019-12-05T03:50:06.040 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.031+0000 7fd3da32c700 1 -- 172.21.15.158:0/3082649413 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3d413c9d0 con 0x7fd3d4138ee0 2019-12-05T03:50:06.040 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.031+0000 7fd3d3fff700 1 --2- 172.21.15.158:0/3082649413 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3d4138ee0 0x7fd3d407cf30 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7fd3d41395e0 tx=0x7fd3bc012fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.040 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.031+0000 7fd3d17fa700 1 -- 172.21.15.158:0/3082649413 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fd3bc0149e0 con 0x7fd3d4138ee0 2019-12-05T03:50:06.040 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.031+0000 7fd3d3fff700 1 --2- 172.21.15.158:0/3082649413 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3d4138ee0 0x7fd3d407cf30 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7fd3d41395e0 tx=0x7fd3bc012fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.041 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.031+0000 7fd3d17fa700 1 --2- 172.21.15.158:0/3082649413 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd3b803ad40 0x7fd3b803d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:06.041 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.031+0000 7fd3d17fa700 1 -- 172.21.15.158:0/3082649413 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fd3bc04d2d0 con 0x7fd3d4138ee0 2019-12-05T03:50:06.041 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.035+0000 7fd3d88c9700 1 --2- 172.21.15.158:0/3082649413 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd3b803ad40 0x7fd3b803d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.041 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.035+0000 7fd3d88c9700 1 --2- 172.21.15.158:0/3082649413 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd3b803ad40 0x7fd3b803d250 crc :-1 s=READY pgs=62 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:06.042 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.039+0000 7fd3da32c700 1 --2- 172.21.15.158:0/3082649413 >> [v2:172.21.15.158:6808/12193,v1:172.21.15.158:6809/12193] conn(0x7fd3d409a930 0x7fd3d409ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:06.042 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.039+0000 7fd3da32c700 1 -- 172.21.15.158:0/3082649413 --> [v2:172.21.15.158:6808/12193,v1:172.21.15.158:6809/12193] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd3d40554d0 con 0x7fd3d409a930 2019-12-05T03:50:06.042 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.039+0000 7fd3d90ca700 1 --2- 172.21.15.158:0/3082649413 >> [v2:172.21.15.158:6808/12193,v1:172.21.15.158:6809/12193] conn(0x7fd3d409a930 0x7fd3d409ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.042 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.039+0000 7fd3d90ca700 1 --2- 172.21.15.158:0/3082649413 >> [v2:172.21.15.158:6808/12193,v1:172.21.15.158:6809/12193] conn(0x7fd3d409a930 0x7fd3d409ad60 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:06.042 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.039+0000 7fd3d17fa700 1 -- 172.21.15.158:0/3082649413 <== osd.1 v2:172.21.15.158:6808/12193 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23014 (crc 0 0 0) 0x7fd3d40554d0 con 0x7fd3d409a930 2019-12-05T03:50:06.068 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.067+0000 7fd3da32c700 1 -- 172.21.15.158:0/3082649413 --> [v2:172.21.15.158:6808/12193,v1:172.21.15.158:6809/12193] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd3d405a940 con 0x7fd3d409a930 2019-12-05T03:50:06.069 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.067+0000 7fd3d17fa700 1 -- 172.21.15.158:0/3082649413 <== osd.1 v2:172.21.15.158:6808/12193 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd3d405a940 con 0x7fd3d409a930 2019-12-05T03:50:06.070 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.067+0000 7fd3da32c700 1 -- 172.21.15.158:0/3082649413 >> [v2:172.21.15.158:6808/12193,v1:172.21.15.158:6809/12193] conn(0x7fd3d409a930 msgr2=0x7fd3d409ad60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.070 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.067+0000 7fd3da32c700 1 --2- 172.21.15.158:0/3082649413 >> [v2:172.21.15.158:6808/12193,v1:172.21.15.158:6809/12193] conn(0x7fd3d409a930 0x7fd3d409ad60 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:06.071 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.067+0000 7fd3da32c700 1 -- 172.21.15.158:0/3082649413 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd3b803ad40 msgr2=0x7fd3b803d250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.071 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.067+0000 7fd3da32c700 1 --2- 172.21.15.158:0/3082649413 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd3b803ad40 0x7fd3b803d250 crc :-1 s=READY pgs=62 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:06.071 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.067+0000 7fd3da32c700 1 -- 172.21.15.158:0/3082649413 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3d4138ee0 msgr2=0x7fd3d407cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.071 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.067+0000 7fd3da32c700 1 --2- 172.21.15.158:0/3082649413 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3d4138ee0 0x7fd3d407cf30 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7fd3d41395e0 tx=0x7fd3bc012fb0).stop 2019-12-05T03:50:06.072 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.067+0000 7fd3d90ca700 1 -- 172.21.15.158:0/3082649413 reap_dead start 2019-12-05T03:50:06.072 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.067+0000 7fd3da32c700 1 -- 172.21.15.158:0/3082649413 shutdown_connections 2019-12-05T03:50:06.072 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.067+0000 7fd3da32c700 1 --2- 172.21.15.158:0/3082649413 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd3d4138ee0 0x7fd3d407cf30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:06.072 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.067+0000 7fd3da32c700 1 -- 172.21.15.158:0/3082649413 shutdown_connections 2019-12-05T03:50:06.072 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.067+0000 7fd3da32c700 1 -- 172.21.15.158:0/3082649413 wait complete. 2019-12-05T03:50:06.072 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.067+0000 7fd3da32c700 1 -- 172.21.15.158:0/3082649413 >> 172.21.15.158:0/3082649413 conn(0x7fd3d40b7e50 msgr2=0x7fd3d407e190 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:06.086 INFO:teuthology.orchestra.run.smithi158.stdout:55834574853 2019-12-05T03:50:06.086 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2019-12-05T03:50:06.192 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.183+0000 7f307aea2700 1 Processor -- start 2019-12-05T03:50:06.192 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.183+0000 7f307aea2700 1 -- start start 2019-12-05T03:50:06.192 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.183+0000 7f307aea2700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f307409cf60 0x7f307409a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:06.192 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.183+0000 7f307aea2700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f30741553b0 0x7f30741557e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:06.192 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.183+0000 7f307aea2700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30740accb0 con 0x7f307405a740 2019-12-05T03:50:06.193 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.183+0000 7f307aea2700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30740b1730 con 0x7f307409cf60 2019-12-05T03:50:06.193 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.183+0000 7f307aea2700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30740b19d0 con 0x7f30741553b0 2019-12-05T03:50:06.193 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.183+0000 7f3079c40700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f30741553b0 0x7f30741557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.193 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.183+0000 7f3078c3e700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f307405a740 0x7f3074151460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48368/0 (socket says 172.21.15.158:48368) 2019-12-05T03:50:06.193 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.183+0000 7f3078c3e700 1 -- 172.21.15.158:0/188496094 learned_addr learned my addr 172.21.15.158:0/188496094 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:06.193 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.183+0000 7f307943f700 1 --2- 172.21.15.158:0/188496094 >> v2:172.21.15.96:3300/0 conn(0x7f307409cf60 0x7f307409a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.194 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.187+0000 7f3079c40700 1 -- 172.21.15.158:0/188496094 >> v2:172.21.15.96:3300/0 conn(0x7f307409cf60 msgr2=0x7f307409a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:06.194 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.187+0000 7f3079c40700 1 --2- 172.21.15.158:0/188496094 >> v2:172.21.15.96:3300/0 conn(0x7f307409cf60 0x7f307409a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:06.194 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.187+0000 7f3079c40700 1 -- 172.21.15.158:0/188496094 >> v1:172.21.15.158:6789/0 conn(0x7f307405a740 legacy=0x7f3074151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.194 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.187+0000 7f3079c40700 1 -- 172.21.15.158:0/188496094 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f307405ab70 con 0x7f30741553b0 2019-12-05T03:50:06.194 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.187+0000 7f3079c40700 1 --2- 172.21.15.158:0/188496094 >> v2:172.21.15.158:3300/0 conn(0x7f30741553b0 0x7f30741557e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f306c008b10 tx=0x7f306c00fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.194 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.187+0000 7f3079c40700 1 --2- 172.21.15.158:0/188496094 >> v2:172.21.15.158:3300/0 conn(0x7f30741553b0 0x7f30741557e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f306c008b10 tx=0x7f306c00fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.194 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.187+0000 7f3079c40700 1 --2- 172.21.15.158:0/188496094 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f30741553b0 0x7f30741557e0 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7f306c008b10 tx=0x7f306c00fff0).ready entity=mon.1 client_cookie=b1dc2b6713dd0467 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:06.194 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.187+0000 7f3079c40700 1 --2- 172.21.15.158:0/188496094 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f30741553b0 0x7f30741557e0 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f306c008b10 tx=0x7f306c00fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.195 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.187+0000 7f306bfff700 1 -- 172.21.15.158:0/188496094 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f306c0108c0 con 0x7f30741553b0 2019-12-05T03:50:06.195 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.187+0000 7f3079c40700 1 --2- 172.21.15.158:0/188496094 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f30741553b0 0x7f30741557e0 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f306c008b10 tx=0x7f306c00fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.195 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.187+0000 7f3079c40700 1 --2- 172.21.15.158:0/188496094 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f30741553b0 0x7f30741557e0 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f306c008b10 tx=0x7f306c00fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.195 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.187+0000 7f306bfff700 1 -- 172.21.15.158:0/188496094 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306c008b50 con 0x7f30741553b0 2019-12-05T03:50:06.195 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.187+0000 7f306bfff700 1 -- 172.21.15.158:0/188496094 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f306c0110c0 con 0x7f30741553b0 2019-12-05T03:50:06.195 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.187+0000 7f307aea2700 1 -- 172.21.15.158:0/188496094 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f30741553b0 msgr2=0x7f30741557e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.195 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.187+0000 7f307aea2700 1 --2- 172.21.15.158:0/188496094 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f30741553b0 0x7f30741557e0 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7f306c008b10 tx=0x7f306c00fff0).stop 2019-12-05T03:50:06.196 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.187+0000 7f307aea2700 1 -- 172.21.15.158:0/188496094 shutdown_connections 2019-12-05T03:50:06.196 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.187+0000 7f307aea2700 1 --2- 172.21.15.158:0/188496094 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f30741553b0 0x7f30741557e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:06.196 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.187+0000 7f307aea2700 1 --2- 172.21.15.158:0/188496094 >> v2:172.21.15.96:3300/0 conn(0x7f307409cf60 0x7f307409a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:06.196 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.187+0000 7f307aea2700 1 -- 172.21.15.158:0/188496094 shutdown_connections 2019-12-05T03:50:06.196 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.187+0000 7f307aea2700 1 -- 172.21.15.158:0/188496094 wait complete. 2019-12-05T03:50:06.196 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.187+0000 7f307aea2700 1 -- 172.21.15.158:0/188496094 >> 172.21.15.158:0/188496094 conn(0x7f30740b7e60 msgr2=0x7f30740b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:06.200 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.191+0000 7f307aea2700 1 Processor -- start 2019-12-05T03:50:06.200 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.191+0000 7f307aea2700 1 -- start start 2019-12-05T03:50:06.200 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.191+0000 7f307aea2700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f307407b660 0x7f3074125e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:06.200 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.191+0000 7f307aea2700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f30741336b0 0x7f3074151230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:06.201 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.191+0000 7f307aea2700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3074152bc0 con 0x7f30740b0e90 2019-12-05T03:50:06.201 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.191+0000 7f307aea2700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3074152920 con 0x7f307407b660 2019-12-05T03:50:06.201 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.191+0000 7f307aea2700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30740b12c0 con 0x7f30741336b0 2019-12-05T03:50:06.201 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.191+0000 7f3079c40700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f30741336b0 0x7f3074151230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.201 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.195+0000 7f3079c40700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f30741336b0 0x7f3074151230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53596/0 (socket says 172.21.15.158:53596) 2019-12-05T03:50:06.201 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.195+0000 7f3079c40700 1 -- 172.21.15.158:0/560280127 learned_addr learned my addr 172.21.15.158:0/560280127 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:06.201 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.195+0000 7f307943f700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f307407b660 0x7f3074125e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.202 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.195+0000 7f3079c40700 1 -- 172.21.15.158:0/560280127 >> v2:172.21.15.96:3300/0 conn(0x7f307407b660 msgr2=0x7f3074125e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.202 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.195+0000 7f3079c40700 1 --2- 172.21.15.158:0/560280127 >> v2:172.21.15.96:3300/0 conn(0x7f307407b660 0x7f3074125e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:06.202 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.195+0000 7f3079c40700 1 -- 172.21.15.158:0/560280127 >> v1:172.21.15.96:6789/0 conn(0x7f30740b0e90 legacy=0x7f3074154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.202 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.195+0000 7f3079c40700 1 -- 172.21.15.158:0/560280127 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3074154a90 con 0x7f30741336b0 2019-12-05T03:50:06.202 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.195+0000 7f3079c40700 1 --2- 172.21.15.158:0/560280127 >> v2:172.21.15.158:3300/0 conn(0x7f30741336b0 0x7f3074151230 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f30740b60d0 tx=0x7f306c0112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.203 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.195+0000 7f3079c40700 1 --2- 172.21.15.158:0/560280127 >> v2:172.21.15.158:3300/0 conn(0x7f30741336b0 0x7f3074151230 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f30740b60d0 tx=0x7f306c0112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.203 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.195+0000 7f3079c40700 1 --2- 172.21.15.158:0/560280127 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f30741336b0 0x7f3074151230 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7f30740b60d0 tx=0x7f306c0112f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:06.203 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.195+0000 7f3079c40700 1 --2- 172.21.15.158:0/560280127 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f30741336b0 0x7f3074151230 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f30740b60d0 tx=0x7f306c0112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.203 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.195+0000 7f3079c40700 1 --2- 172.21.15.158:0/560280127 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f30741336b0 0x7f3074151230 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f30740b60d0 tx=0x7f306c0112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.203 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.195+0000 7f3079c40700 1 --2- 172.21.15.158:0/560280127 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f30741336b0 0x7f3074151230 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f30740b60d0 tx=0x7f306c0112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.204 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.195+0000 7f3069ffb700 1 -- 172.21.15.158:0/560280127 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f306c005ab0 con 0x7f30741336b0 2019-12-05T03:50:06.204 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.195+0000 7f3069ffb700 1 -- 172.21.15.158:0/560280127 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306c010ac0 con 0x7f30741336b0 2019-12-05T03:50:06.204 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.195+0000 7f307aea2700 1 -- 172.21.15.158:0/560280127 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3074154e50 con 0x7f30741336b0 2019-12-05T03:50:06.204 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.195+0000 7f3069ffb700 1 -- 172.21.15.158:0/560280127 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f306c00f6a0 con 0x7f30741336b0 2019-12-05T03:50:06.204 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.195+0000 7f307aea2700 1 -- 172.21.15.158:0/560280127 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3074133c80 con 0x7f30741336b0 2019-12-05T03:50:06.204 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.195+0000 7f3079c40700 1 --2- 172.21.15.158:0/560280127 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f30741336b0 0x7f3074151230 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f30740b60d0 tx=0x7f306c0112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.204 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.195+0000 7f3069ffb700 1 -- 172.21.15.158:0/560280127 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f306c0113d0 con 0x7f30741336b0 2019-12-05T03:50:06.205 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.195+0000 7f3079c40700 1 --2- 172.21.15.158:0/560280127 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f30741336b0 0x7f3074151230 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f30740b60d0 tx=0x7f306c0112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.205 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.195+0000 7f3069ffb700 1 --2- 172.21.15.158:0/560280127 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f305403acc0 0x7f305403d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:06.205 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.195+0000 7f3069ffb700 1 -- 172.21.15.158:0/560280127 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f306c04d700 con 0x7f30741336b0 2019-12-05T03:50:06.205 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.195+0000 7f307943f700 1 --2- 172.21.15.158:0/560280127 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f305403acc0 0x7f305403d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.205 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.195+0000 7f307943f700 1 --2- 172.21.15.158:0/560280127 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f305403acc0 0x7f305403d1d0 crc :-1 s=READY pgs=63 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:06.205 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.199+0000 7f307aea2700 1 --2- 172.21.15.158:0/560280127 >> [v2:172.21.15.158:6824/12195,v1:172.21.15.158:6825/12195] conn(0x7f307409a940 0x7f307409ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:06.205 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.199+0000 7f307aea2700 1 -- 172.21.15.158:0/560280127 --> [v2:172.21.15.158:6824/12195,v1:172.21.15.158:6825/12195] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f307405a950 con 0x7f307409a940 2019-12-05T03:50:06.206 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.199+0000 7f3078c3e700 1 --2- 172.21.15.158:0/560280127 >> [v2:172.21.15.158:6824/12195,v1:172.21.15.158:6825/12195] conn(0x7f307409a940 0x7f307409ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.206 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.199+0000 7f3078c3e700 1 --2- 172.21.15.158:0/560280127 >> [v2:172.21.15.158:6824/12195,v1:172.21.15.158:6825/12195] conn(0x7f307409a940 0x7f307409ad70 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:06.206 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.199+0000 7f3069ffb700 1 -- 172.21.15.158:0/560280127 <== osd.2 v2:172.21.15.158:6824/12195 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23014 (crc 0 0 0) 0x7f307405a950 con 0x7f307409a940 2019-12-05T03:50:06.222 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.219+0000 7f307aea2700 1 -- 172.21.15.158:0/560280127 --> [v2:172.21.15.158:6824/12195,v1:172.21.15.158:6825/12195] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3074066940 con 0x7f307409a940 2019-12-05T03:50:06.222 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.219+0000 7f3069ffb700 1 -- 172.21.15.158:0/560280127 <== osd.2 v2:172.21.15.158:6824/12195 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3074066940 con 0x7f307409a940 2019-12-05T03:50:06.224 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.223+0000 7f307aea2700 1 -- 172.21.15.158:0/560280127 >> [v2:172.21.15.158:6824/12195,v1:172.21.15.158:6825/12195] conn(0x7f307409a940 msgr2=0x7f307409ad70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.224 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.223+0000 7f307aea2700 1 --2- 172.21.15.158:0/560280127 >> [v2:172.21.15.158:6824/12195,v1:172.21.15.158:6825/12195] conn(0x7f307409a940 0x7f307409ad70 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:06.224 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.223+0000 7f307aea2700 1 -- 172.21.15.158:0/560280127 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f305403acc0 msgr2=0x7f305403d1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.224 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.223+0000 7f307aea2700 1 --2- 172.21.15.158:0/560280127 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f305403acc0 0x7f305403d1d0 crc :-1 s=READY pgs=63 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:06.224 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.223+0000 7f307aea2700 1 -- 172.21.15.158:0/560280127 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f30741336b0 msgr2=0x7f3074151230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.225 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.223+0000 7f307aea2700 1 --2- 172.21.15.158:0/560280127 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f30741336b0 0x7f3074151230 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7f30740b60d0 tx=0x7f306c0112f0).stop 2019-12-05T03:50:06.225 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.223+0000 7f3079c40700 1 -- 172.21.15.158:0/560280127 reap_dead start 2019-12-05T03:50:06.225 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.223+0000 7f307aea2700 1 -- 172.21.15.158:0/560280127 shutdown_connections 2019-12-05T03:50:06.225 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.223+0000 7f307aea2700 1 --2- 172.21.15.158:0/560280127 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f30741336b0 0x7f3074151230 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:06.225 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.223+0000 7f307aea2700 1 -- 172.21.15.158:0/560280127 shutdown_connections 2019-12-05T03:50:06.225 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.223+0000 7f307aea2700 1 -- 172.21.15.158:0/560280127 wait complete. 2019-12-05T03:50:06.225 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.223+0000 7f307aea2700 1 -- 172.21.15.158:0/560280127 >> 172.21.15.158:0/560280127 conn(0x7f307409ba50 msgr2=0x7f30740ac2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:06.233 INFO:teuthology.orchestra.run.smithi158.stdout:55834574854 2019-12-05T03:50:06.234 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2019-12-05T03:50:06.333 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.323+0000 7ff5ea0dd700 1 Processor -- start 2019-12-05T03:50:06.333 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.323+0000 7ff5ea0dd700 1 -- start start 2019-12-05T03:50:06.333 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.327+0000 7ff5ea0dd700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff5e409a310 0x7ff5e405a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:06.333 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.327+0000 7ff5ea0dd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff5e41553a0 0x7ff5e41557d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:06.334 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.327+0000 7ff5ea0dd700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5e40acca0 con 0x7ff5e409cf50 2019-12-05T03:50:06.334 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.327+0000 7ff5ea0dd700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5e409a740 con 0x7ff5e409a310 2019-12-05T03:50:06.334 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.327+0000 7ff5ea0dd700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5e40b1720 con 0x7ff5e41553a0 2019-12-05T03:50:06.334 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.327+0000 7ff5e8e7b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff5e41553a0 0x7ff5e41557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.334 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.327+0000 7ff5e8e7b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff5e41553a0 0x7ff5e41557d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53606/0 (socket says 172.21.15.158:53606) 2019-12-05T03:50:06.334 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.327+0000 7ff5e8e7b700 1 -- 172.21.15.158:0/850878804 learned_addr learned my addr 172.21.15.158:0/850878804 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:06.334 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.327+0000 7ff5e37fe700 1 --2- 172.21.15.158:0/850878804 >> v2:172.21.15.96:3300/0 conn(0x7ff5e409a310 0x7ff5e405a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.335 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.327+0000 7ff5e8e7b700 1 -- 172.21.15.158:0/850878804 >> v2:172.21.15.96:3300/0 conn(0x7ff5e409a310 msgr2=0x7ff5e405a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:06.335 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.327+0000 7ff5e8e7b700 1 --2- 172.21.15.158:0/850878804 >> v2:172.21.15.96:3300/0 conn(0x7ff5e409a310 0x7ff5e405a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:06.335 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.327+0000 7ff5e8e7b700 1 -- 172.21.15.158:0/850878804 >> v1:172.21.15.96:6789/0 conn(0x7ff5e409cf50 legacy=0x7ff5e4151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:06.335 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.327+0000 7ff5e8e7b700 1 -- 172.21.15.158:0/850878804 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e40b6970 con 0x7ff5e41553a0 2019-12-05T03:50:06.335 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.327+0000 7ff5e8e7b700 1 --2- 172.21.15.158:0/850878804 >> v2:172.21.15.158:3300/0 conn(0x7ff5e41553a0 0x7ff5e41557d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff5dc008790 tx=0x7ff5dc00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.335 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.327+0000 7ff5e8e7b700 1 --2- 172.21.15.158:0/850878804 >> v2:172.21.15.158:3300/0 conn(0x7ff5e41553a0 0x7ff5e41557d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff5dc008790 tx=0x7ff5dc00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.335 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.327+0000 7ff5e8e7b700 1 --2- 172.21.15.158:0/850878804 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff5e41553a0 0x7ff5e41557d0 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7ff5dc008790 tx=0x7ff5dc00fd30).ready entity=mon.1 client_cookie=df016d56b1609563 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:06.336 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.327+0000 7ff5e8e7b700 1 --2- 172.21.15.158:0/850878804 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff5e41553a0 0x7ff5e41557d0 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7ff5dc008790 tx=0x7ff5dc00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.336 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.327+0000 7ff5e8e7b700 1 --2- 172.21.15.158:0/850878804 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff5e41553a0 0x7ff5e41557d0 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7ff5dc008790 tx=0x7ff5dc00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.336 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.327+0000 7ff5e2ffd700 1 -- 172.21.15.158:0/850878804 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5dc008c90 con 0x7ff5e41553a0 2019-12-05T03:50:06.336 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.327+0000 7ff5e8e7b700 1 --2- 172.21.15.158:0/850878804 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff5e41553a0 0x7ff5e41557d0 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7ff5dc008790 tx=0x7ff5dc00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.336 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.327+0000 7ff5e2ffd700 1 -- 172.21.15.158:0/850878804 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5dc0088b0 con 0x7ff5e41553a0 2019-12-05T03:50:06.336 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.327+0000 7ff5e2ffd700 1 -- 172.21.15.158:0/850878804 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5dc011ad0 con 0x7ff5e41553a0 2019-12-05T03:50:06.336 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.327+0000 7ff5ea0dd700 1 -- 172.21.15.158:0/850878804 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff5e41553a0 msgr2=0x7ff5e41557d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.337 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.327+0000 7ff5ea0dd700 1 --2- 172.21.15.158:0/850878804 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff5e41553a0 0x7ff5e41557d0 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7ff5dc008790 tx=0x7ff5dc00fd30).stop 2019-12-05T03:50:06.337 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.327+0000 7ff5ea0dd700 1 -- 172.21.15.158:0/850878804 shutdown_connections 2019-12-05T03:50:06.337 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.327+0000 7ff5ea0dd700 1 --2- 172.21.15.158:0/850878804 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff5e41553a0 0x7ff5e41557d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:06.337 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.327+0000 7ff5ea0dd700 1 --2- 172.21.15.158:0/850878804 >> v2:172.21.15.96:3300/0 conn(0x7ff5e409a310 0x7ff5e405a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:06.337 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.327+0000 7ff5ea0dd700 1 -- 172.21.15.158:0/850878804 shutdown_connections 2019-12-05T03:50:06.337 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.327+0000 7ff5ea0dd700 1 -- 172.21.15.158:0/850878804 wait complete. 2019-12-05T03:50:06.337 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.327+0000 7ff5ea0dd700 1 -- 172.21.15.158:0/850878804 >> 172.21.15.158:0/850878804 conn(0x7ff5e40b7e50 msgr2=0x7ff5e40b3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:06.340 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.331+0000 7ff5ea0dd700 1 Processor -- start 2019-12-05T03:50:06.341 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.331+0000 7ff5ea0dd700 1 -- start start 2019-12-05T03:50:06.341 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.335+0000 7ff5ea0dd700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff5e415ba60 0x7ff5e4136100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:06.341 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.335+0000 7ff5ea0dd700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff5e409b130 0x7ff5e4153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:06.341 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.335+0000 7ff5ea0dd700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5e4136f80 con 0x7ff5e41259d0 2019-12-05T03:50:06.341 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.335+0000 7ff5ea0dd700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5e41367a0 con 0x7ff5e409b130 2019-12-05T03:50:06.341 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.335+0000 7ff5ea0dd700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e4136a40 con 0x7ff5e415ba60 2019-12-05T03:50:06.342 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.335+0000 7ff5e3fff700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff5e415ba60 0x7ff5e4136100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.342 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.335+0000 7ff5e8e7b700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff5e409b130 0x7ff5e4153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.342 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.335+0000 7ff5e3fff700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff5e415ba60 0x7ff5e4136100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.158:36348/0 (socket says 172.21.15.158:36348) 2019-12-05T03:50:06.342 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.335+0000 7ff5e8e7b700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff5e409b130 0x7ff5e4153b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.158:40198/0 (socket says 172.21.15.158:40198) 2019-12-05T03:50:06.342 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.335+0000 7ff5e3fff700 1 -- 172.21.15.158:0/573099002 learned_addr learned my addr 172.21.15.158:0/573099002 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:06.342 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.335+0000 7ff5e8e7b700 1 -- 172.21.15.158:0/573099002 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff5e415ba60 msgr2=0x7ff5e4136100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.342 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.335+0000 7ff5e8e7b700 1 --2- 172.21.15.158:0/573099002 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff5e415ba60 0x7ff5e4136100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:06.343 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.335+0000 7ff5e8e7b700 1 -- 172.21.15.158:0/573099002 >> v1:172.21.15.96:6789/0 conn(0x7ff5e41259d0 legacy=0x7ff5e409a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.343 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.335+0000 7ff5e8e7b700 1 -- 172.21.15.158:0/573099002 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e4125e00 con 0x7ff5e409b130 2019-12-05T03:50:06.343 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.335+0000 7ff5e8e7b700 1 --2- 172.21.15.158:0/573099002 >> v2:172.21.15.96:3300/0 conn(0x7ff5e409b130 0x7ff5e4153b50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff5e4136960 tx=0x7ff5dc008b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.343 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.335+0000 7ff5e8e7b700 1 --2- 172.21.15.158:0/573099002 >> v2:172.21.15.96:3300/0 conn(0x7ff5e409b130 0x7ff5e4153b50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff5e4136960 tx=0x7ff5dc008b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.343 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.335+0000 7ff5e8e7b700 1 --2- 172.21.15.158:0/573099002 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5e409b130 0x7ff5e4153b50 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7ff5e4136960 tx=0x7ff5dc008b40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:06.343 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.335+0000 7ff5e8e7b700 1 --2- 172.21.15.158:0/573099002 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5e409b130 0x7ff5e4153b50 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7ff5e4136960 tx=0x7ff5dc008b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.343 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.335+0000 7ff5e0ff9700 1 -- 172.21.15.158:0/573099002 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5dc00f470 con 0x7ff5e409b130 2019-12-05T03:50:06.344 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.335+0000 7ff5e8e7b700 1 --2- 172.21.15.158:0/573099002 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5e409b130 0x7ff5e4153b50 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7ff5e4136960 tx=0x7ff5dc008b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.344 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.335+0000 7ff5e8e7b700 1 --2- 172.21.15.158:0/573099002 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5e409b130 0x7ff5e4153b50 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7ff5e4136960 tx=0x7ff5dc008b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.344 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.335+0000 7ff5e0ff9700 1 -- 172.21.15.158:0/573099002 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5dc0116f0 con 0x7ff5e409b130 2019-12-05T03:50:06.344 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.335+0000 7ff5e0ff9700 1 -- 172.21.15.158:0/573099002 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5dc005730 con 0x7ff5e409b130 2019-12-05T03:50:06.345 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.335+0000 7ff5ea0dd700 1 -- 172.21.15.158:0/573099002 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e409b560 con 0x7ff5e409b130 2019-12-05T03:50:06.345 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.335+0000 7ff5ea0dd700 1 -- 172.21.15.158:0/573099002 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e41540a0 con 0x7ff5e409b130 2019-12-05T03:50:06.345 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.335+0000 7ff5e8e7b700 1 --2- 172.21.15.158:0/573099002 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5e409b130 0x7ff5e4153b50 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7ff5e4136960 tx=0x7ff5dc008b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.345 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.339+0000 7ff5e0ff9700 1 -- 172.21.15.158:0/573099002 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7ff5dc005a50 con 0x7ff5e409b130 2019-12-05T03:50:06.346 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.339+0000 7ff5e8e7b700 1 --2- 172.21.15.158:0/573099002 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5e409b130 0x7ff5e4153b50 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7ff5e4136960 tx=0x7ff5dc008b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.346 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.339+0000 7ff5e0ff9700 1 --2- 172.21.15.158:0/573099002 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7ff5c403ac60 0x7ff5c403d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:06.346 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.339+0000 7ff5e0ff9700 1 -- 172.21.15.158:0/573099002 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7ff5dc04bb30 con 0x7ff5e409b130 2019-12-05T03:50:06.346 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.339+0000 7ff5e3fff700 1 --2- 172.21.15.158:0/573099002 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7ff5c403ac60 0x7ff5c403d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.346 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.339+0000 7ff5e3fff700 1 --2- 172.21.15.158:0/573099002 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7ff5c403ac60 0x7ff5c403d170 crc :-1 s=READY pgs=64 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:06.347 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.339+0000 7ff5ea0dd700 1 --2- 172.21.15.158:0/573099002 >> [v2:172.21.15.158:6816/12194,v1:172.21.15.158:6817/12194] conn(0x7ff5e4154680 0x7ff5e4054250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:06.347 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.339+0000 7ff5ea0dd700 1 -- 172.21.15.158:0/573099002 --> [v2:172.21.15.158:6816/12194,v1:172.21.15.158:6817/12194] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff5e409a520 con 0x7ff5e4154680 2019-12-05T03:50:06.347 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.339+0000 7ff5e37fe700 1 --2- 172.21.15.158:0/573099002 >> [v2:172.21.15.158:6816/12194,v1:172.21.15.158:6817/12194] conn(0x7ff5e4154680 0x7ff5e4054250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.347 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.339+0000 7ff5e37fe700 1 --2- 172.21.15.158:0/573099002 >> [v2:172.21.15.158:6816/12194,v1:172.21.15.158:6817/12194] conn(0x7ff5e4154680 0x7ff5e4054250 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:06.347 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.339+0000 7ff5e0ff9700 1 -- 172.21.15.158:0/573099002 <== osd.3 v2:172.21.15.158:6816/12194 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23014 (crc 0 0 0) 0x7ff5e409a520 con 0x7ff5e4154680 2019-12-05T03:50:06.367 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.367+0000 7ff5ea0dd700 1 -- 172.21.15.158:0/573099002 --> [v2:172.21.15.158:6816/12194,v1:172.21.15.158:6817/12194] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff5e4066930 con 0x7ff5e4154680 2019-12-05T03:50:06.368 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.367+0000 7ff5e0ff9700 1 -- 172.21.15.158:0/573099002 <== osd.3 v2:172.21.15.158:6816/12194 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff5e4066930 con 0x7ff5e4154680 2019-12-05T03:50:06.370 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.367+0000 7ff5ea0dd700 1 -- 172.21.15.158:0/573099002 >> [v2:172.21.15.158:6816/12194,v1:172.21.15.158:6817/12194] conn(0x7ff5e4154680 msgr2=0x7ff5e4054250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.370 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.367+0000 7ff5ea0dd700 1 --2- 172.21.15.158:0/573099002 >> [v2:172.21.15.158:6816/12194,v1:172.21.15.158:6817/12194] conn(0x7ff5e4154680 0x7ff5e4054250 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:06.370 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.367+0000 7ff5ea0dd700 1 -- 172.21.15.158:0/573099002 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7ff5c403ac60 msgr2=0x7ff5c403d170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.370 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.367+0000 7ff5ea0dd700 1 --2- 172.21.15.158:0/573099002 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7ff5c403ac60 0x7ff5c403d170 crc :-1 s=READY pgs=64 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:06.370 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.367+0000 7ff5ea0dd700 1 -- 172.21.15.158:0/573099002 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5e409b130 msgr2=0x7ff5e4153b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.370 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.367+0000 7ff5ea0dd700 1 --2- 172.21.15.158:0/573099002 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5e409b130 0x7ff5e4153b50 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7ff5e4136960 tx=0x7ff5dc008b40).stop 2019-12-05T03:50:06.371 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.367+0000 7ff5e8e7b700 1 -- 172.21.15.158:0/573099002 reap_dead start 2019-12-05T03:50:06.371 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.367+0000 7ff5ea0dd700 1 -- 172.21.15.158:0/573099002 shutdown_connections 2019-12-05T03:50:06.371 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.367+0000 7ff5ea0dd700 1 --2- 172.21.15.158:0/573099002 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5e409b130 0x7ff5e4153b50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:06.371 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.367+0000 7ff5ea0dd700 1 -- 172.21.15.158:0/573099002 shutdown_connections 2019-12-05T03:50:06.371 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.367+0000 7ff5ea0dd700 1 -- 172.21.15.158:0/573099002 wait complete. 2019-12-05T03:50:06.371 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.367+0000 7ff5ea0dd700 1 -- 172.21.15.158:0/573099002 >> 172.21.15.158:0/573099002 conn(0x7ff5e40b58f0 msgr2=0x7ff5e41557e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:06.380 INFO:teuthology.orchestra.run.smithi158.stdout:55834574854 2019-12-05T03:50:06.380 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2019-12-05T03:50:06.481 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.475+0000 7efe1c637700 1 Processor -- start 2019-12-05T03:50:06.481 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.475+0000 7efe1c637700 1 -- start start 2019-12-05T03:50:06.481 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.475+0000 7efe1c637700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7efe1409a320 0x7efe1405a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:06.482 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.475+0000 7efe1c637700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7efe141553b0 0x7efe141557e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:06.482 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.475+0000 7efe1c637700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe140accb0 con 0x7efe1409cf60 2019-12-05T03:50:06.482 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.475+0000 7efe1c637700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe1409a750 con 0x7efe141553b0 2019-12-05T03:50:06.482 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.475+0000 7efe1c637700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe140b1730 con 0x7efe1409a320 2019-12-05T03:50:06.482 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.475+0000 7efe1a3d3700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7efe1409a320 0x7efe1405a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.482 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.475+0000 7efe1a3d3700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7efe1409a320 0x7efe1405a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53618/0 (socket says 172.21.15.158:53618) 2019-12-05T03:50:06.482 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.475+0000 7efe1a3d3700 1 -- 172.21.15.158:0/3075806486 learned_addr learned my addr 172.21.15.158:0/3075806486 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:06.483 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.475+0000 7efe1b3d5700 1 --2- 172.21.15.158:0/3075806486 >> v2:172.21.15.96:3300/0 conn(0x7efe141553b0 0x7efe141557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.483 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.475+0000 7efe1a3d3700 1 -- 172.21.15.158:0/3075806486 >> v2:172.21.15.96:3300/0 conn(0x7efe141553b0 msgr2=0x7efe141557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:06.483 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.475+0000 7efe1a3d3700 1 --2- 172.21.15.158:0/3075806486 >> v2:172.21.15.96:3300/0 conn(0x7efe141553b0 0x7efe141557e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:06.483 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.475+0000 7efe1a3d3700 1 -- 172.21.15.158:0/3075806486 >> v1:172.21.15.96:6789/0 conn(0x7efe1409cf60 legacy=0x7efe14151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:06.483 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.475+0000 7efe1a3d3700 1 -- 172.21.15.158:0/3075806486 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe140b6980 con 0x7efe1409a320 2019-12-05T03:50:06.483 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.475+0000 7efe1a3d3700 1 --2- 172.21.15.158:0/3075806486 >> v2:172.21.15.158:3300/0 conn(0x7efe1409a320 0x7efe1405a740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efe08008790 tx=0x7efe0800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.483 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.475+0000 7efe1a3d3700 1 --2- 172.21.15.158:0/3075806486 >> v2:172.21.15.158:3300/0 conn(0x7efe1409a320 0x7efe1405a740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efe08008790 tx=0x7efe0800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.484 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.475+0000 7efe1a3d3700 1 --2- 172.21.15.158:0/3075806486 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efe1409a320 0x7efe1405a740 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7efe08008790 tx=0x7efe0800fd30).ready entity=mon.1 client_cookie=f413ef6f414d113b server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:06.484 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.475+0000 7efe1a3d3700 1 --2- 172.21.15.158:0/3075806486 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efe1409a320 0x7efe1405a740 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7efe08008790 tx=0x7efe0800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.484 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.475+0000 7efe1a3d3700 1 --2- 172.21.15.158:0/3075806486 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efe1409a320 0x7efe1405a740 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7efe08008790 tx=0x7efe0800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.484 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.475+0000 7efe19bd2700 1 -- 172.21.15.158:0/3075806486 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe08008c90 con 0x7efe1409a320 2019-12-05T03:50:06.484 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.475+0000 7efe1a3d3700 1 --2- 172.21.15.158:0/3075806486 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efe1409a320 0x7efe1405a740 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7efe08008790 tx=0x7efe0800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.484 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.475+0000 7efe19bd2700 1 -- 172.21.15.158:0/3075806486 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe080088b0 con 0x7efe1409a320 2019-12-05T03:50:06.484 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.475+0000 7efe19bd2700 1 -- 172.21.15.158:0/3075806486 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe08011ad0 con 0x7efe1409a320 2019-12-05T03:50:06.485 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.475+0000 7efe1c637700 1 -- 172.21.15.158:0/3075806486 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efe1409a320 msgr2=0x7efe1405a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.485 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.475+0000 7efe1c637700 1 --2- 172.21.15.158:0/3075806486 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efe1409a320 0x7efe1405a740 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7efe08008790 tx=0x7efe0800fd30).stop 2019-12-05T03:50:06.485 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.479+0000 7efe1c637700 1 -- 172.21.15.158:0/3075806486 shutdown_connections 2019-12-05T03:50:06.485 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.479+0000 7efe1c637700 1 --2- 172.21.15.158:0/3075806486 >> v2:172.21.15.96:3300/0 conn(0x7efe141553b0 0x7efe141557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:06.485 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.479+0000 7efe1c637700 1 --2- 172.21.15.158:0/3075806486 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efe1409a320 0x7efe1405a740 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:06.485 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.479+0000 7efe1c637700 1 -- 172.21.15.158:0/3075806486 shutdown_connections 2019-12-05T03:50:06.485 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.479+0000 7efe1c637700 1 -- 172.21.15.158:0/3075806486 wait complete. 2019-12-05T03:50:06.486 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.479+0000 7efe1c637700 1 -- 172.21.15.158:0/3075806486 >> 172.21.15.158:0/3075806486 conn(0x7efe140b7e60 msgr2=0x7efe140b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:06.486 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.479+0000 7efe1c637700 1 Processor -- start 2019-12-05T03:50:06.486 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.479+0000 7efe1c637700 1 -- start start 2019-12-05T03:50:06.489 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.479+0000 7efe1c637700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7efe14151f10 0x7efe14139b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:06.489 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.479+0000 7efe1c637700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efe1407d340 0x7efe1407d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:06.489 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.479+0000 7efe1c637700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe1413a660 con 0x7efe14154190 2019-12-05T03:50:06.489 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.479+0000 7efe1c637700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe14152420 con 0x7efe14151f10 2019-12-05T03:50:06.489 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.479+0000 7efe1c637700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe14153ef0 con 0x7efe1407d340 2019-12-05T03:50:06.489 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.479+0000 7efe1abd4700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7efe14151f10 0x7efe14139b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.490 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.479+0000 7efe1abd4700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7efe14151f10 0x7efe14139b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53626/0 (socket says 172.21.15.158:53626) 2019-12-05T03:50:06.490 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.479+0000 7efe1a3d3700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efe1407d340 0x7efe1407d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.490 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.479+0000 7efe1abd4700 1 -- 172.21.15.158:0/1137142261 learned_addr learned my addr 172.21.15.158:0/1137142261 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:06.490 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.479+0000 7efe1abd4700 1 -- 172.21.15.158:0/1137142261 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efe1407d340 msgr2=0x7efe1407d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.490 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.479+0000 7efe077fe700 1 -- 172.21.15.158:0/1137142261 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1536457258 0 0) 0x7efe1413a660 con 0x7efe14154190 2019-12-05T03:50:06.490 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.479+0000 7efe1abd4700 1 --2- 172.21.15.158:0/1137142261 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efe1407d340 0x7efe1407d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:06.490 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.479+0000 7efe1abd4700 1 -- 172.21.15.158:0/1137142261 >> v1:172.21.15.96:6789/0 conn(0x7efe14154190 legacy=0x7efe141545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.491 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.479+0000 7efe1abd4700 1 -- 172.21.15.158:0/1137142261 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe141526c0 con 0x7efe14151f10 2019-12-05T03:50:06.491 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.479+0000 7efe1abd4700 1 --2- 172.21.15.158:0/1137142261 >> v2:172.21.15.158:3300/0 conn(0x7efe14151f10 0x7efe14139b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efe10002ef0 tx=0x7efe10010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.491 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.479+0000 7efe1abd4700 1 --2- 172.21.15.158:0/1137142261 >> v2:172.21.15.158:3300/0 conn(0x7efe14151f10 0x7efe14139b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efe10002ef0 tx=0x7efe10010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.491 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.479+0000 7efe1abd4700 1 --2- 172.21.15.158:0/1137142261 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efe14151f10 0x7efe14139b40 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7efe10002ef0 tx=0x7efe10010950).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:06.491 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.483+0000 7efe1abd4700 1 --2- 172.21.15.158:0/1137142261 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efe14151f10 0x7efe14139b40 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7efe10002ef0 tx=0x7efe10010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.491 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.483+0000 7efe077fe700 1 -- 172.21.15.158:0/1137142261 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe10008810 con 0x7efe14151f10 2019-12-05T03:50:06.491 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.483+0000 7efe1abd4700 1 --2- 172.21.15.158:0/1137142261 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efe14151f10 0x7efe14139b40 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7efe10002ef0 tx=0x7efe10010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.492 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.483+0000 7efe077fe700 1 -- 172.21.15.158:0/1137142261 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe10007160 con 0x7efe14151f10 2019-12-05T03:50:06.492 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.483+0000 7efe1c637700 1 -- 172.21.15.158:0/1137142261 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe1407dcc0 con 0x7efe14151f10 2019-12-05T03:50:06.492 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.483+0000 7efe1abd4700 1 --2- 172.21.15.158:0/1137142261 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efe14151f10 0x7efe14139b40 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7efe10002ef0 tx=0x7efe10010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.492 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.483+0000 7efe077fe700 1 -- 172.21.15.158:0/1137142261 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe10008df0 con 0x7efe14151f10 2019-12-05T03:50:06.492 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.483+0000 7efe1c637700 1 -- 172.21.15.158:0/1137142261 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe14128320 con 0x7efe14151f10 2019-12-05T03:50:06.492 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.483+0000 7efe1abd4700 1 --2- 172.21.15.158:0/1137142261 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efe14151f10 0x7efe14139b40 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7efe10002ef0 tx=0x7efe10010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.492 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.483+0000 7efe077fe700 1 -- 172.21.15.158:0/1137142261 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7efe100057c0 con 0x7efe14151f10 2019-12-05T03:50:06.493 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.483+0000 7efe1abd4700 1 --2- 172.21.15.158:0/1137142261 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efe14151f10 0x7efe14139b40 secure :-1 s=THROTTLE_DONE pgs=114 cs=0 l=1 rx=0x7efe10002ef0 tx=0x7efe10010950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.493 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.483+0000 7efe077fe700 1 --2- 172.21.15.158:0/1137142261 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7efdfc03ac10 0x7efdfc03d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:06.493 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.483+0000 7efe077fe700 1 -- 172.21.15.158:0/1137142261 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7efe1004ac90 con 0x7efe14151f10 2019-12-05T03:50:06.493 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.483+0000 7efe1a3d3700 1 --2- 172.21.15.158:0/1137142261 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7efdfc03ac10 0x7efdfc03d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.493 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.483+0000 7efe1a3d3700 1 --2- 172.21.15.158:0/1137142261 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7efdfc03ac10 0x7efdfc03d120 crc :-1 s=READY pgs=65 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:06.494 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.491+0000 7efe1c637700 1 --2- 172.21.15.158:0/1137142261 >> [v2:172.21.15.96:6802/12460,v1:172.21.15.96:6803/12460] conn(0x7efe140593f0 0x7efe14054260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:06.494 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.491+0000 7efe1c637700 1 -- 172.21.15.158:0/1137142261 --> [v2:172.21.15.96:6802/12460,v1:172.21.15.96:6803/12460] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efe140554e0 con 0x7efe140593f0 2019-12-05T03:50:06.494 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.491+0000 7efe1b3d5700 1 --2- 172.21.15.158:0/1137142261 >> [v2:172.21.15.96:6802/12460,v1:172.21.15.96:6803/12460] conn(0x7efe140593f0 0x7efe14054260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.494 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.491+0000 7efe1b3d5700 1 --2- 172.21.15.158:0/1137142261 >> [v2:172.21.15.96:6802/12460,v1:172.21.15.96:6803/12460] conn(0x7efe140593f0 0x7efe14054260 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:06.495 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.491+0000 7efe077fe700 1 -- 172.21.15.158:0/1137142261 <== osd.4 v2:172.21.15.96:6802/12460 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23014 (crc 0 0 0) 0x7efe140554e0 con 0x7efe140593f0 2019-12-05T03:50:06.520 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.515+0000 7efe1c637700 1 -- 172.21.15.158:0/1137142261 --> [v2:172.21.15.96:6802/12460,v1:172.21.15.96:6803/12460] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efe141550d0 con 0x7efe140593f0 2019-12-05T03:50:06.521 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.515+0000 7efe077fe700 1 -- 172.21.15.158:0/1137142261 <== osd.4 v2:172.21.15.96:6802/12460 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efe141550d0 con 0x7efe140593f0 2019-12-05T03:50:06.521 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.519+0000 7efe1c637700 1 -- 172.21.15.158:0/1137142261 >> [v2:172.21.15.96:6802/12460,v1:172.21.15.96:6803/12460] conn(0x7efe140593f0 msgr2=0x7efe14054260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.521 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.519+0000 7efe1c637700 1 --2- 172.21.15.158:0/1137142261 >> [v2:172.21.15.96:6802/12460,v1:172.21.15.96:6803/12460] conn(0x7efe140593f0 0x7efe14054260 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:06.521 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.519+0000 7efe1c637700 1 -- 172.21.15.158:0/1137142261 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7efdfc03ac10 msgr2=0x7efdfc03d120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.521 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.519+0000 7efe1c637700 1 --2- 172.21.15.158:0/1137142261 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7efdfc03ac10 0x7efdfc03d120 crc :-1 s=READY pgs=65 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:06.521 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.519+0000 7efe1c637700 1 -- 172.21.15.158:0/1137142261 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efe14151f10 msgr2=0x7efe14139b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.522 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.519+0000 7efe1c637700 1 --2- 172.21.15.158:0/1137142261 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efe14151f10 0x7efe14139b40 secure :-1 s=READY pgs=114 cs=0 l=1 rx=0x7efe10002ef0 tx=0x7efe10010950).stop 2019-12-05T03:50:06.522 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.519+0000 7efe1b3d5700 1 -- 172.21.15.158:0/1137142261 reap_dead start 2019-12-05T03:50:06.522 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.519+0000 7efe1c637700 1 -- 172.21.15.158:0/1137142261 shutdown_connections 2019-12-05T03:50:06.522 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.519+0000 7efe1c637700 1 --2- 172.21.15.158:0/1137142261 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efe14151f10 0x7efe14139b40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:06.522 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.519+0000 7efe1c637700 1 -- 172.21.15.158:0/1137142261 shutdown_connections 2019-12-05T03:50:06.522 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.519+0000 7efe1c637700 1 -- 172.21.15.158:0/1137142261 wait complete. 2019-12-05T03:50:06.522 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.519+0000 7efe1c637700 1 -- 172.21.15.158:0/1137142261 >> 172.21.15.158:0/1137142261 conn(0x7efe140b7e60 msgr2=0x7efe141299f0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:06.530 INFO:teuthology.orchestra.run.smithi158.stdout:55834574855 2019-12-05T03:50:06.530 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2019-12-05T03:50:06.634 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.627+0000 7f616f688700 1 Processor -- start 2019-12-05T03:50:06.634 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.627+0000 7f616f688700 1 -- start start 2019-12-05T03:50:06.634 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.627+0000 7f616f688700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f616809cf50 0x7f616809a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:06.635 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.627+0000 7f616f688700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f61681553a0 0x7f61681557d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:06.635 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.627+0000 7f616f688700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61680acca0 con 0x7f616805a730 2019-12-05T03:50:06.635 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.627+0000 7f616f688700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61680b1720 con 0x7f616809cf50 2019-12-05T03:50:06.635 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.627+0000 7f616f688700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61680b19c0 con 0x7f61681553a0 2019-12-05T03:50:06.635 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.627+0000 7f616e426700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f61681553a0 0x7f61681557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.635 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.627+0000 7f616e426700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f61681553a0 0x7f61681557d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53638/0 (socket says 172.21.15.158:53638) 2019-12-05T03:50:06.635 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.627+0000 7f616e426700 1 -- 172.21.15.158:0/4213680797 learned_addr learned my addr 172.21.15.158:0/4213680797 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:06.636 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.627+0000 7f616dc25700 1 --2- 172.21.15.158:0/4213680797 >> v2:172.21.15.96:3300/0 conn(0x7f616809cf50 0x7f616809a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.636 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.627+0000 7f616e426700 1 -- 172.21.15.158:0/4213680797 >> v2:172.21.15.96:3300/0 conn(0x7f616809cf50 msgr2=0x7f616809a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:06.636 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.627+0000 7f616e426700 1 --2- 172.21.15.158:0/4213680797 >> v2:172.21.15.96:3300/0 conn(0x7f616809cf50 0x7f616809a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:06.636 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.627+0000 7f616e426700 1 -- 172.21.15.158:0/4213680797 >> v1:172.21.15.96:6789/0 conn(0x7f616805a730 legacy=0x7f6168151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.636 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.627+0000 7f616e426700 1 -- 172.21.15.158:0/4213680797 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616805ab60 con 0x7f61681553a0 2019-12-05T03:50:06.636 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.627+0000 7f616e426700 1 --2- 172.21.15.158:0/4213680797 >> v2:172.21.15.158:3300/0 conn(0x7f61681553a0 0x7f61681557d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6160008790 tx=0x7f616000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.636 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.627+0000 7f616e426700 1 --2- 172.21.15.158:0/4213680797 >> v2:172.21.15.158:3300/0 conn(0x7f61681553a0 0x7f61681557d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6160008790 tx=0x7f616000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.637 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.627+0000 7f616e426700 1 --2- 172.21.15.158:0/4213680797 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f61681553a0 0x7f61681557d0 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7f6160008790 tx=0x7f616000fd30).ready entity=mon.1 client_cookie=8630b422b6440ea9 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:06.637 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.627+0000 7f616e426700 1 --2- 172.21.15.158:0/4213680797 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f61681553a0 0x7f61681557d0 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f6160008790 tx=0x7f616000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.637 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.627+0000 7f616cc23700 1 -- 172.21.15.158:0/4213680797 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6160008c90 con 0x7f61681553a0 2019-12-05T03:50:06.637 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.627+0000 7f616e426700 1 --2- 172.21.15.158:0/4213680797 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f61681553a0 0x7f61681557d0 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f6160008790 tx=0x7f616000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.637 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.627+0000 7f616e426700 1 --2- 172.21.15.158:0/4213680797 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f61681553a0 0x7f61681557d0 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f6160008790 tx=0x7f616000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.637 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.627+0000 7f616cc23700 1 -- 172.21.15.158:0/4213680797 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61600088b0 con 0x7f61681553a0 2019-12-05T03:50:06.637 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.627+0000 7f616cc23700 1 -- 172.21.15.158:0/4213680797 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6160011ad0 con 0x7f61681553a0 2019-12-05T03:50:06.638 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.627+0000 7f616f688700 1 -- 172.21.15.158:0/4213680797 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f61681553a0 msgr2=0x7f61681557d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.638 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.627+0000 7f616f688700 1 --2- 172.21.15.158:0/4213680797 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f61681553a0 0x7f61681557d0 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7f6160008790 tx=0x7f616000fd30).stop 2019-12-05T03:50:06.638 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.631+0000 7f616f688700 1 -- 172.21.15.158:0/4213680797 shutdown_connections 2019-12-05T03:50:06.638 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.631+0000 7f616f688700 1 --2- 172.21.15.158:0/4213680797 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f61681553a0 0x7f61681557d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:06.638 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.631+0000 7f616f688700 1 --2- 172.21.15.158:0/4213680797 >> v2:172.21.15.96:3300/0 conn(0x7f616809cf50 0x7f616809a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:06.638 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.631+0000 7f616f688700 1 -- 172.21.15.158:0/4213680797 shutdown_connections 2019-12-05T03:50:06.638 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.631+0000 7f616f688700 1 -- 172.21.15.158:0/4213680797 wait complete. 2019-12-05T03:50:06.638 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.631+0000 7f616f688700 1 -- 172.21.15.158:0/4213680797 >> 172.21.15.158:0/4213680797 conn(0x7f61680b7e50 msgr2=0x7f61680b3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:06.642 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.631+0000 7f616f688700 1 Processor -- start 2019-12-05T03:50:06.642 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.631+0000 7f616f688700 1 -- start start 2019-12-05T03:50:06.642 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.635+0000 7f616f688700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6168152720 0x7f6168154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:06.642 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.635+0000 7f616f688700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f6168153fe0 0x7f616809b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:06.642 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.635+0000 7f616f688700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6168152230 con 0x7f616812e6e0 2019-12-05T03:50:06.643 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.635+0000 7f616f688700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f616813ccc0 con 0x7f6168153fe0 2019-12-05T03:50:06.643 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.635+0000 7f616f688700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f616813cf40 con 0x7f6168152720 2019-12-05T03:50:06.643 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.635+0000 7f616e426700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f616812e6e0 0x7f616813f8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48422/0 (socket says 172.21.15.158:48422) 2019-12-05T03:50:06.643 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.635+0000 7f616d424700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f6168153fe0 0x7f616809b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.643 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.635+0000 7f616e426700 1 -- 172.21.15.158:0/2527471286 learned_addr learned my addr 172.21.15.158:0/2527471286 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:06.643 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.635+0000 7f616dc25700 1 --2- 172.21.15.158:0/2527471286 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6168152720 0x7f6168154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.643 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.635+0000 7f61667fc700 1 -- 172.21.15.158:0/2527471286 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1846264459 0 0) 0x7f6168152230 con 0x7f616812e6e0 2019-12-05T03:50:06.644 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.635+0000 7f61667fc700 1 -- 172.21.15.158:0/2527471286 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61480030b0 con 0x7f616812e6e0 2019-12-05T03:50:06.644 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.635+0000 7f616dc25700 1 -- 172.21.15.158:0/2527471286 >> v2:172.21.15.158:3300/0 conn(0x7f6168153fe0 msgr2=0x7f616809b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.644 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.635+0000 7f616dc25700 1 --2- 172.21.15.158:0/2527471286 >> v2:172.21.15.158:3300/0 conn(0x7f6168153fe0 0x7f616809b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:06.644 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.635+0000 7f616dc25700 1 -- 172.21.15.158:0/2527471286 >> v1:172.21.15.158:6789/0 conn(0x7f616812e6e0 legacy=0x7f616813f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.644 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.635+0000 7f616dc25700 1 -- 172.21.15.158:0/2527471286 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616809b570 con 0x7f6168152720 2019-12-05T03:50:06.644 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.635+0000 7f616dc25700 1 --2- 172.21.15.158:0/2527471286 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6168152720 0x7f6168154b60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6158002f30 tx=0x7f6158010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.644 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.635+0000 7f616dc25700 1 --2- 172.21.15.158:0/2527471286 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6168152720 0x7f6168154b60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6158002f30 tx=0x7f6158010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.645 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.635+0000 7f616dc25700 1 --2- 172.21.15.158:0/2527471286 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6168152720 0x7f6168154b60 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7f6158002f30 tx=0x7f6158010ae0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:06.645 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.635+0000 7f616dc25700 1 --2- 172.21.15.158:0/2527471286 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6168152720 0x7f6168154b60 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f6158002f30 tx=0x7f6158010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.645 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.635+0000 7f61667fc700 1 -- 172.21.15.158:0/2527471286 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6158005930 con 0x7f6168152720 2019-12-05T03:50:06.645 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.635+0000 7f616dc25700 1 --2- 172.21.15.158:0/2527471286 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6168152720 0x7f6168154b60 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f6158002f30 tx=0x7f6158010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.645 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.635+0000 7f616dc25700 1 --2- 172.21.15.158:0/2527471286 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6168152720 0x7f6168154b60 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f6158002f30 tx=0x7f6158010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.645 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.635+0000 7f61667fc700 1 -- 172.21.15.158:0/2527471286 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6158007160 con 0x7f6168152720 2019-12-05T03:50:06.645 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.635+0000 7f616f688700 1 -- 172.21.15.158:0/2527471286 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f616812eb10 con 0x7f6168152720 2019-12-05T03:50:06.646 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.635+0000 7f61667fc700 1 -- 172.21.15.158:0/2527471286 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61580087f0 con 0x7f6168152720 2019-12-05T03:50:06.646 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.635+0000 7f616f688700 1 -- 172.21.15.158:0/2527471286 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61681400c0 con 0x7f6168152720 2019-12-05T03:50:06.646 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.639+0000 7f616dc25700 1 --2- 172.21.15.158:0/2527471286 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6168152720 0x7f6168154b60 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f6158002f30 tx=0x7f6158010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.646 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.639+0000 7f61667fc700 1 -- 172.21.15.158:0/2527471286 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f6158008b00 con 0x7f6168152720 2019-12-05T03:50:06.646 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.639+0000 7f616dc25700 1 --2- 172.21.15.158:0/2527471286 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6168152720 0x7f6168154b60 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f6158002f30 tx=0x7f6158010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.646 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.639+0000 7f61667fc700 1 --2- 172.21.15.158:0/2527471286 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f614803b2b0 0x7f614803d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:06.646 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.639+0000 7f61667fc700 1 -- 172.21.15.158:0/2527471286 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f615804afd0 con 0x7f6168152720 2019-12-05T03:50:06.647 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.639+0000 7f616d424700 1 --2- 172.21.15.158:0/2527471286 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f614803b2b0 0x7f614803d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.647 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.639+0000 7f616d424700 1 --2- 172.21.15.158:0/2527471286 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f614803b2b0 0x7f614803d7c0 crc :-1 s=READY pgs=66 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:06.647 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.643+0000 7f616f688700 1 --2- 172.21.15.158:0/2527471286 >> [v2:172.21.15.96:6810/12461,v1:172.21.15.96:6811/12461] conn(0x7f6168054250 0x7f6168054680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:06.648 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.643+0000 7f616f688700 1 -- 172.21.15.158:0/2527471286 --> [v2:172.21.15.96:6810/12461,v1:172.21.15.96:6811/12461] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f616805a940 con 0x7f6168054250 2019-12-05T03:50:06.648 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.643+0000 7f616e426700 1 --2- 172.21.15.158:0/2527471286 >> [v2:172.21.15.96:6810/12461,v1:172.21.15.96:6811/12461] conn(0x7f6168054250 0x7f6168054680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.648 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.643+0000 7f616e426700 1 --2- 172.21.15.158:0/2527471286 >> [v2:172.21.15.96:6810/12461,v1:172.21.15.96:6811/12461] conn(0x7f6168054250 0x7f6168054680 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:06.648 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.647+0000 7f61667fc700 1 -- 172.21.15.158:0/2527471286 <== osd.5 v2:172.21.15.96:6810/12461 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23014 (crc 0 0 0) 0x7f616805a940 con 0x7f6168054250 2019-12-05T03:50:06.670 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.667+0000 7f616f688700 1 -- 172.21.15.158:0/2527471286 --> [v2:172.21.15.96:6810/12461,v1:172.21.15.96:6811/12461] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6168065780 con 0x7f6168054250 2019-12-05T03:50:06.671 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.667+0000 7f61667fc700 1 -- 172.21.15.158:0/2527471286 <== osd.5 v2:172.21.15.96:6810/12461 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6168065780 con 0x7f6168054250 2019-12-05T03:50:06.672 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.671+0000 7f616f688700 1 -- 172.21.15.158:0/2527471286 >> [v2:172.21.15.96:6810/12461,v1:172.21.15.96:6811/12461] conn(0x7f6168054250 msgr2=0x7f6168054680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.672 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.671+0000 7f616f688700 1 --2- 172.21.15.158:0/2527471286 >> [v2:172.21.15.96:6810/12461,v1:172.21.15.96:6811/12461] conn(0x7f6168054250 0x7f6168054680 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:06.673 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.671+0000 7f616f688700 1 -- 172.21.15.158:0/2527471286 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f614803b2b0 msgr2=0x7f614803d7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.673 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.671+0000 7f616f688700 1 --2- 172.21.15.158:0/2527471286 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f614803b2b0 0x7f614803d7c0 crc :-1 s=READY pgs=66 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:06.673 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.671+0000 7f616f688700 1 -- 172.21.15.158:0/2527471286 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6168152720 msgr2=0x7f6168154b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.673 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.671+0000 7f616f688700 1 --2- 172.21.15.158:0/2527471286 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6168152720 0x7f6168154b60 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7f6158002f30 tx=0x7f6158010ae0).stop 2019-12-05T03:50:06.673 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.671+0000 7f616e426700 1 -- 172.21.15.158:0/2527471286 reap_dead start 2019-12-05T03:50:06.673 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.671+0000 7f616f688700 1 -- 172.21.15.158:0/2527471286 shutdown_connections 2019-12-05T03:50:06.674 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.671+0000 7f616f688700 1 -- 172.21.15.158:0/2527471286 shutdown_connections 2019-12-05T03:50:06.674 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.671+0000 7f616f688700 1 -- 172.21.15.158:0/2527471286 wait complete. 2019-12-05T03:50:06.674 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.671+0000 7f616f688700 1 -- 172.21.15.158:0/2527471286 >> 172.21.15.158:0/2527471286 conn(0x7f61680ac6e0 msgr2=0x7f61680b52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:06.682 INFO:teuthology.orchestra.run.smithi158.stdout:55834574855 2019-12-05T03:50:06.682 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2019-12-05T03:50:06.784 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.779+0000 7faf45904700 1 Processor -- start 2019-12-05T03:50:06.784 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.779+0000 7faf45904700 1 -- start start 2019-12-05T03:50:06.785 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.779+0000 7faf45904700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7faf4009a310 0x7faf4005a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:06.785 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.779+0000 7faf45904700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf400acca0 con 0x7faf401553a0 2019-12-05T03:50:06.785 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.779+0000 7faf45904700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf400b6970 con 0x7faf4009cf50 2019-12-05T03:50:06.785 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.779+0000 7faf45904700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf4009a740 con 0x7faf4009a310 2019-12-05T03:50:06.785 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.779+0000 7faf3effd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7faf4009a310 0x7faf4005a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.785 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.779+0000 7faf3f7fe700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7faf4009cf50 0x7faf40151450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48430/0 (socket says 172.21.15.158:48430) 2019-12-05T03:50:06.785 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.779+0000 7faf3f7fe700 1 -- 172.21.15.158:0/116298747 learned_addr learned my addr 172.21.15.158:0/116298747 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:06.786 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.779+0000 7faf3effd700 1 -- 172.21.15.158:0/116298747 >> v1:172.21.15.158:6789/0 conn(0x7faf4009cf50 legacy=0x7faf40151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.786 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.779+0000 7faf3e7fc700 1 -- 172.21.15.158:0/116298747 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 655378796 0 0) 0x7faf400b6970 con 0x7faf4009cf50 2019-12-05T03:50:06.786 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.779+0000 7faf3effd700 1 -- 172.21.15.158:0/116298747 >> v1:172.21.15.96:6789/0 conn(0x7faf401553a0 legacy=0x7faf401557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.786 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.779+0000 7faf3effd700 1 -- 172.21.15.158:0/116298747 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf40155fd0 con 0x7faf4009a310 2019-12-05T03:50:06.786 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.779+0000 7faf3effd700 1 --2- 172.21.15.158:0/116298747 >> v2:172.21.15.158:3300/0 conn(0x7faf4009a310 0x7faf4005a730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7faf28008b10 tx=0x7faf2800ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.786 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.779+0000 7faf3effd700 1 --2- 172.21.15.158:0/116298747 >> v2:172.21.15.158:3300/0 conn(0x7faf4009a310 0x7faf4005a730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7faf28008b10 tx=0x7faf2800ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.786 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.779+0000 7faf3effd700 1 --2- 172.21.15.158:0/116298747 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faf4009a310 0x7faf4005a730 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7faf28008b10 tx=0x7faf2800ff70).ready entity=mon.1 client_cookie=bde82d68b45cab57 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:06.787 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.779+0000 7faf3effd700 1 --2- 172.21.15.158:0/116298747 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faf4009a310 0x7faf4005a730 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7faf28008b10 tx=0x7faf2800ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.787 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.779+0000 7faf3e7fc700 1 -- 172.21.15.158:0/116298747 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf28011990 con 0x7faf4009a310 2019-12-05T03:50:06.787 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.779+0000 7faf3effd700 1 --2- 172.21.15.158:0/116298747 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faf4009a310 0x7faf4005a730 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7faf28008b10 tx=0x7faf2800ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.787 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.779+0000 7faf3e7fc700 1 -- 172.21.15.158:0/116298747 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf280115b0 con 0x7faf4009a310 2019-12-05T03:50:06.787 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.779+0000 7faf3effd700 1 --2- 172.21.15.158:0/116298747 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faf4009a310 0x7faf4005a730 secure :-1 s=THROTTLE_DONE pgs=118 cs=0 l=1 rx=0x7faf28008b10 tx=0x7faf2800ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.787 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.779+0000 7faf45904700 1 -- 172.21.15.158:0/116298747 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faf4009a310 msgr2=0x7faf4005a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.787 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.779+0000 7faf3e7fc700 1 -- 172.21.15.158:0/116298747 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf2800a160 con 0x7faf4009a310 2019-12-05T03:50:06.788 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.779+0000 7faf45904700 1 --2- 172.21.15.158:0/116298747 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faf4009a310 0x7faf4005a730 secure :-1 s=READY pgs=118 cs=0 l=1 rx=0x7faf28008b10 tx=0x7faf2800ff70).stop 2019-12-05T03:50:06.788 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.783+0000 7faf45904700 1 -- 172.21.15.158:0/116298747 shutdown_connections 2019-12-05T03:50:06.788 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.783+0000 7faf45904700 1 --2- 172.21.15.158:0/116298747 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7faf4009a310 0x7faf4005a730 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:06.788 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.783+0000 7faf45904700 1 -- 172.21.15.158:0/116298747 shutdown_connections 2019-12-05T03:50:06.788 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.783+0000 7faf45904700 1 -- 172.21.15.158:0/116298747 wait complete. 2019-12-05T03:50:06.788 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.783+0000 7faf45904700 1 -- 172.21.15.158:0/116298747 >> 172.21.15.158:0/116298747 conn(0x7faf400b7e50 msgr2=0x7faf400b3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:06.790 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.783+0000 7faf45904700 1 Processor -- start 2019-12-05T03:50:06.791 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.783+0000 7faf45904700 1 -- start start 2019-12-05T03:50:06.791 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.783+0000 7faf45904700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7faf4007b390 0x7faf400adc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:06.791 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.783+0000 7faf45904700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf4013d210 0x7faf4013d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:06.791 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.783+0000 7faf45904700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf400b1050 con 0x7faf400b0c20 2019-12-05T03:50:06.791 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.783+0000 7faf45904700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf4007da20 con 0x7faf4007b390 2019-12-05T03:50:06.791 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.783+0000 7faf45904700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf400ad460 con 0x7faf4013d210 2019-12-05T03:50:06.791 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.783+0000 7faf3f7fe700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7faf4007b390 0x7faf400adc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.792 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.783+0000 7faf3f7fe700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7faf4007b390 0x7faf400adc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.158:40248/0 (socket says 172.21.15.158:40248) 2019-12-05T03:50:06.792 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.783+0000 7faf3f7fe700 1 -- 172.21.15.158:0/3525653692 learned_addr learned my addr 172.21.15.158:0/3525653692 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:06.792 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.783+0000 7faf3ffff700 1 --2- 172.21.15.158:0/3525653692 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf4013d210 0x7faf4013d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.792 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.787+0000 7faf3ffff700 1 -- 172.21.15.158:0/3525653692 >> v2:172.21.15.96:3300/0 conn(0x7faf4007b390 msgr2=0x7faf400adc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.792 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.787+0000 7faf3ffff700 1 --2- 172.21.15.158:0/3525653692 >> v2:172.21.15.96:3300/0 conn(0x7faf4007b390 0x7faf400adc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:06.792 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.787+0000 7faf3ffff700 1 -- 172.21.15.158:0/3525653692 >> v1:172.21.15.96:6789/0 conn(0x7faf400b0c20 legacy=0x7faf4007bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.792 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.787+0000 7faf3ffff700 1 -- 172.21.15.158:0/3525653692 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4012e260 con 0x7faf4013d210 2019-12-05T03:50:06.793 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.787+0000 7faf3ffff700 1 --2- 172.21.15.158:0/3525653692 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf4013d210 0x7faf4013d640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7faf38000b80 tx=0x7faf38010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.793 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.787+0000 7faf3ffff700 1 --2- 172.21.15.158:0/3525653692 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf4013d210 0x7faf4013d640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7faf38000b80 tx=0x7faf38010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.793 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.787+0000 7faf3ffff700 1 --2- 172.21.15.158:0/3525653692 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf4013d210 0x7faf4013d640 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7faf38000b80 tx=0x7faf38010780).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:06.793 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.787+0000 7faf3ffff700 1 --2- 172.21.15.158:0/3525653692 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf4013d210 0x7faf4013d640 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7faf38000b80 tx=0x7faf38010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.793 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.787+0000 7faf3ffff700 1 --2- 172.21.15.158:0/3525653692 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf4013d210 0x7faf4013d640 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7faf38000b80 tx=0x7faf38010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.793 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.787+0000 7faf3ffff700 1 --2- 172.21.15.158:0/3525653692 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf4013d210 0x7faf4013d640 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7faf38000b80 tx=0x7faf38010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.793 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.787+0000 7faf37fff700 1 -- 172.21.15.158:0/3525653692 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf38006a40 con 0x7faf4013d210 2019-12-05T03:50:06.794 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.787+0000 7faf37fff700 1 -- 172.21.15.158:0/3525653692 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf38006660 con 0x7faf4013d210 2019-12-05T03:50:06.794 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.787+0000 7faf45904700 1 -- 172.21.15.158:0/3525653692 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf4013db90 con 0x7faf4013d210 2019-12-05T03:50:06.794 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.787+0000 7faf37fff700 1 -- 172.21.15.158:0/3525653692 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf38010fc0 con 0x7faf4013d210 2019-12-05T03:50:06.794 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.787+0000 7faf45904700 1 -- 172.21.15.158:0/3525653692 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf4013e0c0 con 0x7faf4013d210 2019-12-05T03:50:06.794 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.787+0000 7faf3ffff700 1 --2- 172.21.15.158:0/3525653692 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf4013d210 0x7faf4013d640 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7faf38000b80 tx=0x7faf38010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.794 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.787+0000 7faf37fff700 1 -- 172.21.15.158:0/3525653692 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7faf380112d0 con 0x7faf4013d210 2019-12-05T03:50:06.794 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.787+0000 7faf3ffff700 1 --2- 172.21.15.158:0/3525653692 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf4013d210 0x7faf4013d640 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7faf38000b80 tx=0x7faf38010780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.795 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.787+0000 7faf37fff700 1 --2- 172.21.15.158:0/3525653692 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7faf2403acb0 0x7faf2403d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:06.795 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.791+0000 7faf37fff700 1 -- 172.21.15.158:0/3525653692 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7faf3804b060 con 0x7faf4013d210 2019-12-05T03:50:06.795 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.791+0000 7faf3f7fe700 1 --2- 172.21.15.158:0/3525653692 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7faf2403acb0 0x7faf2403d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.796 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.791+0000 7faf3f7fe700 1 --2- 172.21.15.158:0/3525653692 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7faf2403acb0 0x7faf2403d1c0 crc :-1 s=READY pgs=67 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:06.796 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.795+0000 7faf45904700 1 --2- 172.21.15.158:0/3525653692 >> [v2:172.21.15.96:6826/12463,v1:172.21.15.96:6827/12463] conn(0x7faf40054250 0x7faf40054680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:06.796 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.795+0000 7faf45904700 1 -- 172.21.15.158:0/3525653692 --> [v2:172.21.15.96:6826/12463,v1:172.21.15.96:6827/12463] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faf400554d0 con 0x7faf40054250 2019-12-05T03:50:06.797 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.795+0000 7faf3effd700 1 --2- 172.21.15.158:0/3525653692 >> [v2:172.21.15.96:6826/12463,v1:172.21.15.96:6827/12463] conn(0x7faf40054250 0x7faf40054680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.797 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.795+0000 7faf3effd700 1 --2- 172.21.15.158:0/3525653692 >> [v2:172.21.15.96:6826/12463,v1:172.21.15.96:6827/12463] conn(0x7faf40054250 0x7faf40054680 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:06.805 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.795+0000 7faf37fff700 1 -- 172.21.15.158:0/3525653692 <== osd.6 v2:172.21.15.96:6826/12463 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23014 (crc 0 0 0) 0x7faf400554d0 con 0x7faf40054250 2019-12-05T03:50:06.821 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.819+0000 7faf45904700 1 -- 172.21.15.158:0/3525653692 --> [v2:172.21.15.96:6826/12463,v1:172.21.15.96:6827/12463] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faf40066930 con 0x7faf40054250 2019-12-05T03:50:06.822 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.819+0000 7faf37fff700 1 -- 172.21.15.158:0/3525653692 <== osd.6 v2:172.21.15.96:6826/12463 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7faf40066930 con 0x7faf40054250 2019-12-05T03:50:06.823 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.819+0000 7faf45904700 1 -- 172.21.15.158:0/3525653692 >> [v2:172.21.15.96:6826/12463,v1:172.21.15.96:6827/12463] conn(0x7faf40054250 msgr2=0x7faf40054680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.823 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.819+0000 7faf45904700 1 --2- 172.21.15.158:0/3525653692 >> [v2:172.21.15.96:6826/12463,v1:172.21.15.96:6827/12463] conn(0x7faf40054250 0x7faf40054680 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:06.824 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.819+0000 7faf45904700 1 -- 172.21.15.158:0/3525653692 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7faf2403acb0 msgr2=0x7faf2403d1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.824 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.823+0000 7faf45904700 1 --2- 172.21.15.158:0/3525653692 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7faf2403acb0 0x7faf2403d1c0 crc :-1 s=READY pgs=67 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:06.824 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.823+0000 7faf45904700 1 -- 172.21.15.158:0/3525653692 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf4013d210 msgr2=0x7faf4013d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.824 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.823+0000 7faf45904700 1 --2- 172.21.15.158:0/3525653692 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faf4013d210 0x7faf4013d640 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7faf38000b80 tx=0x7faf38010780).stop 2019-12-05T03:50:06.824 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.823+0000 7faf3ffff700 1 -- 172.21.15.158:0/3525653692 reap_dead start 2019-12-05T03:50:06.825 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.823+0000 7faf45904700 1 -- 172.21.15.158:0/3525653692 shutdown_connections 2019-12-05T03:50:06.825 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.823+0000 7faf45904700 1 -- 172.21.15.158:0/3525653692 shutdown_connections 2019-12-05T03:50:06.825 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.823+0000 7faf45904700 1 -- 172.21.15.158:0/3525653692 wait complete. 2019-12-05T03:50:06.825 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.823+0000 7faf45904700 1 -- 172.21.15.158:0/3525653692 >> 172.21.15.158:0/3525653692 conn(0x7faf4007e030 msgr2=0x7faf4012e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:06.834 INFO:teuthology.orchestra.run.smithi158.stdout:55834574854 2019-12-05T03:50:06.834 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2019-12-05T03:50:06.943 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.935+0000 7f040e039700 1 Processor -- start 2019-12-05T03:50:06.944 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.935+0000 7f040e039700 1 -- start start 2019-12-05T03:50:06.944 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.935+0000 7f040e039700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f040809cf60 0x7f040809a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:06.944 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.935+0000 7f040e039700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f040805a740 0x7f0408151460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:06.944 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.935+0000 7f040e039700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04080accb0 con 0x7f04081519b0 2019-12-05T03:50:06.944 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.935+0000 7f040e039700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04080b1730 con 0x7f040805a740 2019-12-05T03:50:06.944 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.935+0000 7f040e039700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04080b19d0 con 0x7f040809cf60 2019-12-05T03:50:06.945 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.939+0000 7f04077fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f040805a740 0x7f0408151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.945 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.939+0000 7f04077fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f040805a740 0x7f0408151460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53668/0 (socket says 172.21.15.158:53668) 2019-12-05T03:50:06.945 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.939+0000 7f04077fe700 1 -- 172.21.15.158:0/3624401875 learned_addr learned my addr 172.21.15.158:0/3624401875 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:06.945 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.939+0000 7f0407fff700 1 --2- 172.21.15.158:0/3624401875 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f040809cf60 0x7f040809a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.945 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.939+0000 7f04077fe700 1 -- 172.21.15.158:0/3624401875 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f040809cf60 msgr2=0x7f040809a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:06.945 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.939+0000 7f04077fe700 1 --2- 172.21.15.158:0/3624401875 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f040809cf60 0x7f040809a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:06.946 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.939+0000 7f04077fe700 1 -- 172.21.15.158:0/3624401875 >> v1:172.21.15.96:6789/0 conn(0x7f04081519b0 legacy=0x7f04080b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.946 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.939+0000 7f04077fe700 1 -- 172.21.15.158:0/3624401875 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f040805ab70 con 0x7f040805a740 2019-12-05T03:50:06.946 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.939+0000 7f04077fe700 1 --2- 172.21.15.158:0/3624401875 >> v2:172.21.15.158:3300/0 conn(0x7f040805a740 0x7f0408151460 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f04080b18f0 tx=0x7f03fc00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.946 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.939+0000 7f04077fe700 1 --2- 172.21.15.158:0/3624401875 >> v2:172.21.15.158:3300/0 conn(0x7f040805a740 0x7f0408151460 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f04080b18f0 tx=0x7f03fc00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.946 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.939+0000 7f04077fe700 1 --2- 172.21.15.158:0/3624401875 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f040805a740 0x7f0408151460 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7f04080b18f0 tx=0x7f03fc00fd30).ready entity=mon.1 client_cookie=caec21f7fda71a53 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:06.946 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.939+0000 7f04077fe700 1 --2- 172.21.15.158:0/3624401875 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f040805a740 0x7f0408151460 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7f04080b18f0 tx=0x7f03fc00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.946 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.939+0000 7f04077fe700 1 --2- 172.21.15.158:0/3624401875 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f040805a740 0x7f0408151460 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7f04080b18f0 tx=0x7f03fc00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.947 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.939+0000 7f0406ffd700 1 -- 172.21.15.158:0/3624401875 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03fc0113b0 con 0x7f040805a740 2019-12-05T03:50:06.947 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.939+0000 7f04077fe700 1 --2- 172.21.15.158:0/3624401875 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f040805a740 0x7f0408151460 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7f04080b18f0 tx=0x7f03fc00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.947 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.939+0000 7f0406ffd700 1 -- 172.21.15.158:0/3624401875 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03fc008bb0 con 0x7f040805a740 2019-12-05T03:50:06.947 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.939+0000 7f0406ffd700 1 -- 172.21.15.158:0/3624401875 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03fc011990 con 0x7f040805a740 2019-12-05T03:50:06.947 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.939+0000 7f040e039700 1 -- 172.21.15.158:0/3624401875 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f040805a740 msgr2=0x7f0408151460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.947 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.939+0000 7f040e039700 1 --2- 172.21.15.158:0/3624401875 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f040805a740 0x7f0408151460 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7f04080b18f0 tx=0x7f03fc00fd30).stop 2019-12-05T03:50:06.948 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.939+0000 7f040e039700 1 -- 172.21.15.158:0/3624401875 shutdown_connections 2019-12-05T03:50:06.948 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.939+0000 7f040e039700 1 --2- 172.21.15.158:0/3624401875 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f040809cf60 0x7f040809a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:06.948 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.939+0000 7f040e039700 1 --2- 172.21.15.158:0/3624401875 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f040805a740 0x7f0408151460 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:06.948 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.939+0000 7f040e039700 1 -- 172.21.15.158:0/3624401875 shutdown_connections 2019-12-05T03:50:06.948 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.939+0000 7f040e039700 1 -- 172.21.15.158:0/3624401875 wait complete. 2019-12-05T03:50:06.948 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.939+0000 7f040e039700 1 -- 172.21.15.158:0/3624401875 >> 172.21.15.158:0/3624401875 conn(0x7f04080b7e60 msgr2=0x7f04080b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:06.952 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.943+0000 7f040e039700 1 Processor -- start 2019-12-05T03:50:06.953 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.943+0000 7f040e039700 1 -- start start 2019-12-05T03:50:06.953 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.943+0000 7f040e039700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f04080b0ed0 0x7f040807b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:06.953 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.943+0000 7f040e039700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f040809beb0 0x7f0408133270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:06.953 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.943+0000 7f040e039700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f040809a320 con 0x7f0408152120 2019-12-05T03:50:06.953 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.943+0000 7f040e039700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04080ac890 con 0x7f04080b0ed0 2019-12-05T03:50:06.953 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.943+0000 7f040e039700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0408152dc0 con 0x7f040809beb0 2019-12-05T03:50:06.954 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.943+0000 7f04077fe700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f0408152120 0x7f04081544a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48456/0 (socket says 172.21.15.158:48456) 2019-12-05T03:50:06.954 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.943+0000 7f04077fe700 1 -- 172.21.15.158:0/1324856877 learned_addr learned my addr 172.21.15.158:0/1324856877 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:06.954 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.943+0000 7f0407fff700 1 --2- 172.21.15.158:0/1324856877 >> v2:172.21.15.96:3300/0 conn(0x7f04080b0ed0 0x7f040807b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.954 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.943+0000 7f040cdd7700 1 --2- 172.21.15.158:0/1324856877 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f040809beb0 0x7f0408133270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.954 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.943+0000 7f0404ff9700 1 -- 172.21.15.158:0/1324856877 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 290187385 0 0) 0x7f040809a320 con 0x7f0408152120 2019-12-05T03:50:06.954 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.943+0000 7f0404ff9700 1 -- 172.21.15.158:0/1324856877 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03e80030b0 con 0x7f0408152120 2019-12-05T03:50:06.954 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.943+0000 7f0407fff700 1 -- 172.21.15.158:0/1324856877 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f040809beb0 msgr2=0x7f0408133270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.955 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.943+0000 7f0407fff700 1 --2- 172.21.15.158:0/1324856877 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f040809beb0 0x7f0408133270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:06.955 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.943+0000 7f0407fff700 1 -- 172.21.15.158:0/1324856877 >> v1:172.21.15.158:6789/0 conn(0x7f0408152120 legacy=0x7f04081544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.955 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.943+0000 7f0407fff700 1 -- 172.21.15.158:0/1324856877 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0408154ca0 con 0x7f04080b0ed0 2019-12-05T03:50:06.955 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.943+0000 7f040cdd7700 1 --2- 172.21.15.158:0/1324856877 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f040809beb0 0x7f0408133270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:50:06.955 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.943+0000 7f0407fff700 1 --2- 172.21.15.158:0/1324856877 >> v2:172.21.15.96:3300/0 conn(0x7f04080b0ed0 0x7f040807b450 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0408152f80 tx=0x7f03f8010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.955 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.943+0000 7f0407fff700 1 --2- 172.21.15.158:0/1324856877 >> v2:172.21.15.96:3300/0 conn(0x7f04080b0ed0 0x7f040807b450 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0408152f80 tx=0x7f03f8010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.956 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.943+0000 7f0407fff700 1 --2- 172.21.15.158:0/1324856877 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04080b0ed0 0x7f040807b450 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f0408152f80 tx=0x7f03f8010a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:06.956 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.943+0000 7f0407fff700 1 --2- 172.21.15.158:0/1324856877 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04080b0ed0 0x7f040807b450 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f0408152f80 tx=0x7f03f8010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.956 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.943+0000 7f0404ff9700 1 -- 172.21.15.158:0/1324856877 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03f8012960 con 0x7f04080b0ed0 2019-12-05T03:50:06.956 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.943+0000 7f0407fff700 1 --2- 172.21.15.158:0/1324856877 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04080b0ed0 0x7f040807b450 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f0408152f80 tx=0x7f03f8010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.956 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.943+0000 7f040e039700 1 -- 172.21.15.158:0/1324856877 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04081337c0 con 0x7f04080b0ed0 2019-12-05T03:50:06.956 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.943+0000 7f0404ff9700 1 -- 172.21.15.158:0/1324856877 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f8012580 con 0x7f04080b0ed0 2019-12-05T03:50:06.956 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.943+0000 7f0407fff700 1 --2- 172.21.15.158:0/1324856877 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04080b0ed0 0x7f040807b450 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f0408152f80 tx=0x7f03f8010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.957 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.943+0000 7f0404ff9700 1 -- 172.21.15.158:0/1324856877 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03f8005540 con 0x7f04080b0ed0 2019-12-05T03:50:06.957 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.943+0000 7f040e039700 1 -- 172.21.15.158:0/1324856877 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0408133d40 con 0x7f04080b0ed0 2019-12-05T03:50:06.957 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.947+0000 7f0407fff700 1 --2- 172.21.15.158:0/1324856877 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04080b0ed0 0x7f040807b450 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f0408152f80 tx=0x7f03f8010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.957 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.947+0000 7f0404ff9700 1 -- 172.21.15.158:0/1324856877 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f03f80058a0 con 0x7f04080b0ed0 2019-12-05T03:50:06.957 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.947+0000 7f0407fff700 1 --2- 172.21.15.158:0/1324856877 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04080b0ed0 0x7f040807b450 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f0408152f80 tx=0x7f03f8010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:06.957 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.947+0000 7f0404ff9700 1 --2- 172.21.15.158:0/1324856877 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f03e803b210 0x7f03e803d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:06.957 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.947+0000 7f0404ff9700 1 -- 172.21.15.158:0/1324856877 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f03f804afc0 con 0x7f04080b0ed0 2019-12-05T03:50:06.958 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.947+0000 7f04077fe700 1 --2- 172.21.15.158:0/1324856877 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f03e803b210 0x7f03e803d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.958 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.947+0000 7f04077fe700 1 --2- 172.21.15.158:0/1324856877 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f03e803b210 0x7f03e803d720 crc :-1 s=READY pgs=68 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:06.958 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.951+0000 7f040e039700 1 --2- 172.21.15.158:0/1324856877 >> [v2:172.21.15.96:6818/12462,v1:172.21.15.96:6819/12462] conn(0x7f0408152fc0 0x7f040813da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:06.958 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.951+0000 7f040e039700 1 -- 172.21.15.158:0/1324856877 --> [v2:172.21.15.96:6818/12462,v1:172.21.15.96:6819/12462] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f04080b8070 con 0x7f0408152fc0 2019-12-05T03:50:06.958 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.951+0000 7f040cdd7700 1 --2- 172.21.15.158:0/1324856877 >> [v2:172.21.15.96:6818/12462,v1:172.21.15.96:6819/12462] conn(0x7f0408152fc0 0x7f040813da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:06.958 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.951+0000 7f040cdd7700 1 --2- 172.21.15.158:0/1324856877 >> [v2:172.21.15.96:6818/12462,v1:172.21.15.96:6819/12462] conn(0x7f0408152fc0 0x7f040813da70 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:06.959 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.951+0000 7f0404ff9700 1 -- 172.21.15.158:0/1324856877 <== osd.7 v2:172.21.15.96:6818/12462 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23014 (crc 0 0 0) 0x7f04080b8070 con 0x7f0408152fc0 2019-12-05T03:50:06.976 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.975+0000 7f040e039700 1 -- 172.21.15.158:0/1324856877 --> [v2:172.21.15.96:6818/12462,v1:172.21.15.96:6819/12462] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f040805a950 con 0x7f0408152fc0 2019-12-05T03:50:06.976 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.975+0000 7f0404ff9700 1 -- 172.21.15.158:0/1324856877 <== osd.7 v2:172.21.15.96:6818/12462 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f040805a950 con 0x7f0408152fc0 2019-12-05T03:50:06.978 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.975+0000 7f040e039700 1 -- 172.21.15.158:0/1324856877 >> [v2:172.21.15.96:6818/12462,v1:172.21.15.96:6819/12462] conn(0x7f0408152fc0 msgr2=0x7f040813da70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.978 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.975+0000 7f040e039700 1 --2- 172.21.15.158:0/1324856877 >> [v2:172.21.15.96:6818/12462,v1:172.21.15.96:6819/12462] conn(0x7f0408152fc0 0x7f040813da70 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:06.978 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.975+0000 7f040e039700 1 -- 172.21.15.158:0/1324856877 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f03e803b210 msgr2=0x7f03e803d720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.979 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.975+0000 7f040e039700 1 --2- 172.21.15.158:0/1324856877 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f03e803b210 0x7f03e803d720 crc :-1 s=READY pgs=68 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:06.979 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.975+0000 7f040e039700 1 -- 172.21.15.158:0/1324856877 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04080b0ed0 msgr2=0x7f040807b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:06.979 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.975+0000 7f040e039700 1 --2- 172.21.15.158:0/1324856877 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04080b0ed0 0x7f040807b450 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f0408152f80 tx=0x7f03f8010a90).stop 2019-12-05T03:50:06.979 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.975+0000 7f040cdd7700 1 -- 172.21.15.158:0/1324856877 reap_dead start 2019-12-05T03:50:06.979 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.975+0000 7f040e039700 1 -- 172.21.15.158:0/1324856877 shutdown_connections 2019-12-05T03:50:06.979 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.975+0000 7f040e039700 1 --2- 172.21.15.158:0/1324856877 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04080b0ed0 0x7f040807b450 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:06.980 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.975+0000 7f040e039700 1 -- 172.21.15.158:0/1324856877 shutdown_connections 2019-12-05T03:50:06.980 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.975+0000 7f040e039700 1 -- 172.21.15.158:0/1324856877 wait complete. 2019-12-05T03:50:06.980 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:06.975+0000 7f040e039700 1 -- 172.21.15.158:0/1324856877 >> 172.21.15.158:0/1324856877 conn(0x7f0408155390 msgr2=0x7f0408155b70 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:06.993 INFO:teuthology.orchestra.run.smithi158.stdout:55834574854 2019-12-05T03:50:06.993 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2019-12-05T03:50:07.094 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.087+0000 7fc8525cb700 1 Processor -- start 2019-12-05T03:50:07.094 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.087+0000 7fc8525cb700 1 -- start start 2019-12-05T03:50:07.095 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.087+0000 7fc8525cb700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc84c09a310 0x7fc84c05a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:07.095 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.087+0000 7fc8525cb700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc84c1553a0 0x7fc84c1557d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:07.095 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.087+0000 7fc8525cb700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc84c0acca0 con 0x7fc84c09cf50 2019-12-05T03:50:07.095 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.087+0000 7fc8525cb700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc84c09a740 con 0x7fc84c1553a0 2019-12-05T03:50:07.095 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.087+0000 7fc8525cb700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c0b1720 con 0x7fc84c09a310 2019-12-05T03:50:07.095 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.087+0000 7fc850b68700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fc84c09cf50 0x7fc84c151450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48462/0 (socket says 172.21.15.158:48462) 2019-12-05T03:50:07.096 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.087+0000 7fc850b68700 1 -- 172.21.15.158:0/274887085 learned_addr learned my addr 172.21.15.158:0/274887085 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:07.096 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.087+0000 7fc851369700 1 --2- 172.21.15.158:0/274887085 >> v2:172.21.15.96:3300/0 conn(0x7fc84c1553a0 0x7fc84c1557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:07.096 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.087+0000 7fc84bfff700 1 --2- 172.21.15.158:0/274887085 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc84c09a310 0x7fc84c05a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:07.096 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.087+0000 7fc84b7fe700 1 -- 172.21.15.158:0/274887085 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1050889585 0 0) 0x7fc84c0acca0 con 0x7fc84c09cf50 2019-12-05T03:50:07.096 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.091+0000 7fc84b7fe700 1 -- 172.21.15.158:0/274887085 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8380030b0 con 0x7fc84c09cf50 2019-12-05T03:50:07.096 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.091+0000 7fc851369700 1 -- 172.21.15.158:0/274887085 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc84c09a310 msgr2=0x7fc84c05a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:07.096 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.091+0000 7fc851369700 1 --2- 172.21.15.158:0/274887085 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc84c09a310 0x7fc84c05a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:07.097 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.091+0000 7fc851369700 1 -- 172.21.15.158:0/274887085 >> v1:172.21.15.158:6789/0 conn(0x7fc84c09cf50 legacy=0x7fc84c151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:07.097 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.091+0000 7fc851369700 1 -- 172.21.15.158:0/274887085 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc84c0b6970 con 0x7fc84c1553a0 2019-12-05T03:50:07.097 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.091+0000 7fc851369700 1 --2- 172.21.15.158:0/274887085 >> v2:172.21.15.96:3300/0 conn(0x7fc84c1553a0 0x7fc84c1557d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc83c008790 tx=0x7fc83c00fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:07.097 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.091+0000 7fc851369700 1 --2- 172.21.15.158:0/274887085 >> v2:172.21.15.96:3300/0 conn(0x7fc84c1553a0 0x7fc84c1557d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc83c008790 tx=0x7fc83c00fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:07.097 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.091+0000 7fc851369700 1 --2- 172.21.15.158:0/274887085 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc84c1553a0 0x7fc84c1557d0 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7fc83c008790 tx=0x7fc83c00fc70).ready entity=mon.0 client_cookie=811ec75992eabc5c server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:07.097 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.091+0000 7fc851369700 1 --2- 172.21.15.158:0/274887085 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc84c1553a0 0x7fc84c1557d0 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7fc83c008790 tx=0x7fc83c00fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:07.097 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.091+0000 7fc84b7fe700 1 -- 172.21.15.158:0/274887085 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc83c0112f0 con 0x7fc84c1553a0 2019-12-05T03:50:07.098 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.091+0000 7fc851369700 1 --2- 172.21.15.158:0/274887085 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc84c1553a0 0x7fc84c1557d0 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7fc83c008790 tx=0x7fc83c00fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:07.098 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.091+0000 7fc84b7fe700 1 -- 172.21.15.158:0/274887085 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83c008ad0 con 0x7fc84c1553a0 2019-12-05T03:50:07.098 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.091+0000 7fc851369700 1 --2- 172.21.15.158:0/274887085 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc84c1553a0 0x7fc84c1557d0 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7fc83c008790 tx=0x7fc83c00fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:07.098 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.091+0000 7fc84b7fe700 1 -- 172.21.15.158:0/274887085 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc83c0118d0 con 0x7fc84c1553a0 2019-12-05T03:50:07.098 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.091+0000 7fc8525cb700 1 -- 172.21.15.158:0/274887085 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc84c1553a0 msgr2=0x7fc84c1557d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:07.098 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.091+0000 7fc8525cb700 1 --2- 172.21.15.158:0/274887085 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc84c1553a0 0x7fc84c1557d0 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7fc83c008790 tx=0x7fc83c00fc70).stop 2019-12-05T03:50:07.098 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.091+0000 7fc8525cb700 1 -- 172.21.15.158:0/274887085 shutdown_connections 2019-12-05T03:50:07.099 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.091+0000 7fc8525cb700 1 --2- 172.21.15.158:0/274887085 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc84c1553a0 0x7fc84c1557d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:07.099 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.091+0000 7fc8525cb700 1 --2- 172.21.15.158:0/274887085 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc84c09a310 0x7fc84c05a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:07.099 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.091+0000 7fc8525cb700 1 -- 172.21.15.158:0/274887085 shutdown_connections 2019-12-05T03:50:07.099 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.091+0000 7fc8525cb700 1 -- 172.21.15.158:0/274887085 wait complete. 2019-12-05T03:50:07.099 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.091+0000 7fc8525cb700 1 -- 172.21.15.158:0/274887085 >> 172.21.15.158:0/274887085 conn(0x7fc84c0b7e50 msgr2=0x7fc84c0b3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:07.104 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.091+0000 7fc8525cb700 1 Processor -- start 2019-12-05T03:50:07.104 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.095+0000 7fc8525cb700 1 -- start start 2019-12-05T03:50:07.104 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.095+0000 7fc8525cb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fc84c151220 0x7fc84c151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:07.104 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.095+0000 7fc8525cb700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc84c064440 0x7fc84c131720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:07.104 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.095+0000 7fc8525cb700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc84c064870 con 0x7fc84c131c70 2019-12-05T03:50:07.104 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.095+0000 7fc8525cb700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc84c09b890 con 0x7fc84c064440 2019-12-05T03:50:07.105 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.095+0000 7fc8525cb700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc84c151650 con 0x7fc84c151220 2019-12-05T03:50:07.105 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.095+0000 7fc850b68700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fc84c151220 0x7fc84c151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:07.105 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.095+0000 7fc850b68700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fc84c151220 0x7fc84c151e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53688/0 (socket says 172.21.15.158:53688) 2019-12-05T03:50:07.105 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.095+0000 7fc850b68700 1 -- 172.21.15.158:0/3042968905 learned_addr learned my addr 172.21.15.158:0/3042968905 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:07.105 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.095+0000 7fc84bfff700 1 --2- 172.21.15.158:0/3042968905 >> v2:172.21.15.96:3300/0 conn(0x7fc84c064440 0x7fc84c131720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:07.105 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.095+0000 7fc850b68700 1 -- 172.21.15.158:0/3042968905 >> v2:172.21.15.96:3300/0 conn(0x7fc84c064440 msgr2=0x7fc84c131720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:07.105 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.095+0000 7fc850b68700 1 --2- 172.21.15.158:0/3042968905 >> v2:172.21.15.96:3300/0 conn(0x7fc84c064440 0x7fc84c131720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:07.106 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.095+0000 7fc850b68700 1 -- 172.21.15.158:0/3042968905 >> v1:172.21.15.96:6789/0 conn(0x7fc84c131c70 legacy=0x7fc84c12ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:07.106 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.095+0000 7fc850b68700 1 -- 172.21.15.158:0/3042968905 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc84c0b0e00 con 0x7fc84c151220 2019-12-05T03:50:07.107 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.095+0000 7fc850b68700 1 --2- 172.21.15.158:0/3042968905 >> v2:172.21.15.158:3300/0 conn(0x7fc84c151220 0x7fc84c151e30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc84c1321c0 tx=0x7fc844010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:07.107 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.095+0000 7fc850b68700 1 --2- 172.21.15.158:0/3042968905 >> v2:172.21.15.158:3300/0 conn(0x7fc84c151220 0x7fc84c151e30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc84c1321c0 tx=0x7fc844010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:07.108 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.095+0000 7fc850b68700 1 --2- 172.21.15.158:0/3042968905 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc84c151220 0x7fc84c151e30 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7fc84c1321c0 tx=0x7fc844010d80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:07.109 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.095+0000 7fc850b68700 1 --2- 172.21.15.158:0/3042968905 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc84c151220 0x7fc84c151e30 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7fc84c1321c0 tx=0x7fc844010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:07.109 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.095+0000 7fc8497fa700 1 -- 172.21.15.158:0/3042968905 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc844010440 con 0x7fc84c151220 2019-12-05T03:50:07.109 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.095+0000 7fc850b68700 1 --2- 172.21.15.158:0/3042968905 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc84c151220 0x7fc84c151e30 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7fc84c1321c0 tx=0x7fc844010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:07.109 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.095+0000 7fc850b68700 1 --2- 172.21.15.158:0/3042968905 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc84c151220 0x7fc84c151e30 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7fc84c1321c0 tx=0x7fc844010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:07.109 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.095+0000 7fc8497fa700 1 -- 172.21.15.158:0/3042968905 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc84400cc40 con 0x7fc84c151220 2019-12-05T03:50:07.109 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.095+0000 7fc8525cb700 1 -- 172.21.15.158:0/3042968905 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc84c12d670 con 0x7fc84c151220 2019-12-05T03:50:07.110 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.095+0000 7fc8497fa700 1 -- 172.21.15.158:0/3042968905 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc844012570 con 0x7fc84c151220 2019-12-05T03:50:07.110 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.095+0000 7fc8525cb700 1 -- 172.21.15.158:0/3042968905 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc84c13f6f0 con 0x7fc84c151220 2019-12-05T03:50:07.110 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.095+0000 7fc850b68700 1 --2- 172.21.15.158:0/3042968905 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc84c151220 0x7fc84c151e30 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7fc84c1321c0 tx=0x7fc844010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:07.110 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.099+0000 7fc8497fa700 1 -- 172.21.15.158:0/3042968905 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fc844012880 con 0x7fc84c151220 2019-12-05T03:50:07.110 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.099+0000 7fc850b68700 1 --2- 172.21.15.158:0/3042968905 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc84c151220 0x7fc84c151e30 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7fc84c1321c0 tx=0x7fc844010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:07.110 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.099+0000 7fc8497fa700 1 --2- 172.21.15.158:0/3042968905 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fc83003ad30 0x7fc83003d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:07.110 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.099+0000 7fc8497fa700 1 -- 172.21.15.158:0/3042968905 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fc84404b320 con 0x7fc84c151220 2019-12-05T03:50:07.111 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.099+0000 7fc84bfff700 1 --2- 172.21.15.158:0/3042968905 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fc83003ad30 0x7fc83003d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:07.111 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.099+0000 7fc84bfff700 1 --2- 172.21.15.158:0/3042968905 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fc83003ad30 0x7fc83003d240 crc :-1 s=READY pgs=69 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:07.111 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.103+0000 7fc8525cb700 1 -- 172.21.15.158:0/3042968905 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc84c0554d0 con 0x7fc84c151220 2019-12-05T03:50:07.113 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.111+0000 7fc850b68700 1 --2- 172.21.15.158:0/3042968905 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc84c151220 0x7fc84c151e30 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7fc84c1321c0 tx=0x7fc844010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:07.113 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.111+0000 7fc8497fa700 1 -- 172.21.15.158:0/3042968905 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fc8440323a0 con 0x7fc84c151220 2019-12-05T03:50:07.292 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.291+0000 7fc8525cb700 1 -- 172.21.15.158:0/3042968905 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc84c066930 con 0x7fc84c151220 2019-12-05T03:50:07.293 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.291+0000 7fc850b68700 1 --2- 172.21.15.158:0/3042968905 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc84c151220 0x7fc84c151e30 secure :-1 s=THROTTLE_DONE pgs=122 cs=0 l=1 rx=0x7fc84c1321c0 tx=0x7fc844010d80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:07.293 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.291+0000 7fc8497fa700 1 -- 172.21.15.158:0/3042968905 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc844032600 con 0x7fc84c151220 2019-12-05T03:50:07.294 INFO:teuthology.orchestra.run.smithi158.stdout:55834574853 2019-12-05T03:50:07.296 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.295+0000 7fc8525cb700 1 -- 172.21.15.158:0/3042968905 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fc83003ad30 msgr2=0x7fc83003d240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:07.296 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.295+0000 7fc8525cb700 1 --2- 172.21.15.158:0/3042968905 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fc83003ad30 0x7fc83003d240 crc :-1 s=READY pgs=69 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:07.296 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.295+0000 7fc8525cb700 1 -- 172.21.15.158:0/3042968905 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc84c151220 msgr2=0x7fc84c151e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:07.296 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.295+0000 7fc8525cb700 1 --2- 172.21.15.158:0/3042968905 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc84c151220 0x7fc84c151e30 secure :-1 s=READY pgs=122 cs=0 l=1 rx=0x7fc84c1321c0 tx=0x7fc844010d80).stop 2019-12-05T03:50:07.296 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.295+0000 7fc8525cb700 1 -- 172.21.15.158:0/3042968905 shutdown_connections 2019-12-05T03:50:07.297 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.295+0000 7fc8525cb700 1 --2- 172.21.15.158:0/3042968905 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fc83003ad30 0x7fc83003d240 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:07.297 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.295+0000 7fc8525cb700 1 --2- 172.21.15.158:0/3042968905 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc84c151220 0x7fc84c151e30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:07.297 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.295+0000 7fc8525cb700 1 --2- 172.21.15.158:0/3042968905 >> v2:172.21.15.96:3300/0 conn(0x7fc84c064440 0x7fc84c131720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:07.297 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.295+0000 7fc8525cb700 1 -- 172.21.15.158:0/3042968905 shutdown_connections 2019-12-05T03:50:07.297 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.295+0000 7fc8525cb700 1 -- 172.21.15.158:0/3042968905 wait complete. 2019-12-05T03:50:07.297 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:07.295+0000 7fc8525cb700 1 -- 172.21.15.158:0/3042968905 >> 172.21.15.158:0/3042968905 conn(0x7fc84c155e70 msgr2=0x7fc84c0b3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:07.305 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2019-12-05T03:50:08.305 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2019-12-05T03:50:08.406 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.399+0000 7fe3e38bc700 1 Processor -- start 2019-12-05T03:50:08.407 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.403+0000 7fe3e38bc700 1 -- start start 2019-12-05T03:50:08.407 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.403+0000 7fe3e38bc700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe3dc09a320 0x7fe3dc05a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:08.407 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.403+0000 7fe3e38bc700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe3dc1553b0 0x7fe3dc1557e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:08.407 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.403+0000 7fe3e38bc700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3dc0accb0 con 0x7fe3dc09cf60 2019-12-05T03:50:08.407 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.403+0000 7fe3e38bc700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3dc09a750 con 0x7fe3dc09a320 2019-12-05T03:50:08.407 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.403+0000 7fe3e38bc700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3dc0b1730 con 0x7fe3dc1553b0 2019-12-05T03:50:08.407 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.403+0000 7fe3e265a700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe3dc1553b0 0x7fe3dc1557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:08.408 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.403+0000 7fe3e1e59700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fe3dc09cf60 0x7fe3dc151460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48478/0 (socket says 172.21.15.158:48478) 2019-12-05T03:50:08.408 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.403+0000 7fe3e1e59700 1 -- 172.21.15.158:0/2279215809 learned_addr learned my addr 172.21.15.158:0/2279215809 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:08.408 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.403+0000 7fe3e1658700 1 --2- 172.21.15.158:0/2279215809 >> v2:172.21.15.96:3300/0 conn(0x7fe3dc09a320 0x7fe3dc05a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:08.408 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.403+0000 7fe3e265a700 1 -- 172.21.15.158:0/2279215809 >> v2:172.21.15.96:3300/0 conn(0x7fe3dc09a320 msgr2=0x7fe3dc05a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:08.408 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.403+0000 7fe3e265a700 1 --2- 172.21.15.158:0/2279215809 >> v2:172.21.15.96:3300/0 conn(0x7fe3dc09a320 0x7fe3dc05a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:08.408 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.403+0000 7fe3e265a700 1 -- 172.21.15.158:0/2279215809 >> v1:172.21.15.158:6789/0 conn(0x7fe3dc09cf60 legacy=0x7fe3dc151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:08.409 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.403+0000 7fe3e265a700 1 -- 172.21.15.158:0/2279215809 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3dc0b6980 con 0x7fe3dc1553b0 2019-12-05T03:50:08.409 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.403+0000 7fe3e265a700 1 --2- 172.21.15.158:0/2279215809 >> v2:172.21.15.158:3300/0 conn(0x7fe3dc1553b0 0x7fe3dc1557e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe3d4008b10 tx=0x7fe3d400fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:08.409 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.403+0000 7fe3e265a700 1 --2- 172.21.15.158:0/2279215809 >> v2:172.21.15.158:3300/0 conn(0x7fe3dc1553b0 0x7fe3dc1557e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe3d4008b10 tx=0x7fe3d400fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:08.409 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.403+0000 7fe3e265a700 1 --2- 172.21.15.158:0/2279215809 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe3dc1553b0 0x7fe3dc1557e0 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7fe3d4008b10 tx=0x7fe3d400fff0).ready entity=mon.1 client_cookie=36b8c652dee6886c server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:08.409 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.403+0000 7fe3e265a700 1 --2- 172.21.15.158:0/2279215809 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe3dc1553b0 0x7fe3dc1557e0 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7fe3d4008b10 tx=0x7fe3d400fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:08.409 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.403+0000 7fe3e265a700 1 --2- 172.21.15.158:0/2279215809 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe3dc1553b0 0x7fe3dc1557e0 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7fe3d4008b10 tx=0x7fe3d400fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:08.409 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.403+0000 7fe3e0e57700 1 -- 172.21.15.158:0/2279215809 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3d40108c0 con 0x7fe3dc1553b0 2019-12-05T03:50:08.410 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.403+0000 7fe3e265a700 1 --2- 172.21.15.158:0/2279215809 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe3dc1553b0 0x7fe3dc1557e0 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7fe3d4008b10 tx=0x7fe3d400fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:08.410 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.403+0000 7fe3e0e57700 1 -- 172.21.15.158:0/2279215809 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d4008b50 con 0x7fe3dc1553b0 2019-12-05T03:50:08.410 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.403+0000 7fe3e0e57700 1 -- 172.21.15.158:0/2279215809 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3d40110c0 con 0x7fe3dc1553b0 2019-12-05T03:50:08.410 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.403+0000 7fe3e38bc700 1 -- 172.21.15.158:0/2279215809 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe3dc1553b0 msgr2=0x7fe3dc1557e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:08.410 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.403+0000 7fe3e38bc700 1 --2- 172.21.15.158:0/2279215809 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe3dc1553b0 0x7fe3dc1557e0 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7fe3d4008b10 tx=0x7fe3d400fff0).stop 2019-12-05T03:50:08.410 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.403+0000 7fe3e38bc700 1 -- 172.21.15.158:0/2279215809 shutdown_connections 2019-12-05T03:50:08.410 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.403+0000 7fe3e38bc700 1 --2- 172.21.15.158:0/2279215809 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe3dc1553b0 0x7fe3dc1557e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:08.411 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.403+0000 7fe3e38bc700 1 --2- 172.21.15.158:0/2279215809 >> v2:172.21.15.96:3300/0 conn(0x7fe3dc09a320 0x7fe3dc05a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:08.411 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.403+0000 7fe3e38bc700 1 -- 172.21.15.158:0/2279215809 shutdown_connections 2019-12-05T03:50:08.411 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.403+0000 7fe3e38bc700 1 -- 172.21.15.158:0/2279215809 wait complete. 2019-12-05T03:50:08.411 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.403+0000 7fe3e38bc700 1 -- 172.21.15.158:0/2279215809 >> 172.21.15.158:0/2279215809 conn(0x7fe3dc0b7e60 msgr2=0x7fe3dc0b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:08.414 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.407+0000 7fe3e38bc700 1 Processor -- start 2019-12-05T03:50:08.414 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.407+0000 7fe3e38bc700 1 -- start start 2019-12-05T03:50:08.415 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.407+0000 7fe3e38bc700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe3dc0afd00 0x7fe3dc144280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:08.415 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.407+0000 7fe3e38bc700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe3dc0aeb70 0x7fe3dc12d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:08.415 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.407+0000 7fe3e38bc700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3dc0aefa0 con 0x7fe3dc12df40 2019-12-05T03:50:08.415 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.407+0000 7fe3e38bc700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3dc0b6030 con 0x7fe3dc0aeb70 2019-12-05T03:50:08.415 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.407+0000 7fe3e38bc700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3dc0ad7a0 con 0x7fe3dc0afd00 2019-12-05T03:50:08.415 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.407+0000 7fe3e1e59700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe3dc0afd00 0x7fe3dc144280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:08.415 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.407+0000 7fe3e265a700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fe3dc12df40 0x7fe3dc0acfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48484/0 (socket says 172.21.15.158:48484) 2019-12-05T03:50:08.416 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.407+0000 7fe3e265a700 1 -- 172.21.15.158:0/2223856284 learned_addr learned my addr 172.21.15.158:0/2223856284 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:08.416 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.407+0000 7fe3e1658700 1 --2- 172.21.15.158:0/2223856284 >> v2:172.21.15.96:3300/0 conn(0x7fe3dc0aeb70 0x7fe3dc12d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:08.416 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.407+0000 7fe3d27fc700 1 -- 172.21.15.158:0/2223856284 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3872113493 0 0) 0x7fe3dc0aefa0 con 0x7fe3dc12df40 2019-12-05T03:50:08.416 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.407+0000 7fe3d27fc700 1 -- 172.21.15.158:0/2223856284 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3c40030b0 con 0x7fe3dc12df40 2019-12-05T03:50:08.416 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.407+0000 7fe3e1658700 1 -- 172.21.15.158:0/2223856284 >> v2:172.21.15.158:3300/0 conn(0x7fe3dc0afd00 msgr2=0x7fe3dc144280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:08.417 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.407+0000 7fe3e1658700 1 --2- 172.21.15.158:0/2223856284 >> v2:172.21.15.158:3300/0 conn(0x7fe3dc0afd00 0x7fe3dc144280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:08.417 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.407+0000 7fe3e1658700 1 -- 172.21.15.158:0/2223856284 >> v1:172.21.15.158:6789/0 conn(0x7fe3dc12df40 legacy=0x7fe3dc0acfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:08.417 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.407+0000 7fe3e1658700 1 -- 172.21.15.158:0/2223856284 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3dc0af1d0 con 0x7fe3dc0aeb70 2019-12-05T03:50:08.417 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.407+0000 7fe3e1658700 1 --2- 172.21.15.158:0/2223856284 >> v2:172.21.15.96:3300/0 conn(0x7fe3dc0aeb70 0x7fe3dc12d9f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe3cc002f30 tx=0x7fe3cc010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:08.417 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.407+0000 7fe3e1658700 1 --2- 172.21.15.158:0/2223856284 >> v2:172.21.15.96:3300/0 conn(0x7fe3dc0aeb70 0x7fe3dc12d9f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe3cc002f30 tx=0x7fe3cc010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:08.417 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.407+0000 7fe3e1658700 1 --2- 172.21.15.158:0/2223856284 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3dc0aeb70 0x7fe3dc12d9f0 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7fe3cc002f30 tx=0x7fe3cc010b40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:08.417 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.407+0000 7fe3e1658700 1 --2- 172.21.15.158:0/2223856284 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3dc0aeb70 0x7fe3dc12d9f0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7fe3cc002f30 tx=0x7fe3cc010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:08.418 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.407+0000 7fe3d27fc700 1 -- 172.21.15.158:0/2223856284 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3cc0125f0 con 0x7fe3dc0aeb70 2019-12-05T03:50:08.418 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.407+0000 7fe3e1658700 1 --2- 172.21.15.158:0/2223856284 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3dc0aeb70 0x7fe3dc12d9f0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7fe3cc002f30 tx=0x7fe3cc010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:08.418 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.407+0000 7fe3d27fc700 1 -- 172.21.15.158:0/2223856284 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3cc007150 con 0x7fe3dc0aeb70 2019-12-05T03:50:08.418 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.407+0000 7fe3e1658700 1 --2- 172.21.15.158:0/2223856284 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3dc0aeb70 0x7fe3dc12d9f0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7fe3cc002f30 tx=0x7fe3cc010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:08.418 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.407+0000 7fe3e38bc700 1 -- 172.21.15.158:0/2223856284 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3dc1402f0 con 0x7fe3dc0aeb70 2019-12-05T03:50:08.418 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.407+0000 7fe3d27fc700 1 -- 172.21.15.158:0/2223856284 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3cc012c10 con 0x7fe3dc0aeb70 2019-12-05T03:50:08.418 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.407+0000 7fe3e38bc700 1 -- 172.21.15.158:0/2223856284 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3dc1406a0 con 0x7fe3dc0aeb70 2019-12-05T03:50:08.419 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.407+0000 7fe3e1658700 1 --2- 172.21.15.158:0/2223856284 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3dc0aeb70 0x7fe3dc12d9f0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7fe3cc002f30 tx=0x7fe3cc010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:08.419 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.407+0000 7fe3d27fc700 1 -- 172.21.15.158:0/2223856284 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fe3cc005540 con 0x7fe3dc0aeb70 2019-12-05T03:50:08.419 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.407+0000 7fe3e1658700 1 --2- 172.21.15.158:0/2223856284 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3dc0aeb70 0x7fe3dc12d9f0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7fe3cc002f30 tx=0x7fe3cc010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:08.419 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.411+0000 7fe3d27fc700 1 --2- 172.21.15.158:0/2223856284 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fe3c403b210 0x7fe3c403d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:08.419 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.411+0000 7fe3d27fc700 1 -- 172.21.15.158:0/2223856284 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fe3cc04b130 con 0x7fe3dc0aeb70 2019-12-05T03:50:08.419 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.411+0000 7fe3e1e59700 1 --2- 172.21.15.158:0/2223856284 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fe3c403b210 0x7fe3c403d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:08.419 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.411+0000 7fe3e1e59700 1 --2- 172.21.15.158:0/2223856284 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fe3c403b210 0x7fe3c403d720 crc :-1 s=READY pgs=72 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:08.420 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.419+0000 7fe3e38bc700 1 -- 172.21.15.158:0/2223856284 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3dc0554e0 con 0x7fe3dc0aeb70 2019-12-05T03:50:08.428 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.427+0000 7fe3e1658700 1 --2- 172.21.15.158:0/2223856284 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3dc0aeb70 0x7fe3dc12d9f0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7fe3cc002f30 tx=0x7fe3cc010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:08.429 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.427+0000 7fe3d27fc700 1 -- 172.21.15.158:0/2223856284 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fe3dc0af1d0 con 0x7fe3dc0aeb70 2019-12-05T03:50:08.607 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.603+0000 7fe3e38bc700 1 -- 172.21.15.158:0/2223856284 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe3dc09a530 con 0x7fe3dc0aeb70 2019-12-05T03:50:08.607 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.607+0000 7fe3e1658700 1 --2- 172.21.15.158:0/2223856284 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3dc0aeb70 0x7fe3dc12d9f0 secure :-1 s=THROTTLE_DONE pgs=94 cs=0 l=1 rx=0x7fe3cc002f30 tx=0x7fe3cc010b40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:08.608 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.607+0000 7fe3d27fc700 1 -- 172.21.15.158:0/2223856284 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe3cc032190 con 0x7fe3dc0aeb70 2019-12-05T03:50:08.608 INFO:teuthology.orchestra.run.smithi158.stdout:55834574854 2019-12-05T03:50:08.611 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.607+0000 7fe3e38bc700 1 -- 172.21.15.158:0/2223856284 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fe3c403b210 msgr2=0x7fe3c403d720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:08.611 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.607+0000 7fe3e38bc700 1 --2- 172.21.15.158:0/2223856284 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fe3c403b210 0x7fe3c403d720 crc :-1 s=READY pgs=72 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:08.611 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.607+0000 7fe3e38bc700 1 -- 172.21.15.158:0/2223856284 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3dc0aeb70 msgr2=0x7fe3dc12d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:08.611 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.607+0000 7fe3e38bc700 1 --2- 172.21.15.158:0/2223856284 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3dc0aeb70 0x7fe3dc12d9f0 secure :-1 s=READY pgs=94 cs=0 l=1 rx=0x7fe3cc002f30 tx=0x7fe3cc010b40).stop 2019-12-05T03:50:08.611 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.607+0000 7fe3e38bc700 1 -- 172.21.15.158:0/2223856284 shutdown_connections 2019-12-05T03:50:08.611 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.607+0000 7fe3e38bc700 1 --2- 172.21.15.158:0/2223856284 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fe3c403b210 0x7fe3c403d720 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:08.611 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.607+0000 7fe3e38bc700 1 --2- 172.21.15.158:0/2223856284 >> v2:172.21.15.158:3300/0 conn(0x7fe3dc0afd00 0x7fe3dc144280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:08.612 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.607+0000 7fe3e38bc700 1 --2- 172.21.15.158:0/2223856284 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3dc0aeb70 0x7fe3dc12d9f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:08.612 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.607+0000 7fe3e38bc700 1 -- 172.21.15.158:0/2223856284 shutdown_connections 2019-12-05T03:50:08.612 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.607+0000 7fe3e38bc700 1 -- 172.21.15.158:0/2223856284 wait complete. 2019-12-05T03:50:08.612 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.607+0000 7fe3e38bc700 1 -- 172.21.15.158:0/2223856284 >> 172.21.15.158:0/2223856284 conn(0x7fe3dc07e0f0 msgr2=0x7fe3dc1558c0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:08.620 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2019-12-05T03:50:08.620 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2019-12-05T03:50:08.721 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.711+0000 7fdfcf3ce700 1 Processor -- start 2019-12-05T03:50:08.721 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.711+0000 7fdfcf3ce700 1 -- start start 2019-12-05T03:50:08.721 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.715+0000 7fdfcf3ce700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdfc809cf50 0x7fdfc809a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:08.721 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.715+0000 7fdfcf3ce700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fdfc805a730 0x7fdfc8151450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:08.722 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.715+0000 7fdfcf3ce700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc80acca0 con 0x7fdfc81519a0 2019-12-05T03:50:08.722 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.715+0000 7fdfcf3ce700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc80b1720 con 0x7fdfc805a730 2019-12-05T03:50:08.722 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.715+0000 7fdfcf3ce700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc80b19c0 con 0x7fdfc809cf50 2019-12-05T03:50:08.722 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.715+0000 7fdfcd16a700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fdfc805a730 0x7fdfc8151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:08.722 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.715+0000 7fdfcd16a700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fdfc805a730 0x7fdfc8151450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53714/0 (socket says 172.21.15.158:53714) 2019-12-05T03:50:08.723 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.715+0000 7fdfcd16a700 1 -- 172.21.15.158:0/1450106181 learned_addr learned my addr 172.21.15.158:0/1450106181 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:08.723 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.715+0000 7fdfcd96b700 1 --2- 172.21.15.158:0/1450106181 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdfc809cf50 0x7fdfc809a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:08.723 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.715+0000 7fdfcd16a700 1 -- 172.21.15.158:0/1450106181 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdfc809cf50 msgr2=0x7fdfc809a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:08.723 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.715+0000 7fdfcd16a700 1 --2- 172.21.15.158:0/1450106181 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdfc809cf50 0x7fdfc809a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:08.723 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.715+0000 7fdfcd16a700 1 -- 172.21.15.158:0/1450106181 >> v1:172.21.15.158:6789/0 conn(0x7fdfc81519a0 legacy=0x7fdfc80b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:08.723 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.715+0000 7fdfcd16a700 1 -- 172.21.15.158:0/1450106181 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc805ab60 con 0x7fdfc805a730 2019-12-05T03:50:08.723 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.715+0000 7fdfcd16a700 1 --2- 172.21.15.158:0/1450106181 >> v2:172.21.15.158:3300/0 conn(0x7fdfc805a730 0x7fdfc8151450 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdfc80b18e0 tx=0x7fdfb800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:08.723 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.715+0000 7fdfcd16a700 1 --2- 172.21.15.158:0/1450106181 >> v2:172.21.15.158:3300/0 conn(0x7fdfc805a730 0x7fdfc8151450 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdfc80b18e0 tx=0x7fdfb800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:08.724 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.715+0000 7fdfcd16a700 1 --2- 172.21.15.158:0/1450106181 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdfc805a730 0x7fdfc8151450 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7fdfc80b18e0 tx=0x7fdfb800fd30).ready entity=mon.1 client_cookie=f8db51b22a37c680 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:08.724 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.715+0000 7fdfcd16a700 1 --2- 172.21.15.158:0/1450106181 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdfc805a730 0x7fdfc8151450 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fdfc80b18e0 tx=0x7fdfb800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:08.724 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.715+0000 7fdfcc969700 1 -- 172.21.15.158:0/1450106181 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfb80113b0 con 0x7fdfc805a730 2019-12-05T03:50:08.724 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.715+0000 7fdfcd16a700 1 --2- 172.21.15.158:0/1450106181 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdfc805a730 0x7fdfc8151450 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fdfc80b18e0 tx=0x7fdfb800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:08.724 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.715+0000 7fdfcd16a700 1 --2- 172.21.15.158:0/1450106181 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdfc805a730 0x7fdfc8151450 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7fdfc80b18e0 tx=0x7fdfb800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:08.724 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.715+0000 7fdfcc969700 1 -- 172.21.15.158:0/1450106181 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb8008bb0 con 0x7fdfc805a730 2019-12-05T03:50:08.725 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.715+0000 7fdfcc969700 1 -- 172.21.15.158:0/1450106181 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfb8011990 con 0x7fdfc805a730 2019-12-05T03:50:08.725 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.715+0000 7fdfcf3ce700 1 -- 172.21.15.158:0/1450106181 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdfc805a730 msgr2=0x7fdfc8151450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:08.725 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.715+0000 7fdfcf3ce700 1 --2- 172.21.15.158:0/1450106181 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdfc805a730 0x7fdfc8151450 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7fdfc80b18e0 tx=0x7fdfb800fd30).stop 2019-12-05T03:50:08.725 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.715+0000 7fdfcf3ce700 1 -- 172.21.15.158:0/1450106181 shutdown_connections 2019-12-05T03:50:08.725 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.715+0000 7fdfcf3ce700 1 --2- 172.21.15.158:0/1450106181 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdfc809cf50 0x7fdfc809a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:08.725 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.715+0000 7fdfcf3ce700 1 --2- 172.21.15.158:0/1450106181 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdfc805a730 0x7fdfc8151450 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:08.725 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.715+0000 7fdfcf3ce700 1 -- 172.21.15.158:0/1450106181 shutdown_connections 2019-12-05T03:50:08.726 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.715+0000 7fdfcf3ce700 1 -- 172.21.15.158:0/1450106181 wait complete. 2019-12-05T03:50:08.726 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.715+0000 7fdfcf3ce700 1 -- 172.21.15.158:0/1450106181 >> 172.21.15.158:0/1450106181 conn(0x7fdfc80b7e50 msgr2=0x7fdfc80b3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:08.730 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.719+0000 7fdfcf3ce700 1 Processor -- start 2019-12-05T03:50:08.730 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.719+0000 7fdfcf3ce700 1 -- start start 2019-12-05T03:50:08.730 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.723+0000 7fdfcf3ce700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fdfc80ad230 0x7fdfc807d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:08.730 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.723+0000 7fdfcf3ce700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fdfc8154410 0x7fdfc8139060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:08.730 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.723+0000 7fdfcf3ce700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdfc807b050 0x7fdfc807b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:08.731 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.723+0000 7fdfcf3ce700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc8154b20 con 0x7fdfc8154410 2019-12-05T03:50:08.731 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.723+0000 7fdfcf3ce700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc8154dc0 con 0x7fdfc80ad230 2019-12-05T03:50:08.731 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.723+0000 7fdfcf3ce700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc807ddf0 con 0x7fdfc807b050 2019-12-05T03:50:08.731 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.723+0000 7fdfcd96b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fdfc80ad230 0x7fdfc807d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:08.731 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.723+0000 7fdfcd96b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fdfc80ad230 0x7fdfc807d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53718/0 (socket says 172.21.15.158:53718) 2019-12-05T03:50:08.731 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.723+0000 7fdfcd96b700 1 -- 172.21.15.158:0/1016042073 learned_addr learned my addr 172.21.15.158:0/1016042073 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:08.731 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.723+0000 7fdfcd16a700 1 --2- 172.21.15.158:0/1016042073 >> v2:172.21.15.96:3300/0 conn(0x7fdfc8154410 0x7fdfc8139060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:08.731 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.723+0000 7fdfce16c700 1 --2- 172.21.15.158:0/1016042073 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdfc807b050 0x7fdfc807b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:08.732 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.723+0000 7fdfcd96b700 1 -- 172.21.15.158:0/1016042073 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdfc807b050 msgr2=0x7fdfc807b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:08.732 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.723+0000 7fdfcd96b700 1 --2- 172.21.15.158:0/1016042073 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdfc807b050 0x7fdfc807b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:08.732 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.723+0000 7fdfcd96b700 1 -- 172.21.15.158:0/1016042073 >> v2:172.21.15.96:3300/0 conn(0x7fdfc8154410 msgr2=0x7fdfc8139060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:08.732 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.723+0000 7fdfcd96b700 1 --2- 172.21.15.158:0/1016042073 >> v2:172.21.15.96:3300/0 conn(0x7fdfc8154410 0x7fdfc8139060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:08.732 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.723+0000 7fdfcd96b700 1 -- 172.21.15.158:0/1016042073 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc8154840 con 0x7fdfc80ad230 2019-12-05T03:50:08.732 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.723+0000 7fdfcd16a700 1 --2- 172.21.15.158:0/1016042073 >> v2:172.21.15.96:3300/0 conn(0x7fdfc8154410 0x7fdfc8139060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-12-05T03:50:08.733 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.723+0000 7fdfcd96b700 1 --2- 172.21.15.158:0/1016042073 >> v2:172.21.15.158:3300/0 conn(0x7fdfc80ad230 0x7fdfc807d130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdfc807dcc0 tx=0x7fdfc4010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:08.733 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.723+0000 7fdfcd96b700 1 --2- 172.21.15.158:0/1016042073 >> v2:172.21.15.158:3300/0 conn(0x7fdfc80ad230 0x7fdfc807d130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdfc807dcc0 tx=0x7fdfc4010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:08.733 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.723+0000 7fdfcd96b700 1 --2- 172.21.15.158:0/1016042073 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdfc80ad230 0x7fdfc807d130 secure :-1 s=READY pgs=128 cs=0 l=1 rx=0x7fdfc807dcc0 tx=0x7fdfc4010f60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:08.733 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.723+0000 7fdfcd96b700 1 --2- 172.21.15.158:0/1016042073 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdfc80ad230 0x7fdfc807d130 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7fdfc807dcc0 tx=0x7fdfc4010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:08.733 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.723+0000 7fdfbe7fc700 1 -- 172.21.15.158:0/1016042073 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfc4012b80 con 0x7fdfc80ad230 2019-12-05T03:50:08.733 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.723+0000 7fdfcd96b700 1 --2- 172.21.15.158:0/1016042073 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdfc80ad230 0x7fdfc807d130 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7fdfc807dcc0 tx=0x7fdfc4010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:08.733 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.723+0000 7fdfcd96b700 1 --2- 172.21.15.158:0/1016042073 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdfc80ad230 0x7fdfc807d130 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7fdfc807dcc0 tx=0x7fdfc4010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:08.734 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.723+0000 7fdfbe7fc700 1 -- 172.21.15.158:0/1016042073 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc400e160 con 0x7fdfc80ad230 2019-12-05T03:50:08.734 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.723+0000 7fdfcf3ce700 1 -- 172.21.15.158:0/1016042073 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc8155060 con 0x7fdfc80ad230 2019-12-05T03:50:08.734 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.723+0000 7fdfbe7fc700 1 -- 172.21.15.158:0/1016042073 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfc4005ab0 con 0x7fdfc80ad230 2019-12-05T03:50:08.734 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.723+0000 7fdfcf3ce700 1 -- 172.21.15.158:0/1016042073 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc812c8a0 con 0x7fdfc80ad230 2019-12-05T03:50:08.734 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.723+0000 7fdfcd96b700 1 --2- 172.21.15.158:0/1016042073 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdfc80ad230 0x7fdfc807d130 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7fdfc807dcc0 tx=0x7fdfc4010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:08.734 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.723+0000 7fdfbe7fc700 1 -- 172.21.15.158:0/1016042073 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fdfc4007180 con 0x7fdfc80ad230 2019-12-05T03:50:08.734 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.723+0000 7fdfcd96b700 1 --2- 172.21.15.158:0/1016042073 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdfc80ad230 0x7fdfc807d130 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7fdfc807dcc0 tx=0x7fdfc4010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:08.735 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.727+0000 7fdfbe7fc700 1 --2- 172.21.15.158:0/1016042073 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fdfb003ada0 0x7fdfb003d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:08.735 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.727+0000 7fdfbe7fc700 1 -- 172.21.15.158:0/1016042073 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fdfc404af40 con 0x7fdfc80ad230 2019-12-05T03:50:08.735 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.727+0000 7fdfcd16a700 1 --2- 172.21.15.158:0/1016042073 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fdfb003ada0 0x7fdfb003d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:08.735 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.727+0000 7fdfcd16a700 1 --2- 172.21.15.158:0/1016042073 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fdfb003ada0 0x7fdfb003d2b0 crc :-1 s=READY pgs=73 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:08.735 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.727+0000 7fdfcf3ce700 1 -- 172.21.15.158:0/1016042073 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc80554d0 con 0x7fdfc80ad230 2019-12-05T03:50:08.736 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.735+0000 7fdfcd96b700 1 --2- 172.21.15.158:0/1016042073 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdfc80ad230 0x7fdfc807d130 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7fdfc807dcc0 tx=0x7fdfc4010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:08.737 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.735+0000 7fdfbe7fc700 1 -- 172.21.15.158:0/1016042073 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fdfc4031fc0 con 0x7fdfc80ad230 2019-12-05T03:50:08.915 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.911+0000 7fdfcf3ce700 1 -- 172.21.15.158:0/1016042073 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdfc8066930 con 0x7fdfc80ad230 2019-12-05T03:50:08.915 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.915+0000 7fdfcd96b700 1 --2- 172.21.15.158:0/1016042073 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdfc80ad230 0x7fdfc807d130 secure :-1 s=THROTTLE_DONE pgs=128 cs=0 l=1 rx=0x7fdfc807dcc0 tx=0x7fdfc4010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:08.916 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.915+0000 7fdfbe7fc700 1 -- 172.21.15.158:0/1016042073 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdfc4005dc0 con 0x7fdfc80ad230 2019-12-05T03:50:08.916 INFO:teuthology.orchestra.run.smithi158.stdout:55834574853 2019-12-05T03:50:08.918 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.915+0000 7fdfcf3ce700 1 -- 172.21.15.158:0/1016042073 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fdfb003ada0 msgr2=0x7fdfb003d2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:08.918 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.915+0000 7fdfcf3ce700 1 --2- 172.21.15.158:0/1016042073 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fdfb003ada0 0x7fdfb003d2b0 crc :-1 s=READY pgs=73 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:08.919 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.915+0000 7fdfcf3ce700 1 -- 172.21.15.158:0/1016042073 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdfc80ad230 msgr2=0x7fdfc807d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:08.919 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.915+0000 7fdfcf3ce700 1 --2- 172.21.15.158:0/1016042073 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdfc80ad230 0x7fdfc807d130 secure :-1 s=READY pgs=128 cs=0 l=1 rx=0x7fdfc807dcc0 tx=0x7fdfc4010f60).stop 2019-12-05T03:50:08.919 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.915+0000 7fdfcf3ce700 1 -- 172.21.15.158:0/1016042073 shutdown_connections 2019-12-05T03:50:08.919 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.915+0000 7fdfcf3ce700 1 --2- 172.21.15.158:0/1016042073 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fdfb003ada0 0x7fdfb003d2b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:08.919 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.915+0000 7fdfcf3ce700 1 --2- 172.21.15.158:0/1016042073 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdfc807b050 0x7fdfc807b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:08.919 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.915+0000 7fdfcf3ce700 1 --2- 172.21.15.158:0/1016042073 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdfc80ad230 0x7fdfc807d130 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:08.919 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.915+0000 7fdfcf3ce700 1 --2- 172.21.15.158:0/1016042073 >> v2:172.21.15.96:3300/0 conn(0x7fdfc8154410 0x7fdfc8139060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:08.920 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.915+0000 7fdfcf3ce700 1 -- 172.21.15.158:0/1016042073 shutdown_connections 2019-12-05T03:50:08.920 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.915+0000 7fdfcf3ce700 1 -- 172.21.15.158:0/1016042073 wait complete. 2019-12-05T03:50:08.920 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:08.915+0000 7fdfcf3ce700 1 -- 172.21.15.158:0/1016042073 >> 172.21.15.158:0/1016042073 conn(0x7fdfc809cf50 msgr2=0x7fdfc812ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:08.928 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2019-12-05T03:50:08.928 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2019-12-05T03:50:09.030 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.019+0000 7fefe0738700 1 Processor -- start 2019-12-05T03:50:09.030 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.019+0000 7fefe0738700 1 -- start start 2019-12-05T03:50:09.030 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.023+0000 7fefe0738700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fefd809cf50 0x7fefd809a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:09.031 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.023+0000 7fefe0738700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fefd805a730 0x7fefd8151450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:09.031 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.023+0000 7fefe0738700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefd80acca0 con 0x7fefd81519a0 2019-12-05T03:50:09.031 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.023+0000 7fefe0738700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefd80b1720 con 0x7fefd809cf50 2019-12-05T03:50:09.031 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.023+0000 7fefe0738700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd80b19c0 con 0x7fefd805a730 2019-12-05T03:50:09.032 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.023+0000 7fefdecd5700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fefd809cf50 0x7fefd809a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:09.032 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.023+0000 7fefdf4d6700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fefd81519a0 0x7fefd80b52d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48510/0 (socket says 172.21.15.158:48510) 2019-12-05T03:50:09.032 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.023+0000 7fefdf4d6700 1 -- 172.21.15.158:0/2704684968 learned_addr learned my addr 172.21.15.158:0/2704684968 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:09.032 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.023+0000 7fefde4d4700 1 --2- 172.21.15.158:0/2704684968 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fefd805a730 0x7fefd8151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:09.033 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.023+0000 7fefdecd5700 1 -- 172.21.15.158:0/2704684968 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fefd805a730 msgr2=0x7fefd8151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:09.033 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.023+0000 7fefdecd5700 1 --2- 172.21.15.158:0/2704684968 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fefd805a730 0x7fefd8151450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:09.033 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.023+0000 7fefdecd5700 1 -- 172.21.15.158:0/2704684968 >> v1:172.21.15.158:6789/0 conn(0x7fefd81519a0 legacy=0x7fefd80b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:09.033 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.023+0000 7fefdecd5700 1 -- 172.21.15.158:0/2704684968 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd805ab60 con 0x7fefd809cf50 2019-12-05T03:50:09.034 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.023+0000 7fefddcd3700 1 -- 172.21.15.158:0/2704684968 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 698553275 0 0) 0x7fefd80acca0 con 0x7fefd81519a0 2019-12-05T03:50:09.034 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.023+0000 7fefdecd5700 1 --2- 172.21.15.158:0/2704684968 >> v2:172.21.15.158:3300/0 conn(0x7fefd809cf50 0x7fefd809a310 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fefd80b18e0 tx=0x7fefd400fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.034 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.023+0000 7fefdecd5700 1 --2- 172.21.15.158:0/2704684968 >> v2:172.21.15.158:3300/0 conn(0x7fefd809cf50 0x7fefd809a310 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fefd80b18e0 tx=0x7fefd400fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.034 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.023+0000 7fefdecd5700 1 --2- 172.21.15.158:0/2704684968 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fefd809cf50 0x7fefd809a310 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7fefd80b18e0 tx=0x7fefd400fc70).ready entity=mon.1 client_cookie=6a09207ed245d513 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:09.034 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.023+0000 7fefdecd5700 1 --2- 172.21.15.158:0/2704684968 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fefd809cf50 0x7fefd809a310 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7fefd80b18e0 tx=0x7fefd400fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.035 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.023+0000 7fefdecd5700 1 --2- 172.21.15.158:0/2704684968 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fefd809cf50 0x7fefd809a310 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7fefd80b18e0 tx=0x7fefd400fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.035 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.023+0000 7fefddcd3700 1 -- 172.21.15.158:0/2704684968 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefd40112f0 con 0x7fefd809cf50 2019-12-05T03:50:09.035 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.023+0000 7fefdecd5700 1 --2- 172.21.15.158:0/2704684968 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fefd809cf50 0x7fefd809a310 secure :-1 s=THROTTLE_DONE pgs=130 cs=0 l=1 rx=0x7fefd80b18e0 tx=0x7fefd400fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.035 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.023+0000 7fefddcd3700 1 -- 172.21.15.158:0/2704684968 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd4008ad0 con 0x7fefd809cf50 2019-12-05T03:50:09.036 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.023+0000 7fefddcd3700 1 -- 172.21.15.158:0/2704684968 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefd40118d0 con 0x7fefd809cf50 2019-12-05T03:50:09.036 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.023+0000 7fefe0738700 1 -- 172.21.15.158:0/2704684968 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fefd809cf50 msgr2=0x7fefd809a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:09.036 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.023+0000 7fefe0738700 1 --2- 172.21.15.158:0/2704684968 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fefd809cf50 0x7fefd809a310 secure :-1 s=READY pgs=130 cs=0 l=1 rx=0x7fefd80b18e0 tx=0x7fefd400fc70).stop 2019-12-05T03:50:09.036 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.023+0000 7fefe0738700 1 -- 172.21.15.158:0/2704684968 shutdown_connections 2019-12-05T03:50:09.037 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.023+0000 7fefe0738700 1 --2- 172.21.15.158:0/2704684968 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fefd809cf50 0x7fefd809a310 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:09.037 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.023+0000 7fefe0738700 1 --2- 172.21.15.158:0/2704684968 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fefd805a730 0x7fefd8151450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:09.037 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.023+0000 7fefe0738700 1 -- 172.21.15.158:0/2704684968 shutdown_connections 2019-12-05T03:50:09.037 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.023+0000 7fefe0738700 1 -- 172.21.15.158:0/2704684968 wait complete. 2019-12-05T03:50:09.038 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.023+0000 7fefe0738700 1 -- 172.21.15.158:0/2704684968 >> 172.21.15.158:0/2704684968 conn(0x7fefd80b7e50 msgr2=0x7fefd80b3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:09.038 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.027+0000 7fefe0738700 1 Processor -- start 2019-12-05T03:50:09.038 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.027+0000 7fefe0738700 1 -- start start 2019-12-05T03:50:09.043 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.031+0000 7fefe0738700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fefd812dff0 0x7fefd813c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:09.043 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.031+0000 7fefe0738700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fefd807b440 0x7fefd81537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:09.044 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.031+0000 7fefe0738700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefd8154e30 con 0x7fefd80b1d90 2019-12-05T03:50:09.044 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.031+0000 7fefe0738700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefd807b870 con 0x7fefd807b440 2019-12-05T03:50:09.044 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.031+0000 7fefe0738700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd8063b90 con 0x7fefd812dff0 2019-12-05T03:50:09.044 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.031+0000 7fefdf4d6700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fefd80b1d90 0x7fefd8063e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48514/0 (socket says 172.21.15.158:48514) 2019-12-05T03:50:09.044 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.031+0000 7fefdf4d6700 1 -- 172.21.15.158:0/3038447061 learned_addr learned my addr 172.21.15.158:0/3038447061 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:09.045 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.031+0000 7fefde4d4700 1 --2- 172.21.15.158:0/3038447061 >> v2:172.21.15.96:3300/0 conn(0x7fefd807b440 0x7fefd81537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:09.045 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.031+0000 7fefdecd5700 1 --2- 172.21.15.158:0/3038447061 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fefd812dff0 0x7fefd813c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:09.045 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.031+0000 7fefcf7fe700 1 -- 172.21.15.158:0/3038447061 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3260724526 0 0) 0x7fefd8154e30 con 0x7fefd80b1d90 2019-12-05T03:50:09.045 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.031+0000 7fefcf7fe700 1 -- 172.21.15.158:0/3038447061 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefc00030b0 con 0x7fefd80b1d90 2019-12-05T03:50:09.045 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.031+0000 7fefcf7fe700 1 -- 172.21.15.158:0/3038447061 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4039857212 0 0) 0x7fefc00030b0 con 0x7fefd80b1d90 2019-12-05T03:50:09.045 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.031+0000 7fefde4d4700 1 -- 172.21.15.158:0/3038447061 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fefd812dff0 msgr2=0x7fefd813c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:09.047 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.031+0000 7fefde4d4700 1 --2- 172.21.15.158:0/3038447061 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fefd812dff0 0x7fefd813c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:09.047 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.031+0000 7fefde4d4700 1 -- 172.21.15.158:0/3038447061 >> v1:172.21.15.158:6789/0 conn(0x7fefd80b1d90 legacy=0x7fefd8063e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:09.047 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.031+0000 7fefde4d4700 1 -- 172.21.15.158:0/3038447061 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd8153d40 con 0x7fefd807b440 2019-12-05T03:50:09.048 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.031+0000 7fefde4d4700 1 --2- 172.21.15.158:0/3038447061 >> v2:172.21.15.96:3300/0 conn(0x7fefd807b440 0x7fefd81537f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fefd0001e40 tx=0x7fefd0001e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.048 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.031+0000 7fefde4d4700 1 --2- 172.21.15.158:0/3038447061 >> v2:172.21.15.96:3300/0 conn(0x7fefd807b440 0x7fefd81537f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fefd0001e40 tx=0x7fefd0001e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.048 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.031+0000 7fefde4d4700 1 --2- 172.21.15.158:0/3038447061 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefd807b440 0x7fefd81537f0 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7fefd0001e40 tx=0x7fefd0001e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:09.048 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.031+0000 7fefde4d4700 1 --2- 172.21.15.158:0/3038447061 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefd807b440 0x7fefd81537f0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7fefd0001e40 tx=0x7fefd0001e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.049 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.031+0000 7fefcf7fe700 1 -- 172.21.15.158:0/3038447061 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefd0001c00 con 0x7fefd807b440 2019-12-05T03:50:09.049 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.031+0000 7fefde4d4700 1 --2- 172.21.15.158:0/3038447061 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefd807b440 0x7fefd81537f0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7fefd0001e40 tx=0x7fefd0001e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.049 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.031+0000 7fefe0738700 1 -- 172.21.15.158:0/3038447061 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefd80b21c0 con 0x7fefd807b440 2019-12-05T03:50:09.049 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.031+0000 7fefcf7fe700 1 -- 172.21.15.158:0/3038447061 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd0001a10 con 0x7fefd807b440 2019-12-05T03:50:09.050 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.031+0000 7fefde4d4700 1 --2- 172.21.15.158:0/3038447061 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefd807b440 0x7fefd81537f0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7fefd0001e40 tx=0x7fefd0001e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.050 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.031+0000 7fefcf7fe700 1 -- 172.21.15.158:0/3038447061 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefc8005730 con 0x7fefd807b440 2019-12-05T03:50:09.050 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.031+0000 7fefe0738700 1 -- 172.21.15.158:0/3038447061 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd8064630 con 0x7fefd807b440 2019-12-05T03:50:09.050 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.031+0000 7fefde4d4700 1 --2- 172.21.15.158:0/3038447061 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefd807b440 0x7fefd81537f0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7fefd0001e40 tx=0x7fefd0001e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.051 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.035+0000 7fefcf7fe700 1 -- 172.21.15.158:0/3038447061 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fefc8005a10 con 0x7fefd807b440 2019-12-05T03:50:09.051 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.035+0000 7fefde4d4700 1 --2- 172.21.15.158:0/3038447061 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefd807b440 0x7fefd81537f0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7fefd0001e40 tx=0x7fefd0001e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.051 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.035+0000 7fefcf7fe700 1 --2- 172.21.15.158:0/3038447061 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fefc003b210 0x7fefc003d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:09.051 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.035+0000 7fefcf7fe700 1 -- 172.21.15.158:0/3038447061 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fefc804aa50 con 0x7fefd807b440 2019-12-05T03:50:09.051 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.035+0000 7fefdecd5700 1 --2- 172.21.15.158:0/3038447061 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fefc003b210 0x7fefc003d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:09.052 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.035+0000 7fefdecd5700 1 --2- 172.21.15.158:0/3038447061 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fefc003b210 0x7fefc003d720 crc :-1 s=READY pgs=74 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:09.052 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.035+0000 7fefe0738700 1 -- 172.21.15.158:0/3038447061 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefd80b2ad0 con 0x7fefd807b440 2019-12-05T03:50:09.053 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.047+0000 7fefde4d4700 1 --2- 172.21.15.158:0/3038447061 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefd807b440 0x7fefd81537f0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7fefd0001e40 tx=0x7fefd0001e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.053 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.047+0000 7fefcf7fe700 1 -- 172.21.15.158:0/3038447061 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fefc8031ab0 con 0x7fefd807b440 2019-12-05T03:50:09.229 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.227+0000 7fefe0738700 1 -- 172.21.15.158:0/3038447061 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fefd8066930 con 0x7fefd807b440 2019-12-05T03:50:09.230 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.227+0000 7fefde4d4700 1 --2- 172.21.15.158:0/3038447061 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefd807b440 0x7fefd81537f0 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x7fefd0001e40 tx=0x7fefd0001e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.230 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.227+0000 7fefcf7fe700 1 -- 172.21.15.158:0/3038447061 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fefc8010020 con 0x7fefd807b440 2019-12-05T03:50:09.230 INFO:teuthology.orchestra.run.smithi158.stdout:55834574854 2019-12-05T03:50:09.232 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.231+0000 7fefe0738700 1 -- 172.21.15.158:0/3038447061 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fefc003b210 msgr2=0x7fefc003d720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:09.232 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.231+0000 7fefe0738700 1 --2- 172.21.15.158:0/3038447061 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fefc003b210 0x7fefc003d720 crc :-1 s=READY pgs=74 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:09.233 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.231+0000 7fefe0738700 1 -- 172.21.15.158:0/3038447061 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefd807b440 msgr2=0x7fefd81537f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:09.233 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.231+0000 7fefe0738700 1 --2- 172.21.15.158:0/3038447061 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefd807b440 0x7fefd81537f0 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x7fefd0001e40 tx=0x7fefd0001e80).stop 2019-12-05T03:50:09.233 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.231+0000 7fefe0738700 1 -- 172.21.15.158:0/3038447061 shutdown_connections 2019-12-05T03:50:09.233 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.231+0000 7fefe0738700 1 --2- 172.21.15.158:0/3038447061 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fefc003b210 0x7fefc003d720 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:09.233 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.231+0000 7fefe0738700 1 --2- 172.21.15.158:0/3038447061 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fefd812dff0 0x7fefd813c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:09.233 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.231+0000 7fefe0738700 1 --2- 172.21.15.158:0/3038447061 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefd807b440 0x7fefd81537f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:09.233 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.231+0000 7fefe0738700 1 -- 172.21.15.158:0/3038447061 shutdown_connections 2019-12-05T03:50:09.234 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.231+0000 7fefe0738700 1 -- 172.21.15.158:0/3038447061 wait complete. 2019-12-05T03:50:09.234 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.231+0000 7fefe0738700 1 -- 172.21.15.158:0/3038447061 >> 172.21.15.158:0/3038447061 conn(0x7fefd809cf50 msgr2=0x7fefd80b2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:09.242 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2019-12-05T03:50:09.242 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2019-12-05T03:50:09.342 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.335+0000 7fbf788de700 1 Processor -- start 2019-12-05T03:50:09.343 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.335+0000 7fbf788de700 1 -- start start 2019-12-05T03:50:09.343 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.335+0000 7fbf788de700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fbf7405a740 0x7fbf74155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:09.343 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.335+0000 7fbf788de700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf740accb0 con 0x7fbf7409cf60 2019-12-05T03:50:09.343 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.335+0000 7fbf788de700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf74156100 con 0x7fbf7409a320 2019-12-05T03:50:09.343 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.335+0000 7fbf788de700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf7409a750 con 0x7fbf7405a740 2019-12-05T03:50:09.343 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.335+0000 7fbf7359e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fbf7405a740 0x7fbf74155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:09.344 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.335+0000 7fbf7359e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fbf7405a740 0x7fbf74155bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53744/0 (socket says 172.21.15.158:53744) 2019-12-05T03:50:09.344 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.335+0000 7fbf7359e700 1 -- 172.21.15.158:0/44813943 learned_addr learned my addr 172.21.15.158:0/44813943 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:09.344 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.335+0000 7fbf7359e700 1 -- 172.21.15.158:0/44813943 >> v1:172.21.15.158:6789/0 conn(0x7fbf7409a320 legacy=0x7fbf741553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:09.344 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.335+0000 7fbf7359e700 1 -- 172.21.15.158:0/44813943 >> v1:172.21.15.96:6789/0 conn(0x7fbf7409cf60 legacy=0x7fbf74151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:09.344 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.335+0000 7fbf7359e700 1 -- 172.21.15.158:0/44813943 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf7405ab70 con 0x7fbf7405a740 2019-12-05T03:50:09.344 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.335+0000 7fbf7359e700 1 --2- 172.21.15.158:0/44813943 >> v2:172.21.15.158:3300/0 conn(0x7fbf7405a740 0x7fbf74155bb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbf7409c740 tx=0x7fbf6c010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.344 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.335+0000 7fbf7359e700 1 --2- 172.21.15.158:0/44813943 >> v2:172.21.15.158:3300/0 conn(0x7fbf7405a740 0x7fbf74155bb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbf7409c740 tx=0x7fbf6c010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.345 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.335+0000 7fbf7359e700 1 --2- 172.21.15.158:0/44813943 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbf7405a740 0x7fbf74155bb0 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7fbf7409c740 tx=0x7fbf6c010030).ready entity=mon.1 client_cookie=80547928d26d0e62 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:09.345 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.339+0000 7fbf7359e700 1 --2- 172.21.15.158:0/44813943 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbf7405a740 0x7fbf74155bb0 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7fbf7409c740 tx=0x7fbf6c010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.345 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.339+0000 7fbf7359e700 1 --2- 172.21.15.158:0/44813943 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbf7405a740 0x7fbf74155bb0 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7fbf7409c740 tx=0x7fbf6c010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.345 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.339+0000 7fbf7259c700 1 -- 172.21.15.158:0/44813943 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf6c0110c0 con 0x7fbf7405a740 2019-12-05T03:50:09.345 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.339+0000 7fbf7359e700 1 --2- 172.21.15.158:0/44813943 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbf7405a740 0x7fbf74155bb0 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7fbf7409c740 tx=0x7fbf6c010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.345 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.339+0000 7fbf7259c700 1 -- 172.21.15.158:0/44813943 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf6c010a30 con 0x7fbf7405a740 2019-12-05T03:50:09.345 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.339+0000 7fbf7259c700 1 -- 172.21.15.158:0/44813943 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf6c0114b0 con 0x7fbf7405a740 2019-12-05T03:50:09.346 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.339+0000 7fbf788de700 1 -- 172.21.15.158:0/44813943 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbf7405a740 msgr2=0x7fbf74155bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:09.346 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.339+0000 7fbf788de700 1 --2- 172.21.15.158:0/44813943 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbf7405a740 0x7fbf74155bb0 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7fbf7409c740 tx=0x7fbf6c010030).stop 2019-12-05T03:50:09.346 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.339+0000 7fbf788de700 1 -- 172.21.15.158:0/44813943 shutdown_connections 2019-12-05T03:50:09.346 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.339+0000 7fbf788de700 1 --2- 172.21.15.158:0/44813943 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbf7405a740 0x7fbf74155bb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:09.346 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.339+0000 7fbf788de700 1 -- 172.21.15.158:0/44813943 shutdown_connections 2019-12-05T03:50:09.346 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.339+0000 7fbf788de700 1 -- 172.21.15.158:0/44813943 wait complete. 2019-12-05T03:50:09.346 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.339+0000 7fbf788de700 1 -- 172.21.15.158:0/44813943 >> 172.21.15.158:0/44813943 conn(0x7fbf740b7e60 msgr2=0x7fbf740b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:09.347 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.339+0000 7fbf788de700 1 Processor -- start 2019-12-05T03:50:09.347 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.339+0000 7fbf788de700 1 -- start start 2019-12-05T03:50:09.350 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.343+0000 7fbf788de700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fbf74151390 0x7fbf74154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:09.350 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.343+0000 7fbf788de700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbf74138a20 0x7fbf7407d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:09.350 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.343+0000 7fbf788de700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf7409aa60 con 0x7fbf7407da10 2019-12-05T03:50:09.350 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.343+0000 7fbf788de700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf74155060 con 0x7fbf74138a20 2019-12-05T03:50:09.350 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.343+0000 7fbf788de700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf74136470 con 0x7fbf74151390 2019-12-05T03:50:09.350 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.343+0000 7fbf72d9d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fbf74151390 0x7fbf74154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:09.351 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.343+0000 7fbf72d9d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fbf74151390 0x7fbf74154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53746/0 (socket says 172.21.15.158:53746) 2019-12-05T03:50:09.351 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.343+0000 7fbf72d9d700 1 -- 172.21.15.158:0/2182864876 learned_addr learned my addr 172.21.15.158:0/2182864876 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:09.351 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.343+0000 7fbf6a59c700 1 --2- 172.21.15.158:0/2182864876 >> v2:172.21.15.96:3300/0 conn(0x7fbf74138a20 0x7fbf7407d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:09.351 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.343+0000 7fbf72d9d700 1 -- 172.21.15.158:0/2182864876 >> v2:172.21.15.96:3300/0 conn(0x7fbf74138a20 msgr2=0x7fbf7407d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:09.351 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.343+0000 7fbf72d9d700 1 --2- 172.21.15.158:0/2182864876 >> v2:172.21.15.96:3300/0 conn(0x7fbf74138a20 0x7fbf7407d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:09.351 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.343+0000 7fbf72d9d700 1 -- 172.21.15.158:0/2182864876 >> v1:172.21.15.96:6789/0 conn(0x7fbf7407da10 legacy=0x7fbf741231b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:09.351 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.343+0000 7fbf72d9d700 1 -- 172.21.15.158:0/2182864876 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf74138e50 con 0x7fbf74151390 2019-12-05T03:50:09.352 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.343+0000 7fbf72d9d700 1 --2- 172.21.15.158:0/2182864876 >> v2:172.21.15.158:3300/0 conn(0x7fbf74151390 0x7fbf74154b10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbf64000e90 tx=0x7fbf640109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.352 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.343+0000 7fbf72d9d700 1 --2- 172.21.15.158:0/2182864876 >> v2:172.21.15.158:3300/0 conn(0x7fbf74151390 0x7fbf74154b10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbf64000e90 tx=0x7fbf640109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.352 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.343+0000 7fbf72d9d700 1 --2- 172.21.15.158:0/2182864876 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbf74151390 0x7fbf74154b10 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7fbf64000e90 tx=0x7fbf640109a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:09.352 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.343+0000 7fbf72d9d700 1 --2- 172.21.15.158:0/2182864876 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbf74151390 0x7fbf74154b10 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fbf64000e90 tx=0x7fbf640109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.352 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.343+0000 7fbf72d9d700 1 --2- 172.21.15.158:0/2182864876 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbf74151390 0x7fbf74154b10 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fbf64000e90 tx=0x7fbf640109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.352 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.343+0000 7fbf72d9d700 1 --2- 172.21.15.158:0/2182864876 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbf74151390 0x7fbf74154b10 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fbf64000e90 tx=0x7fbf640109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.352 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.343+0000 7fbf6bfff700 1 -- 172.21.15.158:0/2182864876 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf6400caa0 con 0x7fbf74151390 2019-12-05T03:50:09.353 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.343+0000 7fbf6bfff700 1 -- 172.21.15.158:0/2182864876 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf6400c6c0 con 0x7fbf74151390 2019-12-05T03:50:09.353 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.343+0000 7fbf6bfff700 1 -- 172.21.15.158:0/2182864876 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf64012210 con 0x7fbf74151390 2019-12-05T03:50:09.353 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.343+0000 7fbf788de700 1 -- 172.21.15.158:0/2182864876 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf741239b0 con 0x7fbf74151390 2019-12-05T03:50:09.353 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.343+0000 7fbf788de700 1 -- 172.21.15.158:0/2182864876 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf74123f60 con 0x7fbf74151390 2019-12-05T03:50:09.353 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.343+0000 7fbf72d9d700 1 --2- 172.21.15.158:0/2182864876 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbf74151390 0x7fbf74154b10 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fbf64000e90 tx=0x7fbf640109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.353 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.343+0000 7fbf6bfff700 1 -- 172.21.15.158:0/2182864876 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fbf64012520 con 0x7fbf74151390 2019-12-05T03:50:09.353 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.343+0000 7fbf72d9d700 1 --2- 172.21.15.158:0/2182864876 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbf74151390 0x7fbf74154b10 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fbf64000e90 tx=0x7fbf640109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.354 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.343+0000 7fbf6bfff700 1 --2- 172.21.15.158:0/2182864876 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fbf5803ac90 0x7fbf5803d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:09.354 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.347+0000 7fbf6bfff700 1 -- 172.21.15.158:0/2182864876 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fbf6404b2f0 con 0x7fbf74151390 2019-12-05T03:50:09.354 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.347+0000 7fbf6a59c700 1 --2- 172.21.15.158:0/2182864876 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fbf5803ac90 0x7fbf5803d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:09.354 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.347+0000 7fbf6a59c700 1 --2- 172.21.15.158:0/2182864876 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fbf5803ac90 0x7fbf5803d1a0 crc :-1 s=READY pgs=75 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:09.354 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.351+0000 7fbf788de700 1 -- 172.21.15.158:0/2182864876 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf740554e0 con 0x7fbf74151390 2019-12-05T03:50:09.357 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.355+0000 7fbf72d9d700 1 --2- 172.21.15.158:0/2182864876 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbf74151390 0x7fbf74154b10 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fbf64000e90 tx=0x7fbf640109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.357 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.355+0000 7fbf6bfff700 1 -- 172.21.15.158:0/2182864876 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fbf64032370 con 0x7fbf74151390 2019-12-05T03:50:09.532 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.531+0000 7fbf788de700 1 -- 172.21.15.158:0/2182864876 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbf74066940 con 0x7fbf74151390 2019-12-05T03:50:09.598 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.531+0000 7fbf72d9d700 1 --2- 172.21.15.158:0/2182864876 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbf74151390 0x7fbf74154b10 secure :-1 s=THROTTLE_DONE pgs=134 cs=0 l=1 rx=0x7fbf64000e90 tx=0x7fbf640109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.598 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.531+0000 7fbf6bfff700 1 -- 172.21.15.158:0/2182864876 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbf640325d0 con 0x7fbf74151390 2019-12-05T03:50:09.599 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.531+0000 7fbf788de700 1 -- 172.21.15.158:0/2182864876 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fbf5803ac90 msgr2=0x7fbf5803d1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:09.599 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.535+0000 7fbf788de700 1 --2- 172.21.15.158:0/2182864876 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fbf5803ac90 0x7fbf5803d1a0 crc :-1 s=READY pgs=75 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:09.599 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.535+0000 7fbf788de700 1 -- 172.21.15.158:0/2182864876 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbf74151390 msgr2=0x7fbf74154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:09.599 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.535+0000 7fbf788de700 1 --2- 172.21.15.158:0/2182864876 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbf74151390 0x7fbf74154b10 secure :-1 s=READY pgs=134 cs=0 l=1 rx=0x7fbf64000e90 tx=0x7fbf640109a0).stop 2019-12-05T03:50:09.599 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.535+0000 7fbf788de700 1 -- 172.21.15.158:0/2182864876 shutdown_connections 2019-12-05T03:50:09.599 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.535+0000 7fbf788de700 1 --2- 172.21.15.158:0/2182864876 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fbf5803ac90 0x7fbf5803d1a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:09.599 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.535+0000 7fbf788de700 1 --2- 172.21.15.158:0/2182864876 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbf74151390 0x7fbf74154b10 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:09.600 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.535+0000 7fbf788de700 1 --2- 172.21.15.158:0/2182864876 >> v2:172.21.15.96:3300/0 conn(0x7fbf74138a20 0x7fbf7407d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:09.600 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.535+0000 7fbf788de700 1 -- 172.21.15.158:0/2182864876 shutdown_connections 2019-12-05T03:50:09.600 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.535+0000 7fbf788de700 1 -- 172.21.15.158:0/2182864876 wait complete. 2019-12-05T03:50:09.600 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.535+0000 7fbf788de700 1 -- 172.21.15.158:0/2182864876 >> 172.21.15.158:0/2182864876 conn(0x7fbf7405a740 msgr2=0x7fbf74155740 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:09.600 INFO:teuthology.orchestra.run.smithi158.stdout:55834574854 2019-12-05T03:50:09.601 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2019-12-05T03:50:09.601 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2019-12-05T03:50:09.704 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.695+0000 7f1715aad700 1 Processor -- start 2019-12-05T03:50:09.705 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.695+0000 7f1715aad700 1 -- start start 2019-12-05T03:50:09.705 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.699+0000 7f1715aad700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f171005a740 0x7f1710155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:09.705 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.699+0000 7f1715aad700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17100accb0 con 0x7f171009cf60 2019-12-05T03:50:09.705 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.699+0000 7f1715aad700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1710156100 con 0x7f171009a320 2019-12-05T03:50:09.705 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.699+0000 7f1715aad700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f171009a750 con 0x7f171005a740 2019-12-05T03:50:09.705 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.699+0000 7f170f7fe700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f171009a320 0x7f17101553b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48536/0 (socket says 172.21.15.158:48536) 2019-12-05T03:50:09.706 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.699+0000 7f170f7fe700 1 -- 172.21.15.158:0/74285851 learned_addr learned my addr 172.21.15.158:0/74285851 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:09.706 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.699+0000 7f171484b700 1 --2- 172.21.15.158:0/74285851 >> v2:172.21.15.158:3300/0 conn(0x7f171005a740 0x7f1710155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:09.706 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.699+0000 7f170effd700 1 -- 172.21.15.158:0/74285851 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2223733549 0 0) 0x7f1710156100 con 0x7f171009a320 2019-12-05T03:50:09.706 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.699+0000 7f170effd700 1 -- 172.21.15.158:0/74285851 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16fc0030b0 con 0x7f171009a320 2019-12-05T03:50:09.706 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.699+0000 7f170effd700 1 -- 172.21.15.158:0/74285851 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2407438153 0 0) 0x7f17100accb0 con 0x7f171009cf60 2019-12-05T03:50:09.706 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.699+0000 7f171484b700 1 -- 172.21.15.158:0/74285851 >> v1:172.21.15.158:6789/0 conn(0x7f171009a320 legacy=0x7f17101553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:09.707 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.699+0000 7f171484b700 1 -- 172.21.15.158:0/74285851 >> v1:172.21.15.96:6789/0 conn(0x7f171009cf60 legacy=0x7f1710151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:09.707 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.699+0000 7f171484b700 1 -- 172.21.15.158:0/74285851 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f171005ab70 con 0x7f171005a740 2019-12-05T03:50:09.707 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.699+0000 7f171484b700 1 --2- 172.21.15.158:0/74285851 >> v2:172.21.15.158:3300/0 conn(0x7f171005a740 0x7f1710155bb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f171009c740 tx=0x7f170800ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.707 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.699+0000 7f171484b700 1 --2- 172.21.15.158:0/74285851 >> v2:172.21.15.158:3300/0 conn(0x7f171005a740 0x7f1710155bb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f171009c740 tx=0x7f170800ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.707 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.699+0000 7f171484b700 1 --2- 172.21.15.158:0/74285851 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f171005a740 0x7f1710155bb0 secure :-1 s=READY pgs=136 cs=0 l=1 rx=0x7f171009c740 tx=0x7f170800ff70).ready entity=mon.1 client_cookie=b0962d05e475d80f server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:09.707 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.699+0000 7f171484b700 1 --2- 172.21.15.158:0/74285851 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f171005a740 0x7f1710155bb0 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f171009c740 tx=0x7f170800ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.707 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.699+0000 7f171484b700 1 --2- 172.21.15.158:0/74285851 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f171005a740 0x7f1710155bb0 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f171009c740 tx=0x7f170800ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.708 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.699+0000 7f171484b700 1 --2- 172.21.15.158:0/74285851 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f171005a740 0x7f1710155bb0 secure :-1 s=THROTTLE_DONE pgs=136 cs=0 l=1 rx=0x7f171009c740 tx=0x7f170800ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.708 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.699+0000 7f170effd700 1 -- 172.21.15.158:0/74285851 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1708010970 con 0x7f171005a740 2019-12-05T03:50:09.708 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.699+0000 7f170effd700 1 -- 172.21.15.158:0/74285851 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1708008b50 con 0x7f171005a740 2019-12-05T03:50:09.708 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.699+0000 7f170effd700 1 -- 172.21.15.158:0/74285851 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17080110c0 con 0x7f171005a740 2019-12-05T03:50:09.708 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.699+0000 7f1715aad700 1 -- 172.21.15.158:0/74285851 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f171005a740 msgr2=0x7f1710155bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:09.708 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.699+0000 7f1715aad700 1 --2- 172.21.15.158:0/74285851 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f171005a740 0x7f1710155bb0 secure :-1 s=READY pgs=136 cs=0 l=1 rx=0x7f171009c740 tx=0x7f170800ff70).stop 2019-12-05T03:50:09.708 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.703+0000 7f1715aad700 1 -- 172.21.15.158:0/74285851 shutdown_connections 2019-12-05T03:50:09.709 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.703+0000 7f1715aad700 1 --2- 172.21.15.158:0/74285851 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f171005a740 0x7f1710155bb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:09.709 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.703+0000 7f1715aad700 1 -- 172.21.15.158:0/74285851 shutdown_connections 2019-12-05T03:50:09.709 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.703+0000 7f1715aad700 1 -- 172.21.15.158:0/74285851 wait complete. 2019-12-05T03:50:09.709 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.703+0000 7f1715aad700 1 -- 172.21.15.158:0/74285851 >> 172.21.15.158:0/74285851 conn(0x7f17100b7e60 msgr2=0x7f17100b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:09.713 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.703+0000 7f1715aad700 1 Processor -- start 2019-12-05T03:50:09.713 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.703+0000 7f1715aad700 1 -- start start 2019-12-05T03:50:09.713 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.703+0000 7f1715aad700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f171012bbf0 0x7f171012b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:09.713 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.703+0000 7f1715aad700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1710128af0 con 0x7f17100af7f0 2019-12-05T03:50:09.713 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.703+0000 7f1715aad700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f171009b3f0 con 0x7f171009afc0 2019-12-05T03:50:09.713 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.703+0000 7f1715aad700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17100640b0 con 0x7f171012bbf0 2019-12-05T03:50:09.714 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.703+0000 7f171484b700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f171009afc0 0x7f1710135010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48542/0 (socket says 172.21.15.158:48542) 2019-12-05T03:50:09.714 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.703+0000 7f171484b700 1 -- 172.21.15.158:0/4011878673 learned_addr learned my addr 172.21.15.158:0/4011878673 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:09.714 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.703+0000 7f170ffff700 1 --2- 172.21.15.158:0/4011878673 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f171012bbf0 0x7f171012b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:09.714 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.707+0000 7f170cff9700 1 -- 172.21.15.158:0/4011878673 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 561882560 0 0) 0x7f171009b3f0 con 0x7f171009afc0 2019-12-05T03:50:09.714 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.707+0000 7f170cff9700 1 -- 172.21.15.158:0/4011878673 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16f40030b0 con 0x7f171009afc0 2019-12-05T03:50:09.714 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.707+0000 7f170cff9700 1 -- 172.21.15.158:0/4011878673 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2276834094 0 0) 0x7f1710128af0 con 0x7f17100af7f0 2019-12-05T03:50:09.715 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.707+0000 7f170cff9700 1 -- 172.21.15.158:0/4011878673 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f171009b3f0 con 0x7f17100af7f0 2019-12-05T03:50:09.715 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.707+0000 7f170ffff700 1 -- 172.21.15.158:0/4011878673 >> v1:172.21.15.158:6789/0 conn(0x7f171009afc0 legacy=0x7f1710135010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:09.715 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.707+0000 7f170ffff700 1 -- 172.21.15.158:0/4011878673 >> v1:172.21.15.96:6789/0 conn(0x7f17100af7f0 legacy=0x7f171007ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:09.715 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.707+0000 7f170ffff700 1 -- 172.21.15.158:0/4011878673 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17100afc20 con 0x7f171012bbf0 2019-12-05T03:50:09.715 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.707+0000 7f170ffff700 1 --2- 172.21.15.158:0/4011878673 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f171012bbf0 0x7f171012b5c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f16f8000b80 tx=0x7f16f80107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.715 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.707+0000 7f170ffff700 1 --2- 172.21.15.158:0/4011878673 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f171012bbf0 0x7f171012b5c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f16f8000b80 tx=0x7f16f80107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.715 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.707+0000 7f170ffff700 1 --2- 172.21.15.158:0/4011878673 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f171012bbf0 0x7f171012b5c0 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7f16f8000b80 tx=0x7f16f80107c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:09.716 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.707+0000 7f170ffff700 1 --2- 172.21.15.158:0/4011878673 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f171012bbf0 0x7f171012b5c0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f16f8000b80 tx=0x7f16f80107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.716 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.707+0000 7f170cff9700 1 -- 172.21.15.158:0/4011878673 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16f8006b30 con 0x7f171012bbf0 2019-12-05T03:50:09.716 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.707+0000 7f170ffff700 1 --2- 172.21.15.158:0/4011878673 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f171012bbf0 0x7f171012b5c0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f16f8000b80 tx=0x7f16f80107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.716 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.707+0000 7f170cff9700 1 -- 172.21.15.158:0/4011878673 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f8006750 con 0x7f171012bbf0 2019-12-05T03:50:09.716 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.707+0000 7f170ffff700 1 --2- 172.21.15.158:0/4011878673 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f171012bbf0 0x7f171012b5c0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f16f8000b80 tx=0x7f16f80107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.716 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.707+0000 7f170cff9700 1 -- 172.21.15.158:0/4011878673 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16f8011000 con 0x7f171012bbf0 2019-12-05T03:50:09.717 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.707+0000 7f1715aad700 1 -- 172.21.15.158:0/4011878673 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1710135810 con 0x7f171012bbf0 2019-12-05T03:50:09.717 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.707+0000 7f1715aad700 1 -- 172.21.15.158:0/4011878673 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1710135d90 con 0x7f171012bbf0 2019-12-05T03:50:09.717 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.707+0000 7f170ffff700 1 --2- 172.21.15.158:0/4011878673 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f171012bbf0 0x7f171012b5c0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f16f8000b80 tx=0x7f16f80107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.717 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.707+0000 7f170cff9700 1 -- 172.21.15.158:0/4011878673 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f16f8011320 con 0x7f171012bbf0 2019-12-05T03:50:09.717 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.707+0000 7f170ffff700 1 --2- 172.21.15.158:0/4011878673 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f171012bbf0 0x7f171012b5c0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f16f8000b80 tx=0x7f16f80107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.717 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.711+0000 7f170cff9700 1 --2- 172.21.15.158:0/4011878673 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f16f403b3e0 0x7f16f403d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:09.717 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.711+0000 7f170cff9700 1 -- 172.21.15.158:0/4011878673 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f16f804b020 con 0x7f171012bbf0 2019-12-05T03:50:09.718 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.711+0000 7f170f7fe700 1 --2- 172.21.15.158:0/4011878673 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f16f403b3e0 0x7f16f403d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:09.718 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.711+0000 7f170f7fe700 1 --2- 172.21.15.158:0/4011878673 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f16f403b3e0 0x7f16f403d8f0 crc :-1 s=READY pgs=77 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:09.718 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.711+0000 7f1715aad700 1 -- 172.21.15.158:0/4011878673 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17100554e0 con 0x7f171012bbf0 2019-12-05T03:50:09.723 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.723+0000 7f170ffff700 1 --2- 172.21.15.158:0/4011878673 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f171012bbf0 0x7f171012b5c0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f16f8000b80 tx=0x7f16f80107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.723 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.723+0000 7f170cff9700 1 -- 172.21.15.158:0/4011878673 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f17100afc20 con 0x7f171012bbf0 2019-12-05T03:50:09.901 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.899+0000 7f1715aad700 1 -- 172.21.15.158:0/4011878673 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f1710066940 con 0x7f171012bbf0 2019-12-05T03:50:09.902 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.899+0000 7f170ffff700 1 --2- 172.21.15.158:0/4011878673 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f171012bbf0 0x7f171012b5c0 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f16f8000b80 tx=0x7f16f80107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:09.902 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.899+0000 7f170cff9700 1 -- 172.21.15.158:0/4011878673 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f16f8032080 con 0x7f171012bbf0 2019-12-05T03:50:09.902 INFO:teuthology.orchestra.run.smithi158.stdout:55834574855 2019-12-05T03:50:09.905 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.903+0000 7f1715aad700 1 -- 172.21.15.158:0/4011878673 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f16f403b3e0 msgr2=0x7f16f403d8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:09.905 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.903+0000 7f1715aad700 1 --2- 172.21.15.158:0/4011878673 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f16f403b3e0 0x7f16f403d8f0 crc :-1 s=READY pgs=77 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:09.905 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.903+0000 7f1715aad700 1 -- 172.21.15.158:0/4011878673 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f171012bbf0 msgr2=0x7f171012b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:09.905 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.903+0000 7f1715aad700 1 --2- 172.21.15.158:0/4011878673 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f171012bbf0 0x7f171012b5c0 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7f16f8000b80 tx=0x7f16f80107c0).stop 2019-12-05T03:50:09.905 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.903+0000 7f1715aad700 1 -- 172.21.15.158:0/4011878673 shutdown_connections 2019-12-05T03:50:09.905 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.903+0000 7f1715aad700 1 --2- 172.21.15.158:0/4011878673 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f171012bbf0 0x7f171012b5c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:09.906 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.903+0000 7f1715aad700 1 --2- 172.21.15.158:0/4011878673 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f16f403b3e0 0x7f16f403d8f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:09.906 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.903+0000 7f1715aad700 1 -- 172.21.15.158:0/4011878673 shutdown_connections 2019-12-05T03:50:09.906 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.903+0000 7f1715aad700 1 -- 172.21.15.158:0/4011878673 wait complete. 2019-12-05T03:50:09.906 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:09.903+0000 7f1715aad700 1 -- 172.21.15.158:0/4011878673 >> 172.21.15.158:0/4011878673 conn(0x7f17100654e0 msgr2=0x7f17100b3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:09.914 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2019-12-05T03:50:09.915 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2019-12-05T03:50:10.015 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.007+0000 7f486446f700 1 Processor -- start 2019-12-05T03:50:10.015 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.007+0000 7f486446f700 1 -- start start 2019-12-05T03:50:10.015 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.011+0000 7f486446f700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f485c09a310 0x7f485c05a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:10.015 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.011+0000 7f486446f700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f485c0acca0 con 0x7f485c1553a0 2019-12-05T03:50:10.015 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.011+0000 7f486446f700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f485c0b6970 con 0x7f485c09cf50 2019-12-05T03:50:10.016 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.011+0000 7f486446f700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f485c09a740 con 0x7f485c09a310 2019-12-05T03:50:10.016 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.011+0000 7f486220b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f485c09a310 0x7f485c05a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:10.016 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.011+0000 7f4862a0c700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f485c09cf50 0x7f485c151450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48548/0 (socket says 172.21.15.158:48548) 2019-12-05T03:50:10.016 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.011+0000 7f4862a0c700 1 -- 172.21.15.158:0/3786754151 learned_addr learned my addr 172.21.15.158:0/3786754151 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:10.016 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.011+0000 7f4861a0a700 1 -- 172.21.15.158:0/3786754151 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3788695312 0 0) 0x7f485c0b6970 con 0x7f485c09cf50 2019-12-05T03:50:10.016 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.011+0000 7f4861a0a700 1 -- 172.21.15.158:0/3786754151 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48480030b0 con 0x7f485c09cf50 2019-12-05T03:50:10.016 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.011+0000 7f486220b700 1 -- 172.21.15.158:0/3786754151 >> v1:172.21.15.158:6789/0 conn(0x7f485c09cf50 legacy=0x7f485c151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:10.017 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.011+0000 7f486220b700 1 -- 172.21.15.158:0/3786754151 >> v1:172.21.15.96:6789/0 conn(0x7f485c1553a0 legacy=0x7f485c1557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:10.017 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.011+0000 7f4861a0a700 1 -- 172.21.15.158:0/3786754151 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3928413498 0 0) 0x7f485c0acca0 con 0x7f485c1553a0 2019-12-05T03:50:10.017 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.011+0000 7f486220b700 1 -- 172.21.15.158:0/3786754151 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f485c155fd0 con 0x7f485c09a310 2019-12-05T03:50:10.017 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.011+0000 7f486220b700 1 --2- 172.21.15.158:0/3786754151 >> v2:172.21.15.158:3300/0 conn(0x7f485c09a310 0x7f485c05a730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4850008790 tx=0x7f485000fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.017 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.011+0000 7f486220b700 1 --2- 172.21.15.158:0/3786754151 >> v2:172.21.15.158:3300/0 conn(0x7f485c09a310 0x7f485c05a730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4850008790 tx=0x7f485000fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.017 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.011+0000 7f486220b700 1 --2- 172.21.15.158:0/3786754151 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f485c09a310 0x7f485c05a730 secure :-1 s=READY pgs=139 cs=0 l=1 rx=0x7f4850008790 tx=0x7f485000fbf0).ready entity=mon.1 client_cookie=291c721ff0a00ab8 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:10.017 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.011+0000 7f486220b700 1 --2- 172.21.15.158:0/3786754151 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f485c09a310 0x7f485c05a730 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f4850008790 tx=0x7f485000fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.018 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.011+0000 7f4861a0a700 1 -- 172.21.15.158:0/3786754151 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4850011230 con 0x7f485c09a310 2019-12-05T03:50:10.018 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.011+0000 7f486220b700 1 --2- 172.21.15.158:0/3786754151 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f485c09a310 0x7f485c05a730 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f4850008790 tx=0x7f485000fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.018 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.011+0000 7f486220b700 1 --2- 172.21.15.158:0/3786754151 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f485c09a310 0x7f485c05a730 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f4850008790 tx=0x7f485000fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.018 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.011+0000 7f4861a0a700 1 -- 172.21.15.158:0/3786754151 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4850008bc0 con 0x7f485c09a310 2019-12-05T03:50:10.018 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.011+0000 7f4861a0a700 1 -- 172.21.15.158:0/3786754151 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4850011810 con 0x7f485c09a310 2019-12-05T03:50:10.018 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.011+0000 7f486446f700 1 -- 172.21.15.158:0/3786754151 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f485c09a310 msgr2=0x7f485c05a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:10.018 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.011+0000 7f486446f700 1 --2- 172.21.15.158:0/3786754151 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f485c09a310 0x7f485c05a730 secure :-1 s=READY pgs=139 cs=0 l=1 rx=0x7f4850008790 tx=0x7f485000fbf0).stop 2019-12-05T03:50:10.018 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.011+0000 7f486446f700 1 -- 172.21.15.158:0/3786754151 shutdown_connections 2019-12-05T03:50:10.019 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.011+0000 7f486446f700 1 --2- 172.21.15.158:0/3786754151 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f485c09a310 0x7f485c05a730 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:10.019 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.011+0000 7f486446f700 1 -- 172.21.15.158:0/3786754151 shutdown_connections 2019-12-05T03:50:10.019 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.011+0000 7f486446f700 1 -- 172.21.15.158:0/3786754151 wait complete. 2019-12-05T03:50:10.019 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.011+0000 7f486446f700 1 -- 172.21.15.158:0/3786754151 >> 172.21.15.158:0/3786754151 conn(0x7f485c0b7e50 msgr2=0x7f485c0b3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:10.022 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.015+0000 7f486446f700 1 Processor -- start 2019-12-05T03:50:10.022 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.015+0000 7f486446f700 1 -- start start 2019-12-05T03:50:10.023 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.015+0000 7f486446f700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f485c07d9e0 0x7f485c12f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:10.023 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.015+0000 7f486446f700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f485c0aef80 0x7f485c139df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:10.023 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.015+0000 7f486446f700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f485c0ad7a0 con 0x7f485c13dc30 2019-12-05T03:50:10.023 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.015+0000 7f486446f700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f485c0adf90 con 0x7f485c07d9e0 2019-12-05T03:50:10.023 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.015+0000 7f486446f700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f485c0ae230 con 0x7f485c0aef80 2019-12-05T03:50:10.023 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.015+0000 7f486320d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f485c0aef80 0x7f485c139df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:10.024 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.015+0000 7f486220b700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f485c07d9e0 0x7f485c12f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:10.024 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.015+0000 7f486320d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f485c0aef80 0x7f485c139df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53778/0 (socket says 172.21.15.158:53778) 2019-12-05T03:50:10.024 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.015+0000 7f486320d700 1 -- 172.21.15.158:0/2255925675 learned_addr learned my addr 172.21.15.158:0/2255925675 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:10.024 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.015+0000 7f486320d700 1 -- 172.21.15.158:0/2255925675 >> v2:172.21.15.96:3300/0 conn(0x7f485c07d9e0 msgr2=0x7f485c12f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:10.024 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.015+0000 7f486320d700 1 --2- 172.21.15.158:0/2255925675 >> v2:172.21.15.96:3300/0 conn(0x7f485c07d9e0 0x7f485c12f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:10.024 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.015+0000 7f486320d700 1 -- 172.21.15.158:0/2255925675 >> v1:172.21.15.96:6789/0 conn(0x7f485c13dc30 legacy=0x7f485c07d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:10.024 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.015+0000 7f486320d700 1 -- 172.21.15.158:0/2255925675 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f485c0adba0 con 0x7f485c0aef80 2019-12-05T03:50:10.025 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.015+0000 7f486320d700 1 --2- 172.21.15.158:0/2255925675 >> v2:172.21.15.158:3300/0 conn(0x7f485c0aef80 0x7f485c139df0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4854001210 tx=0x7f4854010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.025 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.015+0000 7f486320d700 1 --2- 172.21.15.158:0/2255925675 >> v2:172.21.15.158:3300/0 conn(0x7f485c0aef80 0x7f485c139df0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4854001210 tx=0x7f4854010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.025 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.015+0000 7f486320d700 1 --2- 172.21.15.158:0/2255925675 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f485c0aef80 0x7f485c139df0 secure :-1 s=READY pgs=140 cs=0 l=1 rx=0x7f4854001210 tx=0x7f4854010b50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:10.025 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.015+0000 7f486320d700 1 --2- 172.21.15.158:0/2255925675 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f485c0aef80 0x7f485c139df0 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7f4854001210 tx=0x7f4854010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.025 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.015+0000 7f484f7fe700 1 -- 172.21.15.158:0/2255925675 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4854006ac0 con 0x7f485c0aef80 2019-12-05T03:50:10.025 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.015+0000 7f486320d700 1 --2- 172.21.15.158:0/2255925675 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f485c0aef80 0x7f485c139df0 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7f4854001210 tx=0x7f4854010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.025 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.015+0000 7f486320d700 1 --2- 172.21.15.158:0/2255925675 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f485c0aef80 0x7f485c139df0 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7f4854001210 tx=0x7f4854010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.026 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.015+0000 7f484f7fe700 1 -- 172.21.15.158:0/2255925675 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48540066e0 con 0x7f485c0aef80 2019-12-05T03:50:10.026 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.015+0000 7f486446f700 1 -- 172.21.15.158:0/2255925675 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f485c0af3b0 con 0x7f485c0aef80 2019-12-05T03:50:10.026 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.015+0000 7f484f7fe700 1 -- 172.21.15.158:0/2255925675 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4854002730 con 0x7f485c0aef80 2019-12-05T03:50:10.026 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.015+0000 7f486446f700 1 -- 172.21.15.158:0/2255925675 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f485c13a340 con 0x7f485c0aef80 2019-12-05T03:50:10.026 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.015+0000 7f486320d700 1 --2- 172.21.15.158:0/2255925675 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f485c0aef80 0x7f485c139df0 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7f4854001210 tx=0x7f4854010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.026 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.019+0000 7f484f7fe700 1 -- 172.21.15.158:0/2255925675 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f4854002a00 con 0x7f485c0aef80 2019-12-05T03:50:10.026 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.019+0000 7f486320d700 1 --2- 172.21.15.158:0/2255925675 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f485c0aef80 0x7f485c139df0 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7f4854001210 tx=0x7f4854010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.027 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.019+0000 7f484f7fe700 1 --2- 172.21.15.158:0/2255925675 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f484403add0 0x7f484403d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:10.027 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.019+0000 7f484f7fe700 1 -- 172.21.15.158:0/2255925675 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f485404b360 con 0x7f485c0aef80 2019-12-05T03:50:10.027 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.019+0000 7f4862a0c700 1 --2- 172.21.15.158:0/2255925675 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f484403add0 0x7f484403d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:10.027 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.019+0000 7f4862a0c700 1 --2- 172.21.15.158:0/2255925675 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f484403add0 0x7f484403d2e0 crc :-1 s=READY pgs=78 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:10.027 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.023+0000 7f486446f700 1 -- 172.21.15.158:0/2255925675 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f485c0b3120 con 0x7f485c0aef80 2019-12-05T03:50:10.035 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.035+0000 7f486320d700 1 --2- 172.21.15.158:0/2255925675 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f485c0aef80 0x7f485c139df0 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7f4854001210 tx=0x7f4854010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.036 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.035+0000 7f484f7fe700 1 -- 172.21.15.158:0/2255925675 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f48540323e0 con 0x7f485c0aef80 2019-12-05T03:50:10.208 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.207+0000 7f486446f700 1 -- 172.21.15.158:0/2255925675 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f485c0554d0 con 0x7f485c0aef80 2019-12-05T03:50:10.209 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.207+0000 7f486320d700 1 --2- 172.21.15.158:0/2255925675 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f485c0aef80 0x7f485c139df0 secure :-1 s=THROTTLE_DONE pgs=140 cs=0 l=1 rx=0x7f4854001210 tx=0x7f4854010b50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.209 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.207+0000 7f484f7fe700 1 -- 172.21.15.158:0/2255925675 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4854032640 con 0x7f485c0aef80 2019-12-05T03:50:10.209 INFO:teuthology.orchestra.run.smithi158.stdout:55834574855 2019-12-05T03:50:10.212 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.207+0000 7f486446f700 1 -- 172.21.15.158:0/2255925675 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f484403add0 msgr2=0x7f484403d2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:10.212 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.207+0000 7f486446f700 1 --2- 172.21.15.158:0/2255925675 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f484403add0 0x7f484403d2e0 crc :-1 s=READY pgs=78 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:10.212 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.207+0000 7f486446f700 1 -- 172.21.15.158:0/2255925675 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f485c0aef80 msgr2=0x7f485c139df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:10.213 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.207+0000 7f486446f700 1 --2- 172.21.15.158:0/2255925675 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f485c0aef80 0x7f485c139df0 secure :-1 s=READY pgs=140 cs=0 l=1 rx=0x7f4854001210 tx=0x7f4854010b50).stop 2019-12-05T03:50:10.213 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.207+0000 7f486446f700 1 -- 172.21.15.158:0/2255925675 shutdown_connections 2019-12-05T03:50:10.213 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.207+0000 7f486446f700 1 --2- 172.21.15.158:0/2255925675 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f485c0aef80 0x7f485c139df0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:10.213 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.207+0000 7f486446f700 1 --2- 172.21.15.158:0/2255925675 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f484403add0 0x7f484403d2e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:10.213 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.207+0000 7f486446f700 1 --2- 172.21.15.158:0/2255925675 >> v2:172.21.15.96:3300/0 conn(0x7f485c07d9e0 0x7f485c12f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:10.214 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.207+0000 7f486446f700 1 -- 172.21.15.158:0/2255925675 shutdown_connections 2019-12-05T03:50:10.214 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.211+0000 7f486446f700 1 -- 172.21.15.158:0/2255925675 wait complete. 2019-12-05T03:50:10.214 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.211+0000 7f486446f700 1 -- 172.21.15.158:0/2255925675 >> 172.21.15.158:0/2255925675 conn(0x7f485c0b55f0 msgr2=0x7f485c07e040 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:10.226 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2019-12-05T03:50:10.226 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2019-12-05T03:50:10.320 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.315+0000 7fda792ea700 1 Processor -- start 2019-12-05T03:50:10.320 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.315+0000 7fda792ea700 1 -- start start 2019-12-05T03:50:10.320 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.315+0000 7fda792ea700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fda7409cf50 0x7fda7409a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:10.320 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.315+0000 7fda792ea700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fda7405a730 0x7fda74151450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:10.321 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.315+0000 7fda792ea700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda740acca0 con 0x7fda741519a0 2019-12-05T03:50:10.321 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.315+0000 7fda792ea700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda740b1720 con 0x7fda7405a730 2019-12-05T03:50:10.321 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.315+0000 7fda792ea700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda740b19c0 con 0x7fda7409cf50 2019-12-05T03:50:10.321 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.315+0000 7fda737fe700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fda7409cf50 0x7fda7409a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:10.321 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.315+0000 7fda72ffd700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fda7405a730 0x7fda74151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:10.321 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.315+0000 7fda737fe700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fda7409cf50 0x7fda7409a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.158:36522/0 (socket says 172.21.15.158:36522) 2019-12-05T03:50:10.321 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.315+0000 7fda737fe700 1 -- 172.21.15.158:0/2138626936 learned_addr learned my addr 172.21.15.158:0/2138626936 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:10.322 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.315+0000 7fda72ffd700 1 -- 172.21.15.158:0/2138626936 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fda7409cf50 msgr2=0x7fda7409a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:10.322 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.315+0000 7fda72ffd700 1 --2- 172.21.15.158:0/2138626936 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fda7409cf50 0x7fda7409a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:10.322 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.315+0000 7fda72ffd700 1 -- 172.21.15.158:0/2138626936 >> v1:172.21.15.96:6789/0 conn(0x7fda741519a0 legacy=0x7fda740b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:10.322 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.315+0000 7fda72ffd700 1 -- 172.21.15.158:0/2138626936 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda7405ab60 con 0x7fda7405a730 2019-12-05T03:50:10.322 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.315+0000 7fda72ffd700 1 --2- 172.21.15.158:0/2138626936 >> v2:172.21.15.96:3300/0 conn(0x7fda7405a730 0x7fda74151450 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fda740b18e0 tx=0x7fda6c00fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.322 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.315+0000 7fda72ffd700 1 --2- 172.21.15.158:0/2138626936 >> v2:172.21.15.96:3300/0 conn(0x7fda7405a730 0x7fda74151450 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fda740b18e0 tx=0x7fda6c00fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.322 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.315+0000 7fda72ffd700 1 --2- 172.21.15.158:0/2138626936 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda7405a730 0x7fda74151450 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7fda740b18e0 tx=0x7fda6c00fff0).ready entity=mon.0 client_cookie=bc60398c31465688 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:10.323 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.315+0000 7fda72ffd700 1 --2- 172.21.15.158:0/2138626936 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda7405a730 0x7fda74151450 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7fda740b18e0 tx=0x7fda6c00fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.323 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.315+0000 7fda727fc700 1 -- 172.21.15.158:0/2138626936 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda6c011a50 con 0x7fda7405a730 2019-12-05T03:50:10.323 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.315+0000 7fda72ffd700 1 --2- 172.21.15.158:0/2138626936 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda7405a730 0x7fda74151450 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7fda740b18e0 tx=0x7fda6c00fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.323 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.315+0000 7fda72ffd700 1 --2- 172.21.15.158:0/2138626936 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda7405a730 0x7fda74151450 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7fda740b18e0 tx=0x7fda6c00fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.323 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.315+0000 7fda727fc700 1 -- 172.21.15.158:0/2138626936 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda6c011670 con 0x7fda7405a730 2019-12-05T03:50:10.323 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.315+0000 7fda727fc700 1 -- 172.21.15.158:0/2138626936 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda6c00a350 con 0x7fda7405a730 2019-12-05T03:50:10.323 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.315+0000 7fda792ea700 1 -- 172.21.15.158:0/2138626936 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda7405a730 msgr2=0x7fda74151450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:10.324 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.315+0000 7fda792ea700 1 --2- 172.21.15.158:0/2138626936 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda7405a730 0x7fda74151450 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7fda740b18e0 tx=0x7fda6c00fff0).stop 2019-12-05T03:50:10.324 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.315+0000 7fda792ea700 1 -- 172.21.15.158:0/2138626936 shutdown_connections 2019-12-05T03:50:10.324 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.315+0000 7fda792ea700 1 --2- 172.21.15.158:0/2138626936 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fda7409cf50 0x7fda7409a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:10.324 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.315+0000 7fda792ea700 1 --2- 172.21.15.158:0/2138626936 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda7405a730 0x7fda74151450 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:10.324 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.319+0000 7fda792ea700 1 -- 172.21.15.158:0/2138626936 shutdown_connections 2019-12-05T03:50:10.325 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.319+0000 7fda792ea700 1 -- 172.21.15.158:0/2138626936 wait complete. 2019-12-05T03:50:10.325 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.319+0000 7fda792ea700 1 -- 172.21.15.158:0/2138626936 >> 172.21.15.158:0/2138626936 conn(0x7fda740b7e50 msgr2=0x7fda740b3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:10.328 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.319+0000 7fda792ea700 1 Processor -- start 2019-12-05T03:50:10.329 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.319+0000 7fda792ea700 1 -- start start 2019-12-05T03:50:10.329 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.319+0000 7fda792ea700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fda7409a310 0x7fda74140150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:10.329 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.319+0000 7fda792ea700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fda740643f0 0x7fda74064820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:10.329 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.319+0000 7fda792ea700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda7409a740 con 0x7fda7407b4f0 2019-12-05T03:50:10.329 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.319+0000 7fda792ea700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda7407d5e0 con 0x7fda7409a310 2019-12-05T03:50:10.329 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.319+0000 7fda792ea700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda7413c3e0 con 0x7fda740643f0 2019-12-05T03:50:10.330 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.319+0000 7fda72ffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fda7409a310 0x7fda74140150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:10.330 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.319+0000 7fda72ffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fda7409a310 0x7fda74140150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53788/0 (socket says 172.21.15.158:53788) 2019-12-05T03:50:10.330 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.319+0000 7fda737fe700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fda7407b4f0 0x7fda7407cde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48572/0 (socket says 172.21.15.158:48572) 2019-12-05T03:50:10.330 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.319+0000 7fda72ffd700 1 -- 172.21.15.158:0/1194996201 learned_addr learned my addr 172.21.15.158:0/1194996201 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:10.331 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.319+0000 7fda73fff700 1 --2- 172.21.15.158:0/1194996201 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fda740643f0 0x7fda74064820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:10.331 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.319+0000 7fda72ffd700 1 -- 172.21.15.158:0/1194996201 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fda740643f0 msgr2=0x7fda74064820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:10.331 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.319+0000 7fda72ffd700 1 --2- 172.21.15.158:0/1194996201 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fda740643f0 0x7fda74064820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:10.331 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.319+0000 7fda6bfff700 1 -- 172.21.15.158:0/1194996201 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 234011250 0 0) 0x7fda7409a740 con 0x7fda7407b4f0 2019-12-05T03:50:10.331 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.319+0000 7fda72ffd700 1 -- 172.21.15.158:0/1194996201 >> v1:172.21.15.158:6789/0 conn(0x7fda7407b4f0 legacy=0x7fda7407cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:10.331 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.319+0000 7fda72ffd700 1 -- 172.21.15.158:0/1194996201 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda7413c5d0 con 0x7fda7409a310 2019-12-05T03:50:10.332 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.319+0000 7fda72ffd700 1 --2- 172.21.15.158:0/1194996201 >> v2:172.21.15.158:3300/0 conn(0x7fda7409a310 0x7fda74140150 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fda740b18e0 tx=0x7fda6c011920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.332 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.319+0000 7fda72ffd700 1 --2- 172.21.15.158:0/1194996201 >> v2:172.21.15.158:3300/0 conn(0x7fda7409a310 0x7fda74140150 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fda740b18e0 tx=0x7fda6c011920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.332 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.319+0000 7fda72ffd700 1 --2- 172.21.15.158:0/1194996201 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda7409a310 0x7fda74140150 secure :-1 s=READY pgs=142 cs=0 l=1 rx=0x7fda740b18e0 tx=0x7fda6c011920).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:10.332 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.319+0000 7fda72ffd700 1 --2- 172.21.15.158:0/1194996201 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda7409a310 0x7fda74140150 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7fda740b18e0 tx=0x7fda6c011920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.334 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.319+0000 7fda6bfff700 1 -- 172.21.15.158:0/1194996201 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda6c00f760 con 0x7fda7409a310 2019-12-05T03:50:10.334 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.319+0000 7fda72ffd700 1 --2- 172.21.15.158:0/1194996201 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda7409a310 0x7fda74140150 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7fda740b18e0 tx=0x7fda6c011920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.334 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.319+0000 7fda72ffd700 1 --2- 172.21.15.158:0/1194996201 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda7409a310 0x7fda74140150 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7fda740b18e0 tx=0x7fda6c011920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.335 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.323+0000 7fda6bfff700 1 -- 172.21.15.158:0/1194996201 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda6c011c50 con 0x7fda7409a310 2019-12-05T03:50:10.335 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.323+0000 7fda6bfff700 1 -- 172.21.15.158:0/1194996201 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda6c005ab0 con 0x7fda7409a310 2019-12-05T03:50:10.335 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.323+0000 7fda792ea700 1 -- 172.21.15.158:0/1194996201 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda7413c8a0 con 0x7fda7409a310 2019-12-05T03:50:10.335 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.323+0000 7fda792ea700 1 -- 172.21.15.158:0/1194996201 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda7413ce50 con 0x7fda7409a310 2019-12-05T03:50:10.335 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.323+0000 7fda72ffd700 1 --2- 172.21.15.158:0/1194996201 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda7409a310 0x7fda74140150 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7fda740b18e0 tx=0x7fda6c011920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.335 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.323+0000 7fda6bfff700 1 -- 172.21.15.158:0/1194996201 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fda6c007150 con 0x7fda7409a310 2019-12-05T03:50:10.336 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.323+0000 7fda72ffd700 1 --2- 172.21.15.158:0/1194996201 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda7409a310 0x7fda74140150 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7fda740b18e0 tx=0x7fda6c011920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.336 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.323+0000 7fda6bfff700 1 --2- 172.21.15.158:0/1194996201 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fda5803ac50 0x7fda5803d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:10.336 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.323+0000 7fda6bfff700 1 -- 172.21.15.158:0/1194996201 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fda6c04b970 con 0x7fda7409a310 2019-12-05T03:50:10.336 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.323+0000 7fda737fe700 1 --2- 172.21.15.158:0/1194996201 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fda5803ac50 0x7fda5803d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:10.336 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.323+0000 7fda737fe700 1 --2- 172.21.15.158:0/1194996201 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fda5803ac50 0x7fda5803d160 crc :-1 s=READY pgs=79 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:10.337 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.331+0000 7fda792ea700 1 -- 172.21.15.158:0/1194996201 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda740554d0 con 0x7fda7409a310 2019-12-05T03:50:10.341 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.339+0000 7fda72ffd700 1 --2- 172.21.15.158:0/1194996201 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda7409a310 0x7fda74140150 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7fda740b18e0 tx=0x7fda6c011920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.341 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.339+0000 7fda6bfff700 1 -- 172.21.15.158:0/1194996201 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fda6c0329f0 con 0x7fda7409a310 2019-12-05T03:50:10.519 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.519+0000 7fda792ea700 1 -- 172.21.15.158:0/1194996201 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fda74066930 con 0x7fda7409a310 2019-12-05T03:50:10.520 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.519+0000 7fda72ffd700 1 --2- 172.21.15.158:0/1194996201 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda7409a310 0x7fda74140150 secure :-1 s=THROTTLE_DONE pgs=142 cs=0 l=1 rx=0x7fda740b18e0 tx=0x7fda6c011920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.520 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.519+0000 7fda6bfff700 1 -- 172.21.15.158:0/1194996201 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fda6c005d80 con 0x7fda7409a310 2019-12-05T03:50:10.521 INFO:teuthology.orchestra.run.smithi158.stdout:55834574854 2019-12-05T03:50:10.523 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.519+0000 7fda792ea700 1 -- 172.21.15.158:0/1194996201 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fda5803ac50 msgr2=0x7fda5803d160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:10.523 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.519+0000 7fda792ea700 1 --2- 172.21.15.158:0/1194996201 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fda5803ac50 0x7fda5803d160 crc :-1 s=READY pgs=79 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:10.524 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.519+0000 7fda792ea700 1 -- 172.21.15.158:0/1194996201 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda7409a310 msgr2=0x7fda74140150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:10.524 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.519+0000 7fda792ea700 1 --2- 172.21.15.158:0/1194996201 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda7409a310 0x7fda74140150 secure :-1 s=READY pgs=142 cs=0 l=1 rx=0x7fda740b18e0 tx=0x7fda6c011920).stop 2019-12-05T03:50:10.524 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.519+0000 7fda792ea700 1 -- 172.21.15.158:0/1194996201 shutdown_connections 2019-12-05T03:50:10.524 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.519+0000 7fda792ea700 1 --2- 172.21.15.158:0/1194996201 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fda5803ac50 0x7fda5803d160 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:10.524 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.519+0000 7fda792ea700 1 --2- 172.21.15.158:0/1194996201 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fda740643f0 0x7fda74064820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:10.525 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.519+0000 7fda792ea700 1 --2- 172.21.15.158:0/1194996201 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fda7409a310 0x7fda74140150 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:10.533 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.519+0000 7fda792ea700 1 -- 172.21.15.158:0/1194996201 shutdown_connections 2019-12-05T03:50:10.533 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.519+0000 7fda792ea700 1 -- 172.21.15.158:0/1194996201 wait complete. 2019-12-05T03:50:10.534 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.519+0000 7fda792ea700 1 -- 172.21.15.158:0/1194996201 >> 172.21.15.158:0/1194996201 conn(0x7fda740b7e50 msgr2=0x7fda7412e980 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:10.542 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2019-12-05T03:50:10.542 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2019-12-05T03:50:10.647 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.639+0000 7f8aaf0d5700 1 Processor -- start 2019-12-05T03:50:10.647 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.639+0000 7f8aaf0d5700 1 -- start start 2019-12-05T03:50:10.647 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.639+0000 7f8aaf0d5700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8aa809cf50 0x7f8aa809a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:10.647 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.639+0000 7f8aaf0d5700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f8aa81553a0 0x7f8aa81557d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:10.648 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.639+0000 7f8aaf0d5700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa80acca0 con 0x7f8aa805a730 2019-12-05T03:50:10.648 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.639+0000 7f8aaf0d5700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aa80b1720 con 0x7f8aa809cf50 2019-12-05T03:50:10.648 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.639+0000 7f8aaf0d5700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aa80b19c0 con 0x7f8aa81553a0 2019-12-05T03:50:10.648 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.639+0000 7f8aade73700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f8aa81553a0 0x7f8aa81557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:10.648 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.639+0000 7f8aade73700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f8aa81553a0 0x7f8aa81557d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53800/0 (socket says 172.21.15.158:53800) 2019-12-05T03:50:10.648 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.639+0000 7f8aade73700 1 -- 172.21.15.158:0/3311734089 learned_addr learned my addr 172.21.15.158:0/3311734089 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:10.648 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.639+0000 7f8aad672700 1 --2- 172.21.15.158:0/3311734089 >> v2:172.21.15.96:3300/0 conn(0x7f8aa809cf50 0x7f8aa809a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:10.649 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.643+0000 7f8aade73700 1 -- 172.21.15.158:0/3311734089 >> v2:172.21.15.96:3300/0 conn(0x7f8aa809cf50 msgr2=0x7f8aa809a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:10.649 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.643+0000 7f8aade73700 1 --2- 172.21.15.158:0/3311734089 >> v2:172.21.15.96:3300/0 conn(0x7f8aa809cf50 0x7f8aa809a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:10.649 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.643+0000 7f8aade73700 1 -- 172.21.15.158:0/3311734089 >> v1:172.21.15.96:6789/0 conn(0x7f8aa805a730 legacy=0x7f8aa8151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:10.649 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.643+0000 7f8aade73700 1 -- 172.21.15.158:0/3311734089 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa805ab60 con 0x7f8aa81553a0 2019-12-05T03:50:10.649 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.643+0000 7f8aade73700 1 --2- 172.21.15.158:0/3311734089 >> v2:172.21.15.158:3300/0 conn(0x7f8aa81553a0 0x7f8aa81557d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8aa0008790 tx=0x7f8aa000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.649 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.643+0000 7f8aade73700 1 --2- 172.21.15.158:0/3311734089 >> v2:172.21.15.158:3300/0 conn(0x7f8aa81553a0 0x7f8aa81557d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8aa0008790 tx=0x7f8aa000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.649 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.643+0000 7f8aade73700 1 --2- 172.21.15.158:0/3311734089 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8aa81553a0 0x7f8aa81557d0 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7f8aa0008790 tx=0x7f8aa000fd30).ready entity=mon.1 client_cookie=56055040159b5155 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:10.650 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.643+0000 7f8aade73700 1 --2- 172.21.15.158:0/3311734089 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8aa81553a0 0x7f8aa81557d0 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f8aa0008790 tx=0x7f8aa000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.650 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.643+0000 7f8a9bfff700 1 -- 172.21.15.158:0/3311734089 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8aa0008c90 con 0x7f8aa81553a0 2019-12-05T03:50:10.650 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.643+0000 7f8aade73700 1 --2- 172.21.15.158:0/3311734089 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8aa81553a0 0x7f8aa81557d0 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f8aa0008790 tx=0x7f8aa000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.650 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.643+0000 7f8aade73700 1 --2- 172.21.15.158:0/3311734089 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8aa81553a0 0x7f8aa81557d0 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f8aa0008790 tx=0x7f8aa000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.650 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.643+0000 7f8a9bfff700 1 -- 172.21.15.158:0/3311734089 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa00088b0 con 0x7f8aa81553a0 2019-12-05T03:50:10.650 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.643+0000 7f8a9bfff700 1 -- 172.21.15.158:0/3311734089 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8aa0011ad0 con 0x7f8aa81553a0 2019-12-05T03:50:10.650 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.643+0000 7f8aaf0d5700 1 -- 172.21.15.158:0/3311734089 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8aa81553a0 msgr2=0x7f8aa81557d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:10.651 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.643+0000 7f8aaf0d5700 1 --2- 172.21.15.158:0/3311734089 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8aa81553a0 0x7f8aa81557d0 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7f8aa0008790 tx=0x7f8aa000fd30).stop 2019-12-05T03:50:10.651 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.643+0000 7f8aaf0d5700 1 -- 172.21.15.158:0/3311734089 shutdown_connections 2019-12-05T03:50:10.651 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.643+0000 7f8aaf0d5700 1 --2- 172.21.15.158:0/3311734089 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8aa81553a0 0x7f8aa81557d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:10.651 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.643+0000 7f8aaf0d5700 1 --2- 172.21.15.158:0/3311734089 >> v2:172.21.15.96:3300/0 conn(0x7f8aa809cf50 0x7f8aa809a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:10.651 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.643+0000 7f8aaf0d5700 1 -- 172.21.15.158:0/3311734089 shutdown_connections 2019-12-05T03:50:10.651 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.643+0000 7f8aaf0d5700 1 -- 172.21.15.158:0/3311734089 wait complete. 2019-12-05T03:50:10.651 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.643+0000 7f8aaf0d5700 1 -- 172.21.15.158:0/3311734089 >> 172.21.15.158:0/3311734089 conn(0x7f8aa80b7e50 msgr2=0x7f8aa80b3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:10.652 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.643+0000 7f8aaf0d5700 1 Processor -- start 2019-12-05T03:50:10.652 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.647+0000 7f8aaf0d5700 1 -- start start 2019-12-05T03:50:10.655 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.647+0000 7f8aaf0d5700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f8aa8130c50 0x7f8aa8152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:10.655 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.647+0000 7f8aaf0d5700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8aa81406b0 0x7f8aa8140ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:10.655 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.647+0000 7f8aaf0d5700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa8151f70 con 0x7f8aa8151b40 2019-12-05T03:50:10.656 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.647+0000 7f8aaf0d5700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aa81513a0 con 0x7f8aa81406b0 2019-12-05T03:50:10.656 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.647+0000 7f8aaf0d5700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aa8153250 con 0x7f8aa8130c50 2019-12-05T03:50:10.656 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.647+0000 7f8aad672700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f8aa8130c50 0x7f8aa8152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:10.656 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.647+0000 7f8aace71700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f8aa8151b40 0x7f8aa8153600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48584/0 (socket says 172.21.15.158:48584) 2019-12-05T03:50:10.656 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.647+0000 7f8aace71700 1 -- 172.21.15.158:0/3885845716 learned_addr learned my addr 172.21.15.158:0/3885845716 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:10.656 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.647+0000 7f8aad672700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f8aa8130c50 0x7f8aa8152d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53802/0 (socket says 172.21.15.158:53802) 2019-12-05T03:50:10.656 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.647+0000 7f8aade73700 1 --2- 172.21.15.158:0/3885845716 >> v2:172.21.15.96:3300/0 conn(0x7f8aa81406b0 0x7f8aa8140ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:10.657 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.647+0000 7f8aad672700 1 -- 172.21.15.158:0/3885845716 >> v2:172.21.15.96:3300/0 conn(0x7f8aa81406b0 msgr2=0x7f8aa8140ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:10.657 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.647+0000 7f8aad672700 1 --2- 172.21.15.158:0/3885845716 >> v2:172.21.15.96:3300/0 conn(0x7f8aa81406b0 0x7f8aa8140ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:10.657 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.647+0000 7f8aad672700 1 -- 172.21.15.158:0/3885845716 >> v1:172.21.15.158:6789/0 conn(0x7f8aa8151b40 legacy=0x7f8aa8153600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:10.657 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.647+0000 7f8a99ffb700 1 -- 172.21.15.158:0/3885845716 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3478357692 0 0) 0x7f8aa8151f70 con 0x7f8aa8151b40 2019-12-05T03:50:10.657 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.647+0000 7f8aad672700 1 -- 172.21.15.158:0/3885845716 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa8141030 con 0x7f8aa8130c50 2019-12-05T03:50:10.657 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.647+0000 7f8aad672700 1 --2- 172.21.15.158:0/3885845716 >> v2:172.21.15.158:3300/0 conn(0x7f8aa8130c50 0x7f8aa8152d00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8a9c002f30 tx=0x7f8a9c010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.657 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.647+0000 7f8aad672700 1 --2- 172.21.15.158:0/3885845716 >> v2:172.21.15.158:3300/0 conn(0x7f8aa8130c50 0x7f8aa8152d00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8a9c002f30 tx=0x7f8a9c010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.658 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.647+0000 7f8aad672700 1 --2- 172.21.15.158:0/3885845716 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8aa8130c50 0x7f8aa8152d00 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7f8a9c002f30 tx=0x7f8a9c010ae0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:10.658 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.647+0000 7f8aad672700 1 --2- 172.21.15.158:0/3885845716 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8aa8130c50 0x7f8aa8152d00 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f8a9c002f30 tx=0x7f8a9c010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.658 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.647+0000 7f8a99ffb700 1 -- 172.21.15.158:0/3885845716 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a9c008bd0 con 0x7f8aa8130c50 2019-12-05T03:50:10.658 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.647+0000 7f8aad672700 1 --2- 172.21.15.158:0/3885845716 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8aa8130c50 0x7f8aa8152d00 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f8a9c002f30 tx=0x7f8a9c010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.658 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.647+0000 7f8a99ffb700 1 -- 172.21.15.158:0/3885845716 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9c0087f0 con 0x7f8aa8130c50 2019-12-05T03:50:10.658 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.647+0000 7f8aaf0d5700 1 -- 172.21.15.158:0/3885845716 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa8141300 con 0x7f8aa8130c50 2019-12-05T03:50:10.658 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.647+0000 7f8aad672700 1 --2- 172.21.15.158:0/3885845716 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8aa8130c50 0x7f8aa8152d00 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f8a9c002f30 tx=0x7f8a9c010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.659 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.647+0000 7f8a99ffb700 1 -- 172.21.15.158:0/3885845716 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a9c005730 con 0x7f8aa8130c50 2019-12-05T03:50:10.659 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.647+0000 7f8aaf0d5700 1 -- 172.21.15.158:0/3885845716 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa8077d20 con 0x7f8aa8130c50 2019-12-05T03:50:10.659 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.651+0000 7f8aad672700 1 --2- 172.21.15.158:0/3885845716 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8aa8130c50 0x7f8aa8152d00 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f8a9c002f30 tx=0x7f8a9c010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.659 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.651+0000 7f8a99ffb700 1 -- 172.21.15.158:0/3885845716 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f8a9c0059d0 con 0x7f8aa8130c50 2019-12-05T03:50:10.659 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.651+0000 7f8aad672700 1 --2- 172.21.15.158:0/3885845716 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8aa8130c50 0x7f8aa8152d00 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f8a9c002f30 tx=0x7f8a9c010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.659 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.651+0000 7f8a99ffb700 1 --2- 172.21.15.158:0/3885845716 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f8a8803ac40 0x7f8a8803d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:10.659 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.651+0000 7f8a99ffb700 1 -- 172.21.15.158:0/3885845716 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f8a9c04aff0 con 0x7f8aa8130c50 2019-12-05T03:50:10.659 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.651+0000 7f8aace71700 1 --2- 172.21.15.158:0/3885845716 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f8a8803ac40 0x7f8a8803d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:10.660 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.651+0000 7f8aace71700 1 --2- 172.21.15.158:0/3885845716 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f8a8803ac40 0x7f8a8803d150 crc :-1 s=READY pgs=80 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:10.660 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.655+0000 7f8aaf0d5700 1 -- 172.21.15.158:0/3885845716 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aa8154530 con 0x7f8aa8130c50 2019-12-05T03:50:10.662 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.659+0000 7f8aad672700 1 --2- 172.21.15.158:0/3885845716 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8aa8130c50 0x7f8aa8152d00 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f8a9c002f30 tx=0x7f8a9c010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.662 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.659+0000 7f8a99ffb700 1 -- 172.21.15.158:0/3885845716 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f8a9c032050 con 0x7f8aa8130c50 2019-12-05T03:50:10.836 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.835+0000 7f8aaf0d5700 1 -- 172.21.15.158:0/3885845716 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f8aa80554d0 con 0x7f8aa8130c50 2019-12-05T03:50:10.836 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.835+0000 7f8aad672700 1 --2- 172.21.15.158:0/3885845716 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8aa8130c50 0x7f8aa8152d00 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7f8a9c002f30 tx=0x7f8a9c010ae0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.836 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.835+0000 7f8a99ffb700 1 -- 172.21.15.158:0/3885845716 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8a9c0322b0 con 0x7f8aa8130c50 2019-12-05T03:50:10.836 INFO:teuthology.orchestra.run.smithi158.stdout:55834574854 2019-12-05T03:50:10.839 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.835+0000 7f8aaf0d5700 1 -- 172.21.15.158:0/3885845716 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f8a8803ac40 msgr2=0x7f8a8803d150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:10.839 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.835+0000 7f8aaf0d5700 1 --2- 172.21.15.158:0/3885845716 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f8a8803ac40 0x7f8a8803d150 crc :-1 s=READY pgs=80 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:10.840 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.835+0000 7f8aaf0d5700 1 -- 172.21.15.158:0/3885845716 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8aa8130c50 msgr2=0x7f8aa8152d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:10.840 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.835+0000 7f8aaf0d5700 1 --2- 172.21.15.158:0/3885845716 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8aa8130c50 0x7f8aa8152d00 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7f8a9c002f30 tx=0x7f8a9c010ae0).stop 2019-12-05T03:50:10.840 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.835+0000 7f8aaf0d5700 1 -- 172.21.15.158:0/3885845716 shutdown_connections 2019-12-05T03:50:10.840 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.835+0000 7f8aaf0d5700 1 --2- 172.21.15.158:0/3885845716 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f8a8803ac40 0x7f8a8803d150 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:10.840 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.835+0000 7f8aaf0d5700 1 --2- 172.21.15.158:0/3885845716 >> v2:172.21.15.96:3300/0 conn(0x7f8aa81406b0 0x7f8aa8140ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:10.840 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.835+0000 7f8aaf0d5700 1 --2- 172.21.15.158:0/3885845716 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8aa8130c50 0x7f8aa8152d00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:10.840 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.835+0000 7f8aaf0d5700 1 -- 172.21.15.158:0/3885845716 shutdown_connections 2019-12-05T03:50:10.841 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.835+0000 7f8aaf0d5700 1 -- 172.21.15.158:0/3885845716 wait complete. 2019-12-05T03:50:10.841 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.835+0000 7f8aaf0d5700 1 -- 172.21.15.158:0/3885845716 >> 172.21.15.158:0/3885845716 conn(0x7f8aa8068c50 msgr2=0x7f8aa80593e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:10.849 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2019-12-05T03:50:10.849 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2019-12-05T03:50:10.849 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2019-12-05T03:50:10.938 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.931+0000 7f80c6b72700 1 Processor -- start 2019-12-05T03:50:10.938 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.935+0000 7f80c6b72700 1 -- start start 2019-12-05T03:50:10.939 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.935+0000 7f80c6b72700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f80c005a730 0x7f80c0155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:10.939 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.935+0000 7f80c6b72700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80c00acca0 con 0x7f80c009cf50 2019-12-05T03:50:10.939 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.935+0000 7f80c6b72700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80c01560f0 con 0x7f80c009a310 2019-12-05T03:50:10.939 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.935+0000 7f80c6b72700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80c009a740 con 0x7f80c005a730 2019-12-05T03:50:10.939 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.935+0000 7f80c5910700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f80c005a730 0x7f80c0155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:10.939 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.935+0000 7f80c490e700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f80c009a310 0x7f80c01553a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48592/0 (socket says 172.21.15.158:48592) 2019-12-05T03:50:10.939 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.935+0000 7f80c490e700 1 -- 172.21.15.158:0/186993886 learned_addr learned my addr 172.21.15.158:0/186993886 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:10.940 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.935+0000 7f80c5910700 1 -- 172.21.15.158:0/186993886 >> v1:172.21.15.158:6789/0 conn(0x7f80c009a310 legacy=0x7f80c01553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:10.940 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.935+0000 7f80c5910700 1 -- 172.21.15.158:0/186993886 >> v1:172.21.15.96:6789/0 conn(0x7f80c009cf50 legacy=0x7f80c0151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:10.940 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.935+0000 7f80c5910700 1 -- 172.21.15.158:0/186993886 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c005ab60 con 0x7f80c005a730 2019-12-05T03:50:10.940 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.935+0000 7f80c5910700 1 --2- 172.21.15.158:0/186993886 >> v2:172.21.15.158:3300/0 conn(0x7f80c005a730 0x7f80c0155ba0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f80c009c730 tx=0x7f80b000fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.940 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.935+0000 7f80c5910700 1 --2- 172.21.15.158:0/186993886 >> v2:172.21.15.158:3300/0 conn(0x7f80c005a730 0x7f80c0155ba0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f80c009c730 tx=0x7f80b000fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.940 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.935+0000 7f80c5910700 1 --2- 172.21.15.158:0/186993886 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f80c005a730 0x7f80c0155ba0 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7f80c009c730 tx=0x7f80b000fbf0).ready entity=mon.1 client_cookie=37cc74a5c0cbe9e server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:10.940 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.935+0000 7f80c5910700 1 --2- 172.21.15.158:0/186993886 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f80c005a730 0x7f80c0155ba0 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f80c009c730 tx=0x7f80b000fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.941 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.935+0000 7f80bffff700 1 -- 172.21.15.158:0/186993886 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80b0008bb0 con 0x7f80c005a730 2019-12-05T03:50:10.941 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.935+0000 7f80c5910700 1 --2- 172.21.15.158:0/186993886 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f80c005a730 0x7f80c0155ba0 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f80c009c730 tx=0x7f80b000fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.941 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.935+0000 7f80c5910700 1 --2- 172.21.15.158:0/186993886 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f80c005a730 0x7f80c0155ba0 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f80c009c730 tx=0x7f80b000fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.941 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.935+0000 7f80bffff700 1 -- 172.21.15.158:0/186993886 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b00087d0 con 0x7f80c005a730 2019-12-05T03:50:10.941 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.935+0000 7f80bffff700 1 -- 172.21.15.158:0/186993886 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80b00118d0 con 0x7f80c005a730 2019-12-05T03:50:10.941 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.935+0000 7f80c6b72700 1 -- 172.21.15.158:0/186993886 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f80c005a730 msgr2=0x7f80c0155ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:10.941 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.935+0000 7f80c6b72700 1 --2- 172.21.15.158:0/186993886 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f80c005a730 0x7f80c0155ba0 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7f80c009c730 tx=0x7f80b000fbf0).stop 2019-12-05T03:50:10.942 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.935+0000 7f80c6b72700 1 -- 172.21.15.158:0/186993886 shutdown_connections 2019-12-05T03:50:10.942 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.935+0000 7f80c6b72700 1 --2- 172.21.15.158:0/186993886 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f80c005a730 0x7f80c0155ba0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:10.942 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.935+0000 7f80c6b72700 1 -- 172.21.15.158:0/186993886 shutdown_connections 2019-12-05T03:50:10.942 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.935+0000 7f80c6b72700 1 -- 172.21.15.158:0/186993886 wait complete. 2019-12-05T03:50:10.942 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.935+0000 7f80c6b72700 1 -- 172.21.15.158:0/186993886 >> 172.21.15.158:0/186993886 conn(0x7f80c00b7e50 msgr2=0x7f80c00b3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:10.946 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.935+0000 7f80c6b72700 1 Processor -- start 2019-12-05T03:50:10.946 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.935+0000 7f80c6b72700 1 -- start start 2019-12-05T03:50:10.946 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80c6b72700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80c013b790 0x7f80c013dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:10.946 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80c6b72700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80c007dd10 con 0x7f80c00b3060 2019-12-05T03:50:10.947 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80c6b72700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80c00b0c00 con 0x7f80c0137010 2019-12-05T03:50:10.947 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80c6b72700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c00ae130 con 0x7f80c013b790 2019-12-05T03:50:10.947 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80c510f700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f80c0137010 0x7f80c007d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48596/0 (socket says 172.21.15.158:48596) 2019-12-05T03:50:10.947 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80c510f700 1 -- 172.21.15.158:0/4226936456 learned_addr learned my addr 172.21.15.158:0/4226936456 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:10.947 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80c5910700 1 --2- 172.21.15.158:0/4226936456 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80c013b790 0x7f80c013dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:10.947 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80bdffb700 1 -- 172.21.15.158:0/4226936456 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2277180684 0 0) 0x7f80c00b0c00 con 0x7f80c0137010 2019-12-05T03:50:10.947 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80bdffb700 1 -- 172.21.15.158:0/4226936456 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80a00030b0 con 0x7f80c0137010 2019-12-05T03:50:10.948 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80bdffb700 1 -- 172.21.15.158:0/4226936456 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4229839847 0 0) 0x7f80a00030b0 con 0x7f80c0137010 2019-12-05T03:50:10.948 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80bdffb700 1 -- 172.21.15.158:0/4226936456 --> v1:172.21.15.158:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f80c00b0c00 con 0x7f80c0137010 2019-12-05T03:50:10.948 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80bdffb700 1 -- 172.21.15.158:0/4226936456 <== mon.1 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 828730332 0 0) 0x7f80b8001de0 con 0x7f80c0137010 2019-12-05T03:50:10.948 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80bdffb700 1 -- 172.21.15.158:0/4226936456 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80c013b790 msgr2=0x7f80c013dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:10.949 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80bdffb700 1 --2- 172.21.15.158:0/4226936456 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80c013b790 0x7f80c013dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:10.949 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80bdffb700 1 -- 172.21.15.158:0/4226936456 >> v1:172.21.15.158:6789/0 conn(0x7f80c0137010 legacy=0x7f80c007d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:10.949 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80bdffb700 1 -- 172.21.15.158:0/4226936456 >> v1:172.21.15.96:6789/0 conn(0x7f80c00b3060 legacy=0x7f80c00af3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:10.949 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80bdffb700 1 --2- 172.21.15.158:0/4226936456 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f80a00038a0 0x7f80a0003cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:10.950 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80bdffb700 1 --2- 172.21.15.158:0/4226936456 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80a0004420 0x7f80a0004850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:10.950 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80bdffb700 1 --2- 172.21.15.158:0/4226936456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a0004da0 0x7f80a000b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:10.950 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80bdffb700 1 -- 172.21.15.158:0/4226936456 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c00ae130 con 0x7f80a0004da0 2019-12-05T03:50:10.950 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80bdffb700 1 -- 172.21.15.158:0/4226936456 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a000bbc0 con 0x7f80a00038a0 2019-12-05T03:50:10.950 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80bdffb700 1 -- 172.21.15.158:0/4226936456 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a000bd80 con 0x7f80a0004420 2019-12-05T03:50:10.950 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80c510f700 1 --2- 172.21.15.158:0/4226936456 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f80a00038a0 0x7f80a0003cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:10.950 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80c5910700 1 --2- 172.21.15.158:0/4226936456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a0004da0 0x7f80a000b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:10.951 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80c510f700 1 -- 172.21.15.158:0/4226936456 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80a0004420 msgr2=0x7f80a0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:10.951 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80c510f700 1 --2- 172.21.15.158:0/4226936456 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f80a0004420 0x7f80a0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:10.951 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80c510f700 1 -- 172.21.15.158:0/4226936456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a0004da0 msgr2=0x7f80a000b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:10.951 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80c510f700 1 --2- 172.21.15.158:0/4226936456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a0004da0 0x7f80a000b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:10.951 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80c510f700 1 -- 172.21.15.158:0/4226936456 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c00b3490 con 0x7f80a00038a0 2019-12-05T03:50:10.951 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80c6b72700 1 -- 172.21.15.158:0/4226936456 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c0151220 con 0x7f80a00038a0 2019-12-05T03:50:10.951 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80c510f700 1 --2- 172.21.15.158:0/4226936456 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f80a00038a0 0x7f80a0003cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f80b80020a0 tx=0x7f80b80119d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.952 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80c6b72700 1 -- 172.21.15.158:0/4226936456 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c0151720 con 0x7f80a00038a0 2019-12-05T03:50:10.952 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80c510f700 1 --2- 172.21.15.158:0/4226936456 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f80a00038a0 0x7f80a0003cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f80b80020a0 tx=0x7f80b80119d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.952 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80c510f700 1 --2- 172.21.15.158:0/4226936456 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f80a00038a0 0x7f80a0003cd0 secure :-1 s=READY pgs=149 cs=0 l=1 rx=0x7f80b80020a0 tx=0x7f80b80119d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:10.952 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80c510f700 1 --2- 172.21.15.158:0/4226936456 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f80a00038a0 0x7f80a0003cd0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f80b80020a0 tx=0x7f80b80119d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.953 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80bdffb700 1 -- 172.21.15.158:0/4226936456 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80b80098a0 con 0x7f80a00038a0 2019-12-05T03:50:10.953 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80c510f700 1 --2- 172.21.15.158:0/4226936456 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f80a00038a0 0x7f80a0003cd0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f80b80020a0 tx=0x7f80b80119d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.953 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80c510f700 1 --2- 172.21.15.158:0/4226936456 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f80a00038a0 0x7f80a0003cd0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f80b80020a0 tx=0x7f80b80119d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.953 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80bdffb700 1 -- 172.21.15.158:0/4226936456 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b8006a60 con 0x7f80a00038a0 2019-12-05T03:50:10.953 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80bdffb700 1 -- 172.21.15.158:0/4226936456 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80b800b180 con 0x7f80a00038a0 2019-12-05T03:50:10.953 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80c510f700 1 --2- 172.21.15.158:0/4226936456 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f80a00038a0 0x7f80a0003cd0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f80b80020a0 tx=0x7f80b80119d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.953 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80bdffb700 1 -- 172.21.15.158:0/4226936456 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f80b800b380 con 0x7f80a00038a0 2019-12-05T03:50:10.954 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80c510f700 1 --2- 172.21.15.158:0/4226936456 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f80a00038a0 0x7f80a0003cd0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f80b80020a0 tx=0x7f80b80119d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.954 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80bdffb700 1 --2- 172.21.15.158:0/4226936456 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f80a0047ed0 0x7f80a004a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:10.954 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80bdffb700 1 -- 172.21.15.158:0/4226936456 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f80b804b930 con 0x7f80a00038a0 2019-12-05T03:50:10.954 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.939+0000 7f80c490e700 1 --2- 172.21.15.158:0/4226936456 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f80a0047ed0 0x7f80a004a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:10.954 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.943+0000 7f80c490e700 1 --2- 172.21.15.158:0/4226936456 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f80a0047ed0 0x7f80a004a3e0 crc :-1 s=READY pgs=81 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:10.955 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.951+0000 7f80c6b72700 1 -- 172.21.15.158:0/4226936456 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8098003200 con 0x7f80a00038a0 2019-12-05T03:50:10.959 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.955+0000 7f80c510f700 1 --2- 172.21.15.158:0/4226936456 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f80a00038a0 0x7f80a0003cd0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f80b80020a0 tx=0x7f80b80119d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:10.960 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:10.955+0000 7f80bdffb700 1 -- 172.21.15.158:0/4226936456 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f80b80329b0 con 0x7f80a00038a0 2019-12-05T03:50:11.128 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.127+0000 7f80c6b72700 1 -- 172.21.15.158:0/4226936456 --> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8098002010 con 0x7f80a0047ed0 2019-12-05T03:50:11.135 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.135+0000 7f80bdffb700 1 -- 172.21.15.158:0/4226936456 <== mgr.4105 v2:172.21.15.96:6800/12043 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+80367 (crc 0 0 0) 0x7f8098002010 con 0x7f80a0047ed0 2019-12-05T03:50:11.144 INFO:teuthology.orchestra.run.smithi158.stderr:dumped all 2019-12-05T03:50:11.144 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:11.146 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.143+0000 7f80c6b72700 1 -- 172.21.15.158:0/4226936456 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f80a0047ed0 msgr2=0x7f80a004a3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:11.146 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.143+0000 7f80c6b72700 1 --2- 172.21.15.158:0/4226936456 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f80a0047ed0 0x7f80a004a3e0 crc :-1 s=READY pgs=81 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:11.146 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.143+0000 7f80c6b72700 1 -- 172.21.15.158:0/4226936456 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f80a00038a0 msgr2=0x7f80a0003cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:11.147 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.143+0000 7f80c5910700 1 -- 172.21.15.158:0/4226936456 reap_dead start 2019-12-05T03:50:11.147 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.143+0000 7f80c6b72700 1 --2- 172.21.15.158:0/4226936456 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f80a00038a0 0x7f80a0003cd0 secure :-1 s=READY pgs=149 cs=0 l=1 rx=0x7f80b80020a0 tx=0x7f80b80119d0).stop 2019-12-05T03:50:11.147 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.143+0000 7f80c6b72700 1 -- 172.21.15.158:0/4226936456 shutdown_connections 2019-12-05T03:50:11.147 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.143+0000 7f80c6b72700 1 --2- 172.21.15.158:0/4226936456 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f80a00038a0 0x7f80a0003cd0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:11.147 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.143+0000 7f80c6b72700 1 -- 172.21.15.158:0/4226936456 shutdown_connections 2019-12-05T03:50:11.147 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.143+0000 7f80c6b72700 1 -- 172.21.15.158:0/4226936456 wait complete. 2019-12-05T03:50:11.147 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.143+0000 7f80c6b72700 1 -- 172.21.15.158:0/4226936456 >> 172.21.15.158:0/4226936456 conn(0x7f80c009cf50 msgr2=0x7f80c00b5830 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:11.159 INFO:teuthology.orchestra.run.smithi158.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2019-12-05T03:50:09.478124+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390560,"kb_used_data":1888,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584160,"statfs":{"total":773094113280,"available":764502179840,"internally_reserved":8589934592,"allocated":1933312,"data_stored":714872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"3.7","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:01.113231+0000","last_change":"2019-12-05T03:50:01.112050+0000","last_active":"2019-12-05T03:50:01.113231+0000","last_peered":"2019-12-05T03:50:01.113231+0000","last_clean":"2019-12-05T03:50:01.113231+0000","last_became_active":"2019-12-05T03:50:01.110666+0000","last_became_peered":"2019-12-05T03:50:01.110666+0000","last_unstale":"2019-12-05T03:50:01.113231+0000","last_undegraded":"2019-12-05T03:50:01.113231+0000","last_fullsized":"2019-12-05T03:50:01.113231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:59.635454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:59.635454+0000","last_clean_scrub_stamp":"2019-12-05T03:49:59.635454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:00.943043+0000","last_change":"2019-12-05T03:49:54.605466+0000","last_active":"2019-12-05T03:50:00.943043+0000","last_peered":"2019-12-05T03:50:00.943043+0000","last_clean":"2019-12-05T03:50:00.943043+0000","last_became_active":"2019-12-05T03:49:54.605086+0000","last_became_peered":"2019-12-05T03:49:54.605086+0000","last_unstale":"2019-12-05T03:50:00.943043+0000","last_undegraded":"2019-12-05T03:50:00.943043+0000","last_fullsized":"2019-12-05T03:50:00.943043+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:53.583773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:53.583773+0000","last_clean_scrub_stamp":"2019-12-05T03:49:53.583773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:00.945453+0000","last_change":"2019-12-05T03:49:57.643880+0000","last_active":"2019-12-05T03:50:00.945453+0000","last_peered":"2019-12-05T03:50:00.945453+0000","last_clean":"2019-12-05T03:50:00.945453+0000","last_became_active":"2019-12-05T03:49:57.643380+0000","last_became_peered":"2019-12-05T03:49:57.643380+0000","last_unstale":"2019-12-05T03:50:00.945453+0000","last_undegraded":"2019-12-05T03:50:00.945453+0000","last_fullsized":"2019-12-05T03:50:00.945453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:56.617239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:56.617239+0000","last_clean_scrub_stamp":"2019-12-05T03:49:56.617239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:01.113165+0000","last_change":"2019-12-05T03:50:01.112246+0000","last_active":"2019-12-05T03:50:01.113165+0000","last_peered":"2019-12-05T03:50:01.113165+0000","last_clean":"2019-12-05T03:50:01.113165+0000","last_became_active":"2019-12-05T03:50:01.110948+0000","last_became_peered":"2019-12-05T03:50:01.110948+0000","last_unstale":"2019-12-05T03:50:01.113165+0000","last_undegraded":"2019-12-05T03:50:01.113165+0000","last_fullsized":"2019-12-05T03:50:01.113165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:59.635454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:59.635454+0000","last_clean_scrub_stamp":"2019-12-05T03:49:59.635454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"15","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:01.109422+0000","last_change":"2019-12-05T03:49:54.608763+0000","last_active":"2019-12-05T03:50:01.109422+0000","last_peered":"2019-12-05T03:50:01.109422+0000","last_clean":"2019-12-05T03:50:01.109422+0000","last_became_active":"2019-12-05T03:49:54.608314+0000","last_became_peered":"2019-12-05T03:49:54.608314+0000","last_unstale":"2019-12-05T03:50:01.109422+0000","last_undegraded":"2019-12-05T03:50:01.109422+0000","last_fullsized":"2019-12-05T03:50:01.109422+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:53.583773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:53.583773+0000","last_clean_scrub_stamp":"2019-12-05T03:49:53.583773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:00.942761+0000","last_change":"2019-12-05T03:49:57.639944+0000","last_active":"2019-12-05T03:50:00.942761+0000","last_peered":"2019-12-05T03:50:00.942761+0000","last_clean":"2019-12-05T03:50:00.942761+0000","last_became_active":"2019-12-05T03:49:57.639237+0000","last_became_peered":"2019-12-05T03:49:57.639237+0000","last_unstale":"2019-12-05T03:50:00.942761+0000","last_undegraded":"2019-12-05T03:50:00.942761+0000","last_fullsized":"2019-12-05T03:50:00.942761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:56.617239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:56.617239+0000","last_clean_scrub_stamp":"2019-12-05T03:49:56.617239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:00.953102+0000","last_change":"2019-12-05T03:50:00.952574+0000","last_active":"2019-12-05T03:50:00.953102+0000","last_peered":"2019-12-05T03:50:00.953102+0000","last_clean":"2019-12-05T03:50:00.953102+0000","last_became_active":"2019-12-05T03:50:00.952144+0000","last_became_peered":"2019-12-05T03:50:00.952144+0000","last_unstale":"2019-12-05T03:50:00.953102+0000","last_undegraded":"2019-12-05T03:50:00.953102+0000","last_fullsized":"2019-12-05T03:50:00.953102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:59.635454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:59.635454+0000","last_clean_scrub_stamp":"2019-12-05T03:49:59.635454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:00.943909+0000","last_change":"2019-12-05T03:49:54.605022+0000","last_active":"2019-12-05T03:50:00.943909+0000","last_peered":"2019-12-05T03:50:00.943909+0000","last_clean":"2019-12-05T03:50:00.943909+0000","last_became_active":"2019-12-05T03:49:54.604659+0000","last_became_peered":"2019-12-05T03:49:54.604659+0000","last_unstale":"2019-12-05T03:50:00.943909+0000","last_undegraded":"2019-12-05T03:50:00.943909+0000","last_fullsized":"2019-12-05T03:50:00.943909+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:53.583773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:53.583773+0000","last_clean_scrub_stamp":"2019-12-05T03:49:53.583773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:00.942681+0000","last_change":"2019-12-05T03:49:57.645998+0000","last_active":"2019-12-05T03:50:00.942681+0000","last_peered":"2019-12-05T03:50:00.942681+0000","last_clean":"2019-12-05T03:50:00.942681+0000","last_became_active":"2019-12-05T03:49:57.645617+0000","last_became_peered":"2019-12-05T03:49:57.645617+0000","last_unstale":"2019-12-05T03:50:00.942681+0000","last_undegraded":"2019-12-05T03:50:00.942681+0000","last_fullsized":"2019-12-05T03:50:00.942681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:56.617239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:56.617239+0000","last_clean_scrub_stamp":"2019-12-05T03:49:56.617239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:01.116950+0000","last_change":"2019-12-05T03:50:01.112651+0000","last_active":"2019-12-05T03:50:01.116950+0000","last_peered":"2019-12-05T03:50:01.116950+0000","last_clean":"2019-12-05T03:50:01.116950+0000","last_became_active":"2019-12-05T03:50:01.111403+0000","last_became_peered":"2019-12-05T03:50:01.111403+0000","last_unstale":"2019-12-05T03:50:01.116950+0000","last_undegraded":"2019-12-05T03:50:01.116950+0000","last_fullsized":"2019-12-05T03:50:01.116950+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:59.635454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:59.635454+0000","last_clean_scrub_stamp":"2019-12-05T03:49:59.635454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:00.946366+0000","last_change":"2019-12-05T03:49:54.605485+0000","last_active":"2019-12-05T03:50:00.946366+0000","last_peered":"2019-12-05T03:50:00.946366+0000","last_clean":"2019-12-05T03:50:00.946366+0000","last_became_active":"2019-12-05T03:49:54.605133+0000","last_became_peered":"2019-12-05T03:49:54.605133+0000","last_unstale":"2019-12-05T03:50:00.946366+0000","last_undegraded":"2019-12-05T03:50:00.946366+0000","last_fullsized":"2019-12-05T03:50:00.946366+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:53.583773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:53.583773+0000","last_clean_scrub_stamp":"2019-12-05T03:49:53.583773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:01.109176+0000","last_change":"2019-12-05T03:49:57.650575+0000","last_active":"2019-12-05T03:50:01.109176+0000","last_peered":"2019-12-05T03:50:01.109176+0000","last_clean":"2019-12-05T03:50:01.109176+0000","last_became_active":"2019-12-05T03:49:57.650156+0000","last_became_peered":"2019-12-05T03:49:57.650156+0000","last_unstale":"2019-12-05T03:50:01.109176+0000","last_undegraded":"2019-12-05T03:50:01.109176+0000","last_fullsized":"2019-12-05T03:50:01.109176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:56.617239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:56.617239+0000","last_clean_scrub_stamp":"2019-12-05T03:49:56.617239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:00.987064+0000","last_change":"2019-12-05T03:50:00.986657+0000","last_active":"2019-12-05T03:50:00.987064+0000","last_peered":"2019-12-05T03:50:00.987064+0000","last_clean":"2019-12-05T03:50:00.987064+0000","last_became_active":"2019-12-05T03:50:00.986005+0000","last_became_peered":"2019-12-05T03:50:00.986005+0000","last_unstale":"2019-12-05T03:50:00.987064+0000","last_undegraded":"2019-12-05T03:50:00.987064+0000","last_fullsized":"2019-12-05T03:50:00.987064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:59.635454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:59.635454+0000","last_clean_scrub_stamp":"2019-12-05T03:49:59.635454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"15","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:00.982265+0000","last_change":"2019-12-05T03:49:54.605679+0000","last_active":"2019-12-05T03:50:00.982265+0000","last_peered":"2019-12-05T03:50:00.982265+0000","last_clean":"2019-12-05T03:50:00.982265+0000","last_became_active":"2019-12-05T03:49:54.605284+0000","last_became_peered":"2019-12-05T03:49:54.605284+0000","last_unstale":"2019-12-05T03:50:00.982265+0000","last_undegraded":"2019-12-05T03:50:00.982265+0000","last_fullsized":"2019-12-05T03:50:00.982265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:53.583773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:53.583773+0000","last_clean_scrub_stamp":"2019-12-05T03:49:53.583773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:00.942934+0000","last_change":"2019-12-05T03:49:57.755395+0000","last_active":"2019-12-05T03:50:00.942934+0000","last_peered":"2019-12-05T03:50:00.942934+0000","last_clean":"2019-12-05T03:50:00.942934+0000","last_became_active":"2019-12-05T03:49:57.755029+0000","last_became_peered":"2019-12-05T03:49:57.755029+0000","last_unstale":"2019-12-05T03:50:00.942934+0000","last_undegraded":"2019-12-05T03:50:00.942934+0000","last_fullsized":"2019-12-05T03:50:00.942934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:56.617239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:56.617239+0000","last_clean_scrub_stamp":"2019-12-05T03:49:56.617239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:01.109689+0000","last_change":"2019-12-05T03:50:01.109262+0000","last_active":"2019-12-05T03:50:01.109689+0000","last_peered":"2019-12-05T03:50:01.109689+0000","last_clean":"2019-12-05T03:50:01.109689+0000","last_became_active":"2019-12-05T03:50:01.108416+0000","last_became_peered":"2019-12-05T03:50:01.108416+0000","last_unstale":"2019-12-05T03:50:01.109689+0000","last_undegraded":"2019-12-05T03:50:01.109689+0000","last_fullsized":"2019-12-05T03:50:01.109689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:59.635454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:59.635454+0000","last_clean_scrub_stamp":"2019-12-05T03:49:59.635454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"15","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:00.942668+0000","last_change":"2019-12-05T03:49:54.606720+0000","last_active":"2019-12-05T03:50:00.942668+0000","last_peered":"2019-12-05T03:50:00.942668+0000","last_clean":"2019-12-05T03:50:00.942668+0000","last_became_active":"2019-12-05T03:49:54.606363+0000","last_became_peered":"2019-12-05T03:49:54.606363+0000","last_unstale":"2019-12-05T03:50:00.942668+0000","last_undegraded":"2019-12-05T03:50:00.942668+0000","last_fullsized":"2019-12-05T03:50:00.942668+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:53.583773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:53.583773+0000","last_clean_scrub_stamp":"2019-12-05T03:49:53.583773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:00.942815+0000","last_change":"2019-12-05T03:49:57.754454+0000","last_active":"2019-12-05T03:50:00.942815+0000","last_peered":"2019-12-05T03:50:00.942815+0000","last_clean":"2019-12-05T03:50:00.942815+0000","last_became_active":"2019-12-05T03:49:57.753760+0000","last_became_peered":"2019-12-05T03:49:57.753760+0000","last_unstale":"2019-12-05T03:50:00.942815+0000","last_undegraded":"2019-12-05T03:50:00.942815+0000","last_fullsized":"2019-12-05T03:50:00.942815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:56.617239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:56.617239+0000","last_clean_scrub_stamp":"2019-12-05T03:49:56.617239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:00.953206+0000","last_change":"2019-12-05T03:50:00.952616+0000","last_active":"2019-12-05T03:50:00.953206+0000","last_peered":"2019-12-05T03:50:00.953206+0000","last_clean":"2019-12-05T03:50:00.953206+0000","last_became_active":"2019-12-05T03:50:00.952039+0000","last_became_peered":"2019-12-05T03:50:00.952039+0000","last_unstale":"2019-12-05T03:50:00.953206+0000","last_undegraded":"2019-12-05T03:50:00.953206+0000","last_fullsized":"2019-12-05T03:50:00.953206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:59.635454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:59.635454+0000","last_clean_scrub_stamp":"2019-12-05T03:49:59.635454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"15","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:00.943034+0000","last_change":"2019-12-05T03:49:54.606549+0000","last_active":"2019-12-05T03:50:00.943034+0000","last_peered":"2019-12-05T03:50:00.943034+0000","last_clean":"2019-12-05T03:50:00.943034+0000","last_became_active":"2019-12-05T03:49:54.606141+0000","last_became_peered":"2019-12-05T03:49:54.606141+0000","last_unstale":"2019-12-05T03:50:00.943034+0000","last_undegraded":"2019-12-05T03:50:00.943034+0000","last_fullsized":"2019-12-05T03:50:00.943034+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:53.583773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:53.583773+0000","last_clean_scrub_stamp":"2019-12-05T03:49:53.583773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:00.942893+0000","last_change":"2019-12-05T03:49:57.643050+0000","last_active":"2019-12-05T03:50:00.942893+0000","last_peered":"2019-12-05T03:50:00.942893+0000","last_clean":"2019-12-05T03:50:00.942893+0000","last_became_active":"2019-12-05T03:49:57.642755+0000","last_became_peered":"2019-12-05T03:49:57.642755+0000","last_unstale":"2019-12-05T03:50:00.942893+0000","last_undegraded":"2019-12-05T03:50:00.942893+0000","last_fullsized":"2019-12-05T03:50:00.942893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:56.617239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:56.617239+0000","last_clean_scrub_stamp":"2019-12-05T03:49:56.617239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:00.950044+0000","last_change":"2019-12-05T03:50:00.949570+0000","last_active":"2019-12-05T03:50:00.950044+0000","last_peered":"2019-12-05T03:50:00.950044+0000","last_clean":"2019-12-05T03:50:00.950044+0000","last_became_active":"2019-12-05T03:50:00.949099+0000","last_became_peered":"2019-12-05T03:50:00.949099+0000","last_unstale":"2019-12-05T03:50:00.950044+0000","last_undegraded":"2019-12-05T03:50:00.950044+0000","last_fullsized":"2019-12-05T03:50:00.950044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:59.635454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:59.635454+0000","last_clean_scrub_stamp":"2019-12-05T03:49:59.635454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"15","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:00.982418+0000","last_change":"2019-12-05T03:49:54.606167+0000","last_active":"2019-12-05T03:50:00.982418+0000","last_peered":"2019-12-05T03:50:00.982418+0000","last_clean":"2019-12-05T03:50:00.982418+0000","last_became_active":"2019-12-05T03:49:54.605788+0000","last_became_peered":"2019-12-05T03:49:54.605788+0000","last_unstale":"2019-12-05T03:50:00.982418+0000","last_undegraded":"2019-12-05T03:50:00.982418+0000","last_fullsized":"2019-12-05T03:50:00.982418+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:53.583773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:53.583773+0000","last_clean_scrub_stamp":"2019-12-05T03:49:53.583773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:00.947367+0000","last_change":"2019-12-05T03:49:57.757038+0000","last_active":"2019-12-05T03:50:00.947367+0000","last_peered":"2019-12-05T03:50:00.947367+0000","last_clean":"2019-12-05T03:50:00.947367+0000","last_became_active":"2019-12-05T03:49:57.756257+0000","last_became_peered":"2019-12-05T03:49:57.756257+0000","last_unstale":"2019-12-05T03:50:00.947367+0000","last_undegraded":"2019-12-05T03:50:00.947367+0000","last_fullsized":"2019-12-05T03:50:00.947367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:56.617239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:56.617239+0000","last_clean_scrub_stamp":"2019-12-05T03:49:56.617239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":89359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.964}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.914}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.717}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.786}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.147}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.176}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.066}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":89359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.877}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.171}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.946}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.769}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.727}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.049}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":89359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.442}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.694}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.192}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.121}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.771}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.017}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.070}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":89359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.514}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.697}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.663}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.874}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.735}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.854}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.094}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":89359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.521}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.703}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.965}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.822}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.652}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.892}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.104}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":89359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.644}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.571}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.780}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.963}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.016}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.917}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.300}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":89359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.545}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.216}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.902}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.029}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.972}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.439}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.375}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":89359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.333}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.566}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.864}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.909}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.125}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.092}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.515}]}]}]}} 2019-12-05T03:50:11.162 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2019-12-05T03:50:11.264 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.255+0000 7efffc9c9700 1 Processor -- start 2019-12-05T03:50:11.264 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.255+0000 7efffc9c9700 1 -- start start 2019-12-05T03:50:11.264 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.255+0000 7efffc9c9700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7efff809cf60 0x7efff809a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:11.264 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.255+0000 7efffc9c9700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efff805a740 0x7efff8151460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:11.265 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.255+0000 7efffc9c9700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efff80accb0 con 0x7efff81519b0 2019-12-05T03:50:11.265 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.255+0000 7efffc9c9700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efff80b1730 con 0x7efff809cf60 2019-12-05T03:50:11.265 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.255+0000 7efffc9c9700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff80b19d0 con 0x7efff805a740 2019-12-05T03:50:11.265 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.255+0000 7effeffff700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efff805a740 0x7efff8151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:11.265 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.255+0000 7effeffff700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efff805a740 0x7efff8151460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.158:36572/0 (socket says 172.21.15.158:36572) 2019-12-05T03:50:11.265 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.255+0000 7effeffff700 1 -- 172.21.15.158:0/1743804655 learned_addr learned my addr 172.21.15.158:0/1743804655 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:11.265 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.255+0000 7efff759e700 1 --1- 172.21.15.158:0/1743804655 >> v1:172.21.15.96:6789/0 conn(0x7efff81519b0 0x7efff80b52e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.158:43746/0 (socket says 172.21.15.158:43746) 2019-12-05T03:50:11.266 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.255+0000 7efff6d9d700 1 --2- 172.21.15.158:0/1743804655 >> v2:172.21.15.96:3300/0 conn(0x7efff809cf60 0x7efff809a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:11.266 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.255+0000 7effeffff700 1 -- 172.21.15.158:0/1743804655 >> v2:172.21.15.96:3300/0 conn(0x7efff809cf60 msgr2=0x7efff809a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:11.266 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.255+0000 7effeffff700 1 --2- 172.21.15.158:0/1743804655 >> v2:172.21.15.96:3300/0 conn(0x7efff809cf60 0x7efff809a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:11.266 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.255+0000 7effeffff700 1 -- 172.21.15.158:0/1743804655 >> v1:172.21.15.96:6789/0 conn(0x7efff81519b0 legacy=0x7efff80b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:11.266 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.255+0000 7effeffff700 1 -- 172.21.15.158:0/1743804655 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff805ab70 con 0x7efff805a740 2019-12-05T03:50:11.266 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.255+0000 7effeffff700 1 --2- 172.21.15.158:0/1743804655 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efff805a740 0x7efff8151460 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7effe0008790 tx=0x7effe000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.266 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.255+0000 7effeffff700 1 --2- 172.21.15.158:0/1743804655 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efff805a740 0x7efff8151460 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7effe0008790 tx=0x7effe000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.267 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.259+0000 7effeffff700 1 --2- 172.21.15.158:0/1743804655 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efff805a740 0x7efff8151460 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7effe0008790 tx=0x7effe000fd30).ready entity=mon.2 client_cookie=d74fc9b2914a1271 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:11.267 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.259+0000 7effeffff700 1 --2- 172.21.15.158:0/1743804655 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efff805a740 0x7efff8151460 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7effe0008790 tx=0x7effe000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.267 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.259+0000 7efff659c700 1 -- 172.21.15.158:0/1743804655 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effe00113b0 con 0x7efff805a740 2019-12-05T03:50:11.267 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.259+0000 7effeffff700 1 --2- 172.21.15.158:0/1743804655 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efff805a740 0x7efff8151460 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7effe0008790 tx=0x7effe000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.267 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.259+0000 7efff659c700 1 -- 172.21.15.158:0/1743804655 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe0008bb0 con 0x7efff805a740 2019-12-05T03:50:11.267 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.259+0000 7effeffff700 1 --2- 172.21.15.158:0/1743804655 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efff805a740 0x7efff8151460 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7effe0008790 tx=0x7effe000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.267 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.259+0000 7efff659c700 1 -- 172.21.15.158:0/1743804655 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effe0011990 con 0x7efff805a740 2019-12-05T03:50:11.268 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.259+0000 7efffc9c9700 1 -- 172.21.15.158:0/1743804655 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efff805a740 msgr2=0x7efff8151460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:11.268 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.259+0000 7efffc9c9700 1 --2- 172.21.15.158:0/1743804655 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efff805a740 0x7efff8151460 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7effe0008790 tx=0x7effe000fd30).stop 2019-12-05T03:50:11.268 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.259+0000 7efffc9c9700 1 -- 172.21.15.158:0/1743804655 shutdown_connections 2019-12-05T03:50:11.268 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.259+0000 7efffc9c9700 1 --2- 172.21.15.158:0/1743804655 >> v2:172.21.15.96:3300/0 conn(0x7efff809cf60 0x7efff809a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:11.268 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.259+0000 7efffc9c9700 1 --2- 172.21.15.158:0/1743804655 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efff805a740 0x7efff8151460 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:11.268 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.259+0000 7efffc9c9700 1 -- 172.21.15.158:0/1743804655 shutdown_connections 2019-12-05T03:50:11.268 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.259+0000 7efffc9c9700 1 -- 172.21.15.158:0/1743804655 wait complete. 2019-12-05T03:50:11.269 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.259+0000 7efffc9c9700 1 -- 172.21.15.158:0/1743804655 >> 172.21.15.158:0/1743804655 conn(0x7efff80b7e60 msgr2=0x7efff80b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:11.269 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.263+0000 7efffc9c9700 1 Processor -- start 2019-12-05T03:50:11.269 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.263+0000 7efffc9c9700 1 -- start start 2019-12-05T03:50:11.275 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.263+0000 7efffc9c9700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7efff813ff80 0x7efff813ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:11.276 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.263+0000 7efffc9c9700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efff813cf90 con 0x7efff8151230 2019-12-05T03:50:11.276 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.263+0000 7efffc9c9700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efff8151660 con 0x7efff809a690 2019-12-05T03:50:11.276 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.263+0000 7efffc9c9700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efff8152400 con 0x7efff813ff80 2019-12-05T03:50:11.276 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.263+0000 7efff6d9d700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7efff809a690 0x7efff8151c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48614/0 (socket says 172.21.15.158:48614) 2019-12-05T03:50:11.276 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.263+0000 7efff6d9d700 1 -- 172.21.15.158:0/3453152102 learned_addr learned my addr 172.21.15.158:0/3453152102 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:11.276 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.263+0000 7efff759e700 1 --2- 172.21.15.158:0/3453152102 >> v2:172.21.15.96:3300/0 conn(0x7efff813ff80 0x7efff813ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:11.277 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.263+0000 7effef7fe700 1 -- 172.21.15.158:0/3453152102 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2086274379 0 0) 0x7efff8151660 con 0x7efff809a690 2019-12-05T03:50:11.277 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.263+0000 7effef7fe700 1 -- 172.21.15.158:0/3453152102 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effdc0030b0 con 0x7efff809a690 2019-12-05T03:50:11.277 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.267+0000 7efff759e700 1 -- 172.21.15.158:0/3453152102 >> v1:172.21.15.158:6789/0 conn(0x7efff809a690 legacy=0x7efff8151c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:11.277 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.267+0000 7effef7fe700 1 -- 172.21.15.158:0/3453152102 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3954354243 0 0) 0x7efff813cf90 con 0x7efff8151230 2019-12-05T03:50:11.277 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.267+0000 7efff759e700 1 -- 172.21.15.158:0/3453152102 >> v1:172.21.15.96:6789/0 conn(0x7efff8151230 legacy=0x7efff813c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:11.277 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.267+0000 7efff759e700 1 -- 172.21.15.158:0/3453152102 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff81403b0 con 0x7efff813ff80 2019-12-05T03:50:11.277 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.267+0000 7efff759e700 1 --2- 172.21.15.158:0/3453152102 >> v2:172.21.15.96:3300/0 conn(0x7efff813ff80 0x7efff813ca40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efff0001210 tx=0x7efff0010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.278 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.267+0000 7efff759e700 1 --2- 172.21.15.158:0/3453152102 >> v2:172.21.15.96:3300/0 conn(0x7efff813ff80 0x7efff813ca40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efff0001210 tx=0x7efff0010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.278 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.267+0000 7efff759e700 1 --2- 172.21.15.158:0/3453152102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efff813ff80 0x7efff813ca40 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7efff0001210 tx=0x7efff0010ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:11.278 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.267+0000 7efff759e700 1 --2- 172.21.15.158:0/3453152102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efff813ff80 0x7efff813ca40 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7efff0001210 tx=0x7efff0010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.278 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.267+0000 7effef7fe700 1 -- 172.21.15.158:0/3453152102 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efff0004ad0 con 0x7efff813ff80 2019-12-05T03:50:11.278 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.267+0000 7efff759e700 1 --2- 172.21.15.158:0/3453152102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efff813ff80 0x7efff813ca40 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7efff0001210 tx=0x7efff0010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.278 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.267+0000 7efffc9c9700 1 -- 172.21.15.158:0/3453152102 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efff807d230 con 0x7efff813ff80 2019-12-05T03:50:11.278 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.267+0000 7effef7fe700 1 -- 172.21.15.158:0/3453152102 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff00046f0 con 0x7efff813ff80 2019-12-05T03:50:11.279 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.267+0000 7efff759e700 1 --2- 172.21.15.158:0/3453152102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efff813ff80 0x7efff813ca40 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7efff0001210 tx=0x7efff0010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.279 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.267+0000 7effef7fe700 1 -- 172.21.15.158:0/3453152102 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efff0012770 con 0x7efff813ff80 2019-12-05T03:50:11.279 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.267+0000 7efffc9c9700 1 -- 172.21.15.158:0/3453152102 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efff807d730 con 0x7efff813ff80 2019-12-05T03:50:11.279 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.267+0000 7efff759e700 1 --2- 172.21.15.158:0/3453152102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efff813ff80 0x7efff813ca40 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7efff0001210 tx=0x7efff0010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.279 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.267+0000 7effef7fe700 1 -- 172.21.15.158:0/3453152102 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7efff0012a90 con 0x7efff813ff80 2019-12-05T03:50:11.279 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.267+0000 7efff759e700 1 --2- 172.21.15.158:0/3453152102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efff813ff80 0x7efff813ca40 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7efff0001210 tx=0x7efff0010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.279 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.271+0000 7effef7fe700 1 --2- 172.21.15.158:0/3453152102 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7effdc03b1c0 0x7effdc03d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:11.280 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.271+0000 7effef7fe700 1 -- 172.21.15.158:0/3453152102 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7efff004b110 con 0x7efff813ff80 2019-12-05T03:50:11.280 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.271+0000 7efff6d9d700 1 --2- 172.21.15.158:0/3453152102 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7effdc03b1c0 0x7effdc03d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:11.280 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.271+0000 7efffc9c9700 1 -- 172.21.15.158:0/3453152102 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efff80554e0 con 0x7efff813ff80 2019-12-05T03:50:11.280 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.271+0000 7efff6d9d700 1 --2- 172.21.15.158:0/3453152102 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7effdc03b1c0 0x7effdc03d6d0 crc :-1 s=READY pgs=82 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:11.282 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.279+0000 7efff759e700 1 --2- 172.21.15.158:0/3453152102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efff813ff80 0x7efff813ca40 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7efff0001210 tx=0x7efff0010ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.282 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.279+0000 7effef7fe700 1 -- 172.21.15.158:0/3453152102 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7efff0012da0 con 0x7efff813ff80 2019-12-05T03:50:11.454 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.451+0000 7efffc9c9700 1 -- 172.21.15.158:0/3453152102 --> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efff8066940 con 0x7effdc03b1c0 2019-12-05T03:50:11.465 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.459+0000 7effef7fe700 1 -- 172.21.15.158:0/3453152102 <== mgr.4105 v2:172.21.15.96:6800/12043 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+80367 (crc 0 0 0) 0x7efff8066940 con 0x7effdc03b1c0 2019-12-05T03:50:11.465 INFO:teuthology.orchestra.run.smithi158.stderr:dumped all 2019-12-05T03:50:11.465 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.463+0000 7efffc9c9700 1 -- 172.21.15.158:0/3453152102 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7effdc03b1c0 msgr2=0x7effdc03d6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:11.466 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.463+0000 7efffc9c9700 1 --2- 172.21.15.158:0/3453152102 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7effdc03b1c0 0x7effdc03d6d0 crc :-1 s=READY pgs=82 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:11.466 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.463+0000 7efffc9c9700 1 -- 172.21.15.158:0/3453152102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efff813ff80 msgr2=0x7efff813ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:11.466 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.463+0000 7efffc9c9700 1 --2- 172.21.15.158:0/3453152102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efff813ff80 0x7efff813ca40 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7efff0001210 tx=0x7efff0010ad0).stop 2019-12-05T03:50:11.466 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.463+0000 7efffc9c9700 1 -- 172.21.15.158:0/3453152102 shutdown_connections 2019-12-05T03:50:11.467 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.463+0000 7efffc9c9700 1 --2- 172.21.15.158:0/3453152102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efff813ff80 0x7efff813ca40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:11.467 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.463+0000 7efffc9c9700 1 --2- 172.21.15.158:0/3453152102 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7effdc03b1c0 0x7effdc03d6d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:11.467 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.463+0000 7efffc9c9700 1 -- 172.21.15.158:0/3453152102 shutdown_connections 2019-12-05T03:50:11.467 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.463+0000 7efffc9c9700 1 -- 172.21.15.158:0/3453152102 wait complete. 2019-12-05T03:50:11.468 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.463+0000 7efffc9c9700 1 -- 172.21.15.158:0/3453152102 >> 172.21.15.158:0/3453152102 conn(0x7efff805a740 msgr2=0x7efff80593f0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:11.468 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:11.477 INFO:teuthology.orchestra.run.smithi158.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2019-12-05T03:50:09.478124+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390560,"kb_used_data":1888,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584160,"statfs":{"total":773094113280,"available":764502179840,"internally_reserved":8589934592,"allocated":1933312,"data_stored":714872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"3.7","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:01.113231+0000","last_change":"2019-12-05T03:50:01.112050+0000","last_active":"2019-12-05T03:50:01.113231+0000","last_peered":"2019-12-05T03:50:01.113231+0000","last_clean":"2019-12-05T03:50:01.113231+0000","last_became_active":"2019-12-05T03:50:01.110666+0000","last_became_peered":"2019-12-05T03:50:01.110666+0000","last_unstale":"2019-12-05T03:50:01.113231+0000","last_undegraded":"2019-12-05T03:50:01.113231+0000","last_fullsized":"2019-12-05T03:50:01.113231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:59.635454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:59.635454+0000","last_clean_scrub_stamp":"2019-12-05T03:49:59.635454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:00.943043+0000","last_change":"2019-12-05T03:49:54.605466+0000","last_active":"2019-12-05T03:50:00.943043+0000","last_peered":"2019-12-05T03:50:00.943043+0000","last_clean":"2019-12-05T03:50:00.943043+0000","last_became_active":"2019-12-05T03:49:54.605086+0000","last_became_peered":"2019-12-05T03:49:54.605086+0000","last_unstale":"2019-12-05T03:50:00.943043+0000","last_undegraded":"2019-12-05T03:50:00.943043+0000","last_fullsized":"2019-12-05T03:50:00.943043+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:53.583773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:53.583773+0000","last_clean_scrub_stamp":"2019-12-05T03:49:53.583773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:00.945453+0000","last_change":"2019-12-05T03:49:57.643880+0000","last_active":"2019-12-05T03:50:00.945453+0000","last_peered":"2019-12-05T03:50:00.945453+0000","last_clean":"2019-12-05T03:50:00.945453+0000","last_became_active":"2019-12-05T03:49:57.643380+0000","last_became_peered":"2019-12-05T03:49:57.643380+0000","last_unstale":"2019-12-05T03:50:00.945453+0000","last_undegraded":"2019-12-05T03:50:00.945453+0000","last_fullsized":"2019-12-05T03:50:00.945453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:56.617239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:56.617239+0000","last_clean_scrub_stamp":"2019-12-05T03:49:56.617239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:01.113165+0000","last_change":"2019-12-05T03:50:01.112246+0000","last_active":"2019-12-05T03:50:01.113165+0000","last_peered":"2019-12-05T03:50:01.113165+0000","last_clean":"2019-12-05T03:50:01.113165+0000","last_became_active":"2019-12-05T03:50:01.110948+0000","last_became_peered":"2019-12-05T03:50:01.110948+0000","last_unstale":"2019-12-05T03:50:01.113165+0000","last_undegraded":"2019-12-05T03:50:01.113165+0000","last_fullsized":"2019-12-05T03:50:01.113165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:59.635454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:59.635454+0000","last_clean_scrub_stamp":"2019-12-05T03:49:59.635454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"15","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:01.109422+0000","last_change":"2019-12-05T03:49:54.608763+0000","last_active":"2019-12-05T03:50:01.109422+0000","last_peered":"2019-12-05T03:50:01.109422+0000","last_clean":"2019-12-05T03:50:01.109422+0000","last_became_active":"2019-12-05T03:49:54.608314+0000","last_became_peered":"2019-12-05T03:49:54.608314+0000","last_unstale":"2019-12-05T03:50:01.109422+0000","last_undegraded":"2019-12-05T03:50:01.109422+0000","last_fullsized":"2019-12-05T03:50:01.109422+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:53.583773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:53.583773+0000","last_clean_scrub_stamp":"2019-12-05T03:49:53.583773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:00.942761+0000","last_change":"2019-12-05T03:49:57.639944+0000","last_active":"2019-12-05T03:50:00.942761+0000","last_peered":"2019-12-05T03:50:00.942761+0000","last_clean":"2019-12-05T03:50:00.942761+0000","last_became_active":"2019-12-05T03:49:57.639237+0000","last_became_peered":"2019-12-05T03:49:57.639237+0000","last_unstale":"2019-12-05T03:50:00.942761+0000","last_undegraded":"2019-12-05T03:50:00.942761+0000","last_fullsized":"2019-12-05T03:50:00.942761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:56.617239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:56.617239+0000","last_clean_scrub_stamp":"2019-12-05T03:49:56.617239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:00.953102+0000","last_change":"2019-12-05T03:50:00.952574+0000","last_active":"2019-12-05T03:50:00.953102+0000","last_peered":"2019-12-05T03:50:00.953102+0000","last_clean":"2019-12-05T03:50:00.953102+0000","last_became_active":"2019-12-05T03:50:00.952144+0000","last_became_peered":"2019-12-05T03:50:00.952144+0000","last_unstale":"2019-12-05T03:50:00.953102+0000","last_undegraded":"2019-12-05T03:50:00.953102+0000","last_fullsized":"2019-12-05T03:50:00.953102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:59.635454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:59.635454+0000","last_clean_scrub_stamp":"2019-12-05T03:49:59.635454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:00.943909+0000","last_change":"2019-12-05T03:49:54.605022+0000","last_active":"2019-12-05T03:50:00.943909+0000","last_peered":"2019-12-05T03:50:00.943909+0000","last_clean":"2019-12-05T03:50:00.943909+0000","last_became_active":"2019-12-05T03:49:54.604659+0000","last_became_peered":"2019-12-05T03:49:54.604659+0000","last_unstale":"2019-12-05T03:50:00.943909+0000","last_undegraded":"2019-12-05T03:50:00.943909+0000","last_fullsized":"2019-12-05T03:50:00.943909+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:53.583773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:53.583773+0000","last_clean_scrub_stamp":"2019-12-05T03:49:53.583773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:00.942681+0000","last_change":"2019-12-05T03:49:57.645998+0000","last_active":"2019-12-05T03:50:00.942681+0000","last_peered":"2019-12-05T03:50:00.942681+0000","last_clean":"2019-12-05T03:50:00.942681+0000","last_became_active":"2019-12-05T03:49:57.645617+0000","last_became_peered":"2019-12-05T03:49:57.645617+0000","last_unstale":"2019-12-05T03:50:00.942681+0000","last_undegraded":"2019-12-05T03:50:00.942681+0000","last_fullsized":"2019-12-05T03:50:00.942681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:56.617239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:56.617239+0000","last_clean_scrub_stamp":"2019-12-05T03:49:56.617239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:01.116950+0000","last_change":"2019-12-05T03:50:01.112651+0000","last_active":"2019-12-05T03:50:01.116950+0000","last_peered":"2019-12-05T03:50:01.116950+0000","last_clean":"2019-12-05T03:50:01.116950+0000","last_became_active":"2019-12-05T03:50:01.111403+0000","last_became_peered":"2019-12-05T03:50:01.111403+0000","last_unstale":"2019-12-05T03:50:01.116950+0000","last_undegraded":"2019-12-05T03:50:01.116950+0000","last_fullsized":"2019-12-05T03:50:01.116950+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:59.635454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:59.635454+0000","last_clean_scrub_stamp":"2019-12-05T03:49:59.635454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:00.946366+0000","last_change":"2019-12-05T03:49:54.605485+0000","last_active":"2019-12-05T03:50:00.946366+0000","last_peered":"2019-12-05T03:50:00.946366+0000","last_clean":"2019-12-05T03:50:00.946366+0000","last_became_active":"2019-12-05T03:49:54.605133+0000","last_became_peered":"2019-12-05T03:49:54.605133+0000","last_unstale":"2019-12-05T03:50:00.946366+0000","last_undegraded":"2019-12-05T03:50:00.946366+0000","last_fullsized":"2019-12-05T03:50:00.946366+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:53.583773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:53.583773+0000","last_clean_scrub_stamp":"2019-12-05T03:49:53.583773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:01.109176+0000","last_change":"2019-12-05T03:49:57.650575+0000","last_active":"2019-12-05T03:50:01.109176+0000","last_peered":"2019-12-05T03:50:01.109176+0000","last_clean":"2019-12-05T03:50:01.109176+0000","last_became_active":"2019-12-05T03:49:57.650156+0000","last_became_peered":"2019-12-05T03:49:57.650156+0000","last_unstale":"2019-12-05T03:50:01.109176+0000","last_undegraded":"2019-12-05T03:50:01.109176+0000","last_fullsized":"2019-12-05T03:50:01.109176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:56.617239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:56.617239+0000","last_clean_scrub_stamp":"2019-12-05T03:49:56.617239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:00.987064+0000","last_change":"2019-12-05T03:50:00.986657+0000","last_active":"2019-12-05T03:50:00.987064+0000","last_peered":"2019-12-05T03:50:00.987064+0000","last_clean":"2019-12-05T03:50:00.987064+0000","last_became_active":"2019-12-05T03:50:00.986005+0000","last_became_peered":"2019-12-05T03:50:00.986005+0000","last_unstale":"2019-12-05T03:50:00.987064+0000","last_undegraded":"2019-12-05T03:50:00.987064+0000","last_fullsized":"2019-12-05T03:50:00.987064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:59.635454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:59.635454+0000","last_clean_scrub_stamp":"2019-12-05T03:49:59.635454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"15","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:00.982265+0000","last_change":"2019-12-05T03:49:54.605679+0000","last_active":"2019-12-05T03:50:00.982265+0000","last_peered":"2019-12-05T03:50:00.982265+0000","last_clean":"2019-12-05T03:50:00.982265+0000","last_became_active":"2019-12-05T03:49:54.605284+0000","last_became_peered":"2019-12-05T03:49:54.605284+0000","last_unstale":"2019-12-05T03:50:00.982265+0000","last_undegraded":"2019-12-05T03:50:00.982265+0000","last_fullsized":"2019-12-05T03:50:00.982265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:53.583773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:53.583773+0000","last_clean_scrub_stamp":"2019-12-05T03:49:53.583773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:00.942934+0000","last_change":"2019-12-05T03:49:57.755395+0000","last_active":"2019-12-05T03:50:00.942934+0000","last_peered":"2019-12-05T03:50:00.942934+0000","last_clean":"2019-12-05T03:50:00.942934+0000","last_became_active":"2019-12-05T03:49:57.755029+0000","last_became_peered":"2019-12-05T03:49:57.755029+0000","last_unstale":"2019-12-05T03:50:00.942934+0000","last_undegraded":"2019-12-05T03:50:00.942934+0000","last_fullsized":"2019-12-05T03:50:00.942934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:56.617239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:56.617239+0000","last_clean_scrub_stamp":"2019-12-05T03:49:56.617239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:01.109689+0000","last_change":"2019-12-05T03:50:01.109262+0000","last_active":"2019-12-05T03:50:01.109689+0000","last_peered":"2019-12-05T03:50:01.109689+0000","last_clean":"2019-12-05T03:50:01.109689+0000","last_became_active":"2019-12-05T03:50:01.108416+0000","last_became_peered":"2019-12-05T03:50:01.108416+0000","last_unstale":"2019-12-05T03:50:01.109689+0000","last_undegraded":"2019-12-05T03:50:01.109689+0000","last_fullsized":"2019-12-05T03:50:01.109689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:59.635454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:59.635454+0000","last_clean_scrub_stamp":"2019-12-05T03:49:59.635454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"15","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:00.942668+0000","last_change":"2019-12-05T03:49:54.606720+0000","last_active":"2019-12-05T03:50:00.942668+0000","last_peered":"2019-12-05T03:50:00.942668+0000","last_clean":"2019-12-05T03:50:00.942668+0000","last_became_active":"2019-12-05T03:49:54.606363+0000","last_became_peered":"2019-12-05T03:49:54.606363+0000","last_unstale":"2019-12-05T03:50:00.942668+0000","last_undegraded":"2019-12-05T03:50:00.942668+0000","last_fullsized":"2019-12-05T03:50:00.942668+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:53.583773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:53.583773+0000","last_clean_scrub_stamp":"2019-12-05T03:49:53.583773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:00.942815+0000","last_change":"2019-12-05T03:49:57.754454+0000","last_active":"2019-12-05T03:50:00.942815+0000","last_peered":"2019-12-05T03:50:00.942815+0000","last_clean":"2019-12-05T03:50:00.942815+0000","last_became_active":"2019-12-05T03:49:57.753760+0000","last_became_peered":"2019-12-05T03:49:57.753760+0000","last_unstale":"2019-12-05T03:50:00.942815+0000","last_undegraded":"2019-12-05T03:50:00.942815+0000","last_fullsized":"2019-12-05T03:50:00.942815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:56.617239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:56.617239+0000","last_clean_scrub_stamp":"2019-12-05T03:49:56.617239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:00.953206+0000","last_change":"2019-12-05T03:50:00.952616+0000","last_active":"2019-12-05T03:50:00.953206+0000","last_peered":"2019-12-05T03:50:00.953206+0000","last_clean":"2019-12-05T03:50:00.953206+0000","last_became_active":"2019-12-05T03:50:00.952039+0000","last_became_peered":"2019-12-05T03:50:00.952039+0000","last_unstale":"2019-12-05T03:50:00.953206+0000","last_undegraded":"2019-12-05T03:50:00.953206+0000","last_fullsized":"2019-12-05T03:50:00.953206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:59.635454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:59.635454+0000","last_clean_scrub_stamp":"2019-12-05T03:49:59.635454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"15","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:00.943034+0000","last_change":"2019-12-05T03:49:54.606549+0000","last_active":"2019-12-05T03:50:00.943034+0000","last_peered":"2019-12-05T03:50:00.943034+0000","last_clean":"2019-12-05T03:50:00.943034+0000","last_became_active":"2019-12-05T03:49:54.606141+0000","last_became_peered":"2019-12-05T03:49:54.606141+0000","last_unstale":"2019-12-05T03:50:00.943034+0000","last_undegraded":"2019-12-05T03:50:00.943034+0000","last_fullsized":"2019-12-05T03:50:00.943034+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:53.583773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:53.583773+0000","last_clean_scrub_stamp":"2019-12-05T03:49:53.583773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:00.942893+0000","last_change":"2019-12-05T03:49:57.643050+0000","last_active":"2019-12-05T03:50:00.942893+0000","last_peered":"2019-12-05T03:50:00.942893+0000","last_clean":"2019-12-05T03:50:00.942893+0000","last_became_active":"2019-12-05T03:49:57.642755+0000","last_became_peered":"2019-12-05T03:49:57.642755+0000","last_unstale":"2019-12-05T03:50:00.942893+0000","last_undegraded":"2019-12-05T03:50:00.942893+0000","last_fullsized":"2019-12-05T03:50:00.942893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:56.617239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:56.617239+0000","last_clean_scrub_stamp":"2019-12-05T03:49:56.617239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:00.950044+0000","last_change":"2019-12-05T03:50:00.949570+0000","last_active":"2019-12-05T03:50:00.950044+0000","last_peered":"2019-12-05T03:50:00.950044+0000","last_clean":"2019-12-05T03:50:00.950044+0000","last_became_active":"2019-12-05T03:50:00.949099+0000","last_became_peered":"2019-12-05T03:50:00.949099+0000","last_unstale":"2019-12-05T03:50:00.950044+0000","last_undegraded":"2019-12-05T03:50:00.950044+0000","last_fullsized":"2019-12-05T03:50:00.950044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:59.635454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:59.635454+0000","last_clean_scrub_stamp":"2019-12-05T03:49:59.635454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"15","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:00.982418+0000","last_change":"2019-12-05T03:49:54.606167+0000","last_active":"2019-12-05T03:50:00.982418+0000","last_peered":"2019-12-05T03:50:00.982418+0000","last_clean":"2019-12-05T03:50:00.982418+0000","last_became_active":"2019-12-05T03:49:54.605788+0000","last_became_peered":"2019-12-05T03:49:54.605788+0000","last_unstale":"2019-12-05T03:50:00.982418+0000","last_undegraded":"2019-12-05T03:50:00.982418+0000","last_fullsized":"2019-12-05T03:50:00.982418+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:53.583773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:53.583773+0000","last_clean_scrub_stamp":"2019-12-05T03:49:53.583773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-05T03:50:00.947367+0000","last_change":"2019-12-05T03:49:57.757038+0000","last_active":"2019-12-05T03:50:00.947367+0000","last_peered":"2019-12-05T03:50:00.947367+0000","last_clean":"2019-12-05T03:50:00.947367+0000","last_became_active":"2019-12-05T03:49:57.756257+0000","last_became_peered":"2019-12-05T03:49:57.756257+0000","last_unstale":"2019-12-05T03:50:00.947367+0000","last_undegraded":"2019-12-05T03:50:00.947367+0000","last_fullsized":"2019-12-05T03:50:00.947367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-05T03:49:56.617239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-05T03:49:56.617239+0000","last_clean_scrub_stamp":"2019-12-05T03:49:56.617239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":89359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.964}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.914}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.717}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.786}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.147}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.176}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.066}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":89359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.877}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.171}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.946}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.769}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.727}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.049}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":89359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.442}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.694}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.192}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.121}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.771}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.017}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.070}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":89359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.514}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.697}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.663}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.874}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.735}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.854}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.094}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":89359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.521}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.703}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.965}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.822}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.652}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.892}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.104}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":89359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.644}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.571}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.780}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.963}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.016}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.917}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.300}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":89359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.545}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.216}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.902}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.029}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.972}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.439}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.375}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":89359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.333}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.566}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.864}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.909}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.125}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.092}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":1.515}]}]}]}} 2019-12-05T03:50:11.485 INFO:tasks.ceph.ceph_manager.ceph:clean! 2019-12-05T03:50:11.485 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2019-12-05T03:50:11.486 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2019-12-05T03:50:11.486 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2019-12-05T03:50:11.603 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.583+0000 7fb9f3506700 1 Processor -- start 2019-12-05T03:50:11.604 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.583+0000 7fb9f3506700 1 -- start start 2019-12-05T03:50:11.604 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.583+0000 7fb9f3506700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb9ec05a740 0x7fb9ec155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:11.604 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.583+0000 7fb9f3506700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9ec0accb0 con 0x7fb9ec09a320 2019-12-05T03:50:11.605 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.583+0000 7fb9f3506700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9ec156100 con 0x7fb9ec09cf60 2019-12-05T03:50:11.605 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.583+0000 7fb9f3506700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ec09a750 con 0x7fb9ec05a740 2019-12-05T03:50:11.605 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.583+0000 7fb9f1aa3700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fb9ec09cf60 0x7fb9ec151460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48622/0 (socket says 172.21.15.158:48622) 2019-12-05T03:50:11.605 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.583+0000 7fb9f1aa3700 1 -- 172.21.15.158:0/505805294 learned_addr learned my addr 172.21.15.158:0/505805294 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:11.606 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.583+0000 7fb9f22a4700 1 --2- 172.21.15.158:0/505805294 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb9ec05a740 0x7fb9ec155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:11.606 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.583+0000 7fb9f0aa1700 1 -- 172.21.15.158:0/505805294 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2374826485 0 0) 0x7fb9ec156100 con 0x7fb9ec09cf60 2019-12-05T03:50:11.606 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.583+0000 7fb9f0aa1700 1 -- 172.21.15.158:0/505805294 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9d80030b0 con 0x7fb9ec09cf60 2019-12-05T03:50:11.606 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.583+0000 7fb9f0aa1700 1 -- 172.21.15.158:0/505805294 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1509330705 0 0) 0x7fb9ec0accb0 con 0x7fb9ec09a320 2019-12-05T03:50:11.607 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.583+0000 7fb9f0aa1700 1 -- 172.21.15.158:0/505805294 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9ec156100 con 0x7fb9ec09a320 2019-12-05T03:50:11.607 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.583+0000 7fb9f0aa1700 1 -- 172.21.15.158:0/505805294 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2341784887 0 0) 0x7fb9d80030b0 con 0x7fb9ec09cf60 2019-12-05T03:50:11.607 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.583+0000 7fb9f0aa1700 1 -- 172.21.15.158:0/505805294 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb9ec05a740 msgr2=0x7fb9ec155bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:11.607 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.583+0000 7fb9f0aa1700 1 --2- 172.21.15.158:0/505805294 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb9ec05a740 0x7fb9ec155bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:11.607 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.583+0000 7fb9f0aa1700 1 -- 172.21.15.158:0/505805294 >> v1:172.21.15.96:6789/0 conn(0x7fb9ec09a320 legacy=0x7fb9ec1553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:11.608 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.583+0000 7fb9f0aa1700 1 -- 172.21.15.158:0/505805294 --> v1:172.21.15.158:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ec05ab70 con 0x7fb9ec09cf60 2019-12-05T03:50:11.608 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.583+0000 7fb9f0aa1700 1 -- 172.21.15.158:0/505805294 <== mon.1 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 828730332 0 0) 0x7fb9d4001750 con 0x7fb9ec09cf60 2019-12-05T03:50:11.609 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.583+0000 7fb9f0aa1700 1 -- 172.21.15.158:0/505805294 >> v1:172.21.15.158:6789/0 conn(0x7fb9ec09cf60 legacy=0x7fb9ec151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:11.609 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.583+0000 7fb9f0aa1700 1 --2- 172.21.15.158:0/505805294 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9d8003940 0x7fb9d8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:11.609 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.583+0000 7fb9f0aa1700 1 --2- 172.21.15.158:0/505805294 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb9d8004420 0x7fb9d80048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:11.609 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.583+0000 7fb9f0aa1700 1 --2- 172.21.15.158:0/505805294 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb9d8004f30 0x7fb9d800b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:11.609 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.583+0000 7fb9f0aa1700 1 -- 172.21.15.158:0/505805294 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ec09a750 con 0x7fb9d8003940 2019-12-05T03:50:11.609 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.583+0000 7fb9f0aa1700 1 -- 172.21.15.158:0/505805294 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d804fbd0 con 0x7fb9d8004420 2019-12-05T03:50:11.610 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.583+0000 7fb9f0aa1700 1 -- 172.21.15.158:0/505805294 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d804fdc0 con 0x7fb9d8004f30 2019-12-05T03:50:11.610 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.583+0000 7fb9f12a2700 1 --2- 172.21.15.158:0/505805294 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb9d8004420 0x7fb9d80048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:11.610 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.587+0000 7fb9f1aa3700 1 --2- 172.21.15.158:0/505805294 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9d8003940 0x7fb9d8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:11.610 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.587+0000 7fb9f22a4700 1 --2- 172.21.15.158:0/505805294 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb9d8004f30 0x7fb9d800b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:11.610 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.587+0000 7fb9f12a2700 1 -- 172.21.15.158:0/505805294 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb9d8004f30 msgr2=0x7fb9d800b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:11.613 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.587+0000 7fb9f12a2700 1 --2- 172.21.15.158:0/505805294 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb9d8004f30 0x7fb9d800b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:11.613 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.587+0000 7fb9f12a2700 1 -- 172.21.15.158:0/505805294 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9d8003940 msgr2=0x7fb9d8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:11.613 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.587+0000 7fb9f12a2700 1 --2- 172.21.15.158:0/505805294 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9d8003940 0x7fb9d8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:11.613 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.587+0000 7fb9f12a2700 1 -- 172.21.15.158:0/505805294 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d80500c0 con 0x7fb9d8004420 2019-12-05T03:50:11.614 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.587+0000 7fb9f22a4700 1 --2- 172.21.15.158:0/505805294 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb9d8004f30 0x7fb9d800b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-12-05T03:50:11.614 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.587+0000 7fb9f12a2700 1 --2- 172.21.15.158:0/505805294 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb9d8004420 0x7fb9d80048d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb9dc001360 tx=0x7fb9dc00c1c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.614 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.587+0000 7fb9f12a2700 1 --2- 172.21.15.158:0/505805294 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb9d8004420 0x7fb9d80048d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb9dc001360 tx=0x7fb9dc00c1c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.614 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.587+0000 7fb9f12a2700 1 --2- 172.21.15.158:0/505805294 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb9d8004420 0x7fb9d80048d0 secure :-1 s=READY pgs=152 cs=0 l=1 rx=0x7fb9dc001360 tx=0x7fb9dc00c1c0).ready entity=mon.1 client_cookie=51655e57e695a787 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:11.615 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.587+0000 7fb9f12a2700 1 --2- 172.21.15.158:0/505805294 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb9d8004420 0x7fb9d80048d0 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7fb9dc001360 tx=0x7fb9dc00c1c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.615 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.587+0000 7fb9f0aa1700 1 -- 172.21.15.158:0/505805294 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9dc00c8f0 con 0x7fb9d8004420 2019-12-05T03:50:11.615 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.587+0000 7fb9f12a2700 1 --2- 172.21.15.158:0/505805294 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb9d8004420 0x7fb9d80048d0 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7fb9dc001360 tx=0x7fb9dc00c1c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.615 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.587+0000 7fb9f12a2700 1 --2- 172.21.15.158:0/505805294 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb9d8004420 0x7fb9d80048d0 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7fb9dc001360 tx=0x7fb9dc00c1c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.616 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.587+0000 7fb9f0aa1700 1 -- 172.21.15.158:0/505805294 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9dc010a90 con 0x7fb9d8004420 2019-12-05T03:50:11.616 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.587+0000 7fb9f0aa1700 1 -- 172.21.15.158:0/505805294 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9dc0110c0 con 0x7fb9d8004420 2019-12-05T03:50:11.616 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.587+0000 7fb9f3506700 1 -- 172.21.15.158:0/505805294 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb9d8004420 msgr2=0x7fb9d80048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:11.616 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.587+0000 7fb9f3506700 1 --2- 172.21.15.158:0/505805294 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb9d8004420 0x7fb9d80048d0 secure :-1 s=READY pgs=152 cs=0 l=1 rx=0x7fb9dc001360 tx=0x7fb9dc00c1c0).stop 2019-12-05T03:50:11.617 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.587+0000 7fb9f22a4700 1 -- 172.21.15.158:0/505805294 reap_dead start 2019-12-05T03:50:11.617 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.587+0000 7fb9f3506700 1 -- 172.21.15.158:0/505805294 shutdown_connections 2019-12-05T03:50:11.617 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.587+0000 7fb9f3506700 1 -- 172.21.15.158:0/505805294 shutdown_connections 2019-12-05T03:50:11.617 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.587+0000 7fb9f3506700 1 -- 172.21.15.158:0/505805294 wait complete. 2019-12-05T03:50:11.618 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.587+0000 7fb9f3506700 1 -- 172.21.15.158:0/505805294 >> 172.21.15.158:0/505805294 conn(0x7fb9ec0b7e60 msgr2=0x7fb9ec0b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:11.618 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.591+0000 7fb9f3506700 1 Processor -- start 2019-12-05T03:50:11.618 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.591+0000 7fb9f3506700 1 -- start start 2019-12-05T03:50:11.619 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.591+0000 7fb9f3506700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb9ec05f850 0x7fb9ec143c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:11.619 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.591+0000 7fb9f3506700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb9ec140500 0x7fb9ec09b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:11.619 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.591+0000 7fb9f3506700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9ec13fcc0 con 0x7fb9ec09ba40 2019-12-05T03:50:11.619 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.591+0000 7fb9f3506700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9ec099760 con 0x7fb9ec140500 2019-12-05T03:50:11.620 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.591+0000 7fb9f3506700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ec13ffc0 con 0x7fb9ec05f850 2019-12-05T03:50:11.620 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.591+0000 7fb9f22a4700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fb9ec09ba40 0x7fb9ec0af140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48638/0 (socket says 172.21.15.158:48638) 2019-12-05T03:50:11.620 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.591+0000 7fb9f22a4700 1 -- 172.21.15.158:0/2830285353 learned_addr learned my addr 172.21.15.158:0/2830285353 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:11.620 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.591+0000 7fb9f1aa3700 1 --2- 172.21.15.158:0/2830285353 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb9ec05f850 0x7fb9ec143c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:11.620 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.591+0000 7fb9f12a2700 1 --2- 172.21.15.158:0/2830285353 >> v2:172.21.15.96:3300/0 conn(0x7fb9ec140500 0x7fb9ec09b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:11.620 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.591+0000 7fb9ea7fc700 1 -- 172.21.15.158:0/2830285353 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 652304437 0 0) 0x7fb9ec13fcc0 con 0x7fb9ec09ba40 2019-12-05T03:50:11.621 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.591+0000 7fb9ea7fc700 1 -- 172.21.15.158:0/2830285353 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9d00030b0 con 0x7fb9ec09ba40 2019-12-05T03:50:11.621 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.595+0000 7fb9f12a2700 1 -- 172.21.15.158:0/2830285353 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb9ec05f850 msgr2=0x7fb9ec143c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:11.621 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.595+0000 7fb9f12a2700 1 --2- 172.21.15.158:0/2830285353 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb9ec05f850 0x7fb9ec143c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:11.621 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.595+0000 7fb9ea7fc700 1 -- 172.21.15.158:0/2830285353 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3399769684 0 0) 0x7fb9d00030b0 con 0x7fb9ec09ba40 2019-12-05T03:50:11.622 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.595+0000 7fb9f12a2700 1 -- 172.21.15.158:0/2830285353 >> v1:172.21.15.158:6789/0 conn(0x7fb9ec09ba40 legacy=0x7fb9ec0af140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:11.622 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.595+0000 7fb9f12a2700 1 -- 172.21.15.158:0/2830285353 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ec0af940 con 0x7fb9ec140500 2019-12-05T03:50:11.622 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.595+0000 7fb9f1aa3700 1 --2- 172.21.15.158:0/2830285353 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb9ec05f850 0x7fb9ec143c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:50:11.622 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.595+0000 7fb9f12a2700 1 --2- 172.21.15.158:0/2830285353 >> v2:172.21.15.96:3300/0 conn(0x7fb9ec140500 0x7fb9ec09b4f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb9e40016d0 tx=0x7fb9dc00bd00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.623 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.595+0000 7fb9f12a2700 1 --2- 172.21.15.158:0/2830285353 >> v2:172.21.15.96:3300/0 conn(0x7fb9ec140500 0x7fb9ec09b4f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb9e40016d0 tx=0x7fb9dc00bd00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.624 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.595+0000 7fb9f12a2700 1 --2- 172.21.15.158:0/2830285353 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9ec140500 0x7fb9ec09b4f0 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7fb9e40016d0 tx=0x7fb9dc00bd00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:11.625 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.595+0000 7fb9f12a2700 1 --2- 172.21.15.158:0/2830285353 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9ec140500 0x7fb9ec09b4f0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fb9e40016d0 tx=0x7fb9dc00bd00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.625 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.595+0000 7fb9ea7fc700 1 -- 172.21.15.158:0/2830285353 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9e4001490 con 0x7fb9ec140500 2019-12-05T03:50:11.625 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.595+0000 7fb9f12a2700 1 --2- 172.21.15.158:0/2830285353 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9ec140500 0x7fb9ec09b4f0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fb9e40016d0 tx=0x7fb9dc00bd00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.625 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.595+0000 7fb9f3506700 1 -- 172.21.15.158:0/2830285353 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9ec0afbd0 con 0x7fb9ec140500 2019-12-05T03:50:11.626 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.595+0000 7fb9ea7fc700 1 -- 172.21.15.158:0/2830285353 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e40012a0 con 0x7fb9ec140500 2019-12-05T03:50:11.626 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.595+0000 7fb9f12a2700 1 --2- 172.21.15.158:0/2830285353 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9ec140500 0x7fb9ec09b4f0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fb9e40016d0 tx=0x7fb9dc00bd00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.626 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.595+0000 7fb9ea7fc700 1 -- 172.21.15.158:0/2830285353 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9dc0113d0 con 0x7fb9ec140500 2019-12-05T03:50:11.626 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.595+0000 7fb9f3506700 1 -- 172.21.15.158:0/2830285353 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9ec140930 con 0x7fb9ec140500 2019-12-05T03:50:11.627 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.595+0000 7fb9f12a2700 1 --2- 172.21.15.158:0/2830285353 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9ec140500 0x7fb9ec09b4f0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fb9e40016d0 tx=0x7fb9dc00bd00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.627 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.595+0000 7fb9f12a2700 1 --2- 172.21.15.158:0/2830285353 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9ec140500 0x7fb9ec09b4f0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fb9e40016d0 tx=0x7fb9dc00bd00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.627 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.595+0000 7fb9ea7fc700 1 -- 172.21.15.158:0/2830285353 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fb9dc0066e0 con 0x7fb9ec140500 2019-12-05T03:50:11.627 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.595+0000 7fb9ea7fc700 1 --2- 172.21.15.158:0/2830285353 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fb9d003b210 0x7fb9d003d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:11.628 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.595+0000 7fb9ea7fc700 1 -- 172.21.15.158:0/2830285353 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fb9dc04aff0 con 0x7fb9ec140500 2019-12-05T03:50:11.628 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.595+0000 7fb9f1aa3700 1 --2- 172.21.15.158:0/2830285353 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fb9d003b210 0x7fb9d003d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:11.628 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.599+0000 7fb9f1aa3700 1 --2- 172.21.15.158:0/2830285353 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fb9d003b210 0x7fb9d003d720 crc :-1 s=READY pgs=83 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:11.628 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.599+0000 7fb9f3506700 1 -- 172.21.15.158:0/2830285353 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9ec0554e0 con 0x7fb9ec140500 2019-12-05T03:50:11.631 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.607+0000 7fb9f12a2700 1 --2- 172.21.15.158:0/2830285353 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9ec140500 0x7fb9ec09b4f0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fb9e40016d0 tx=0x7fb9dc00bd00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.631 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.607+0000 7fb9ea7fc700 1 -- 172.21.15.158:0/2830285353 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fb9dc032e60 con 0x7fb9ec140500 2019-12-05T03:50:11.766 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.763+0000 7fb9f3506700 1 -- 172.21.15.158:0/2830285353 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb9ec066940 con 0x7fb9ec140500 2019-12-05T03:50:11.767 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.767+0000 7fb9f12a2700 1 --2- 172.21.15.158:0/2830285353 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9ec140500 0x7fb9ec09b4f0 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7fb9e40016d0 tx=0x7fb9dc00bd00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.767 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.767+0000 7fb9ea7fc700 1 -- 172.21.15.158:0/2830285353 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7fb9dc0069f0 con 0x7fb9ec140500 2019-12-05T03:50:11.768 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:11.770 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.767+0000 7fb9f3506700 1 -- 172.21.15.158:0/2830285353 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fb9d003b210 msgr2=0x7fb9d003d720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:11.770 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.767+0000 7fb9f3506700 1 --2- 172.21.15.158:0/2830285353 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fb9d003b210 0x7fb9d003d720 crc :-1 s=READY pgs=83 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:11.770 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.767+0000 7fb9f3506700 1 -- 172.21.15.158:0/2830285353 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9ec140500 msgr2=0x7fb9ec09b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:11.771 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.767+0000 7fb9f3506700 1 --2- 172.21.15.158:0/2830285353 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9ec140500 0x7fb9ec09b4f0 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7fb9e40016d0 tx=0x7fb9dc00bd00).stop 2019-12-05T03:50:11.771 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.767+0000 7fb9f3506700 1 -- 172.21.15.158:0/2830285353 shutdown_connections 2019-12-05T03:50:11.771 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.767+0000 7fb9f3506700 1 --2- 172.21.15.158:0/2830285353 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fb9d003b210 0x7fb9d003d720 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:11.771 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.767+0000 7fb9f3506700 1 --2- 172.21.15.158:0/2830285353 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb9ec05f850 0x7fb9ec143c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:11.771 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.767+0000 7fb9f3506700 1 --2- 172.21.15.158:0/2830285353 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9ec140500 0x7fb9ec09b4f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:11.771 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.767+0000 7fb9f3506700 1 -- 172.21.15.158:0/2830285353 shutdown_connections 2019-12-05T03:50:11.771 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.767+0000 7fb9f3506700 1 -- 172.21.15.158:0/2830285353 wait complete. 2019-12-05T03:50:11.772 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.767+0000 7fb9f3506700 1 -- 172.21.15.158:0/2830285353 >> 172.21.15.158:0/2830285353 conn(0x7fb9ec0b48c0 msgr2=0x7fb9ec1327c0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:11.779 INFO:teuthology.orchestra.run.smithi158.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2019-12-05T03:50:11.780 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2019-12-05T03:50:11.780 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-05T03:50:11.878 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.871+0000 7f6b8861c700 1 Processor -- start 2019-12-05T03:50:11.878 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.871+0000 7f6b8861c700 1 -- start start 2019-12-05T03:50:11.878 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.871+0000 7f6b8861c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f6b8009a320 0x7f6b8005a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:11.879 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.871+0000 7f6b8861c700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6b801553b0 0x7f6b801557e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:11.879 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.871+0000 7f6b8861c700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b800accb0 con 0x7f6b8009cf60 2019-12-05T03:50:11.879 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.871+0000 7f6b8861c700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b8009a750 con 0x7f6b801553b0 2019-12-05T03:50:11.879 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.871+0000 7f6b8861c700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b800b1730 con 0x7f6b8009a320 2019-12-05T03:50:11.879 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.871+0000 7f6b863b8700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f6b8009a320 0x7f6b8005a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:11.879 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.871+0000 7f6b863b8700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f6b8009a320 0x7f6b8005a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53864/0 (socket says 172.21.15.158:53864) 2019-12-05T03:50:11.879 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.871+0000 7f6b863b8700 1 -- 172.21.15.158:0/4069383120 learned_addr learned my addr 172.21.15.158:0/4069383120 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:11.880 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.871+0000 7f6b873ba700 1 --2- 172.21.15.158:0/4069383120 >> v2:172.21.15.96:3300/0 conn(0x7f6b801553b0 0x7f6b801557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:11.880 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.875+0000 7f6b863b8700 1 -- 172.21.15.158:0/4069383120 >> v2:172.21.15.96:3300/0 conn(0x7f6b801553b0 msgr2=0x7f6b801557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:11.880 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.875+0000 7f6b863b8700 1 --2- 172.21.15.158:0/4069383120 >> v2:172.21.15.96:3300/0 conn(0x7f6b801553b0 0x7f6b801557e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:11.880 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.875+0000 7f6b863b8700 1 -- 172.21.15.158:0/4069383120 >> v1:172.21.15.96:6789/0 conn(0x7f6b8009cf60 legacy=0x7f6b80151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:11.880 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.875+0000 7f6b863b8700 1 -- 172.21.15.158:0/4069383120 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b800b6980 con 0x7f6b8009a320 2019-12-05T03:50:11.880 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.875+0000 7f6b863b8700 1 --2- 172.21.15.158:0/4069383120 >> v2:172.21.15.158:3300/0 conn(0x7f6b8009a320 0x7f6b8005a740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6b70008790 tx=0x7f6b7000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.881 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.875+0000 7f6b863b8700 1 --2- 172.21.15.158:0/4069383120 >> v2:172.21.15.158:3300/0 conn(0x7f6b8009a320 0x7f6b8005a740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6b70008790 tx=0x7f6b7000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.881 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.875+0000 7f6b863b8700 1 --2- 172.21.15.158:0/4069383120 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b8009a320 0x7f6b8005a740 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7f6b70008790 tx=0x7f6b7000fd30).ready entity=mon.1 client_cookie=5551e44a117f3981 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:11.881 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.875+0000 7f6b863b8700 1 --2- 172.21.15.158:0/4069383120 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b8009a320 0x7f6b8005a740 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f6b70008790 tx=0x7f6b7000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.881 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.875+0000 7f6b85bb7700 1 -- 172.21.15.158:0/4069383120 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b70008c90 con 0x7f6b8009a320 2019-12-05T03:50:11.881 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.875+0000 7f6b863b8700 1 --2- 172.21.15.158:0/4069383120 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b8009a320 0x7f6b8005a740 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f6b70008790 tx=0x7f6b7000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.881 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.875+0000 7f6b863b8700 1 --2- 172.21.15.158:0/4069383120 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b8009a320 0x7f6b8005a740 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f6b70008790 tx=0x7f6b7000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.881 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.875+0000 7f6b85bb7700 1 -- 172.21.15.158:0/4069383120 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b700088b0 con 0x7f6b8009a320 2019-12-05T03:50:11.882 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.875+0000 7f6b85bb7700 1 -- 172.21.15.158:0/4069383120 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b70011ad0 con 0x7f6b8009a320 2019-12-05T03:50:11.882 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.875+0000 7f6b8861c700 1 -- 172.21.15.158:0/4069383120 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b8009a320 msgr2=0x7f6b8005a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:11.882 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.875+0000 7f6b8861c700 1 --2- 172.21.15.158:0/4069383120 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b8009a320 0x7f6b8005a740 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7f6b70008790 tx=0x7f6b7000fd30).stop 2019-12-05T03:50:11.882 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.875+0000 7f6b8861c700 1 -- 172.21.15.158:0/4069383120 shutdown_connections 2019-12-05T03:50:11.882 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.875+0000 7f6b8861c700 1 --2- 172.21.15.158:0/4069383120 >> v2:172.21.15.96:3300/0 conn(0x7f6b801553b0 0x7f6b801557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:11.882 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.875+0000 7f6b8861c700 1 --2- 172.21.15.158:0/4069383120 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b8009a320 0x7f6b8005a740 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:11.882 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.875+0000 7f6b8861c700 1 -- 172.21.15.158:0/4069383120 shutdown_connections 2019-12-05T03:50:11.882 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.875+0000 7f6b8861c700 1 -- 172.21.15.158:0/4069383120 wait complete. 2019-12-05T03:50:11.883 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.875+0000 7f6b8861c700 1 -- 172.21.15.158:0/4069383120 >> 172.21.15.158:0/4069383120 conn(0x7f6b800b7e60 msgr2=0x7f6b800b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:11.886 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.879+0000 7f6b8861c700 1 Processor -- start 2019-12-05T03:50:11.886 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.879+0000 7f6b8861c700 1 -- start start 2019-12-05T03:50:11.886 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.879+0000 7f6b8861c700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6b800b34c0 0x7f6b80137290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:11.886 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.879+0000 7f6b8861c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f6b801377e0 0x7f6b80133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:11.886 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.879+0000 7f6b8861c700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b80137c10 con 0x7f6b8007b700 2019-12-05T03:50:11.887 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.879+0000 7f6b8861c700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b80137e40 con 0x7f6b801377e0 2019-12-05T03:50:11.887 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.879+0000 7f6b8861c700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b800af450 con 0x7f6b800b34c0 2019-12-05T03:50:11.887 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.879+0000 7f6b873ba700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f6b801377e0 0x7f6b80133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:11.887 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.879+0000 7f6b873ba700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f6b801377e0 0x7f6b80133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53872/0 (socket says 172.21.15.158:53872) 2019-12-05T03:50:11.887 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.879+0000 7f6b863b8700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6b800b34c0 0x7f6b80137290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:11.887 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.879+0000 7f6b873ba700 1 -- 172.21.15.158:0/404907467 learned_addr learned my addr 172.21.15.158:0/404907467 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:11.887 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.883+0000 7f6b873ba700 1 -- 172.21.15.158:0/404907467 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6b800b34c0 msgr2=0x7f6b80137290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:11.888 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.883+0000 7f6b873ba700 1 --2- 172.21.15.158:0/404907467 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6b800b34c0 0x7f6b80137290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:11.888 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.883+0000 7f6b873ba700 1 -- 172.21.15.158:0/404907467 >> v1:172.21.15.96:6789/0 conn(0x7f6b8007b700 legacy=0x7f6b800b08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:11.888 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.883+0000 7f6b873ba700 1 -- 172.21.15.158:0/404907467 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b80134220 con 0x7f6b801377e0 2019-12-05T03:50:11.888 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.883+0000 7f6b777fe700 1 -- 172.21.15.158:0/404907467 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 620201930 0 0) 0x7f6b80137c10 con 0x7f6b8007b700 2019-12-05T03:50:11.888 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.883+0000 7f6b873ba700 1 --2- 172.21.15.158:0/404907467 >> v2:172.21.15.158:3300/0 conn(0x7f6b801377e0 0x7f6b80133cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6b801284c0 tx=0x7f6b78010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.888 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.883+0000 7f6b873ba700 1 --2- 172.21.15.158:0/404907467 >> v2:172.21.15.158:3300/0 conn(0x7f6b801377e0 0x7f6b80133cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6b801284c0 tx=0x7f6b78010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.888 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.883+0000 7f6b873ba700 1 --2- 172.21.15.158:0/404907467 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b801377e0 0x7f6b80133cd0 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7f6b801284c0 tx=0x7f6b78010e20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:11.889 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.883+0000 7f6b873ba700 1 --2- 172.21.15.158:0/404907467 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b801377e0 0x7f6b80133cd0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f6b801284c0 tx=0x7f6b78010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.889 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.883+0000 7f6b777fe700 1 -- 172.21.15.158:0/404907467 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b78011820 con 0x7f6b801377e0 2019-12-05T03:50:11.889 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.883+0000 7f6b873ba700 1 --2- 172.21.15.158:0/404907467 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b801377e0 0x7f6b80133cd0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f6b801284c0 tx=0x7f6b78010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.889 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.883+0000 7f6b873ba700 1 --2- 172.21.15.158:0/404907467 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b801377e0 0x7f6b80133cd0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f6b801284c0 tx=0x7f6b78010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.889 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.883+0000 7f6b777fe700 1 -- 172.21.15.158:0/404907467 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b78008b70 con 0x7f6b801377e0 2019-12-05T03:50:11.889 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.883+0000 7f6b777fe700 1 -- 172.21.15.158:0/404907467 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b78011e00 con 0x7f6b801377e0 2019-12-05T03:50:11.889 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.883+0000 7f6b8861c700 1 -- 172.21.15.158:0/404907467 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b801344f0 con 0x7f6b801377e0 2019-12-05T03:50:11.890 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.883+0000 7f6b8861c700 1 -- 172.21.15.158:0/404907467 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b80134aa0 con 0x7f6b801377e0 2019-12-05T03:50:11.890 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.883+0000 7f6b873ba700 1 --2- 172.21.15.158:0/404907467 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b801377e0 0x7f6b80133cd0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f6b801284c0 tx=0x7f6b78010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.890 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.883+0000 7f6b777fe700 1 -- 172.21.15.158:0/404907467 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f6b7800b220 con 0x7f6b801377e0 2019-12-05T03:50:11.890 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.883+0000 7f6b873ba700 1 --2- 172.21.15.158:0/404907467 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b801377e0 0x7f6b80133cd0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f6b801284c0 tx=0x7f6b78010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.890 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.883+0000 7f6b777fe700 1 --2- 172.21.15.158:0/404907467 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f6b6803acb0 0x7f6b6803d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:11.890 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.883+0000 7f6b777fe700 1 -- 172.21.15.158:0/404907467 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f6b7804b120 con 0x7f6b801377e0 2019-12-05T03:50:11.890 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.883+0000 7f6b86bb9700 1 --2- 172.21.15.158:0/404907467 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f6b6803acb0 0x7f6b6803d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:11.891 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.883+0000 7f6b86bb9700 1 --2- 172.21.15.158:0/404907467 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f6b6803acb0 0x7f6b6803d1c0 crc :-1 s=READY pgs=84 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:11.891 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.887+0000 7f6b8861c700 1 -- 172.21.15.158:0/404907467 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b8009b480 con 0x7f6b801377e0 2019-12-05T03:50:11.894 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.891+0000 7f6b873ba700 1 --2- 172.21.15.158:0/404907467 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b801377e0 0x7f6b80133cd0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f6b801284c0 tx=0x7f6b78010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:11.894 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:11.891+0000 7f6b777fe700 1 -- 172.21.15.158:0/404907467 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f6b780321a0 con 0x7f6b801377e0 2019-12-05T03:50:12.057 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.055+0000 7f6b8861c700 1 -- 172.21.15.158:0/404907467 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b800554e0 con 0x7f6b801377e0 2019-12-05T03:50:12.059 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.059+0000 7f6b873ba700 1 --2- 172.21.15.158:0/404907467 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b801377e0 0x7f6b80133cd0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f6b801284c0 tx=0x7f6b78010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.060 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.059+0000 7f6b777fe700 1 -- 172.21.15.158:0/404907467 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+14933 (secure 0 0 0) 0x7f6b78032400 con 0x7f6b801377e0 2019-12-05T03:50:12.061 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:12.061 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":23,"fsid":"a91186ae-f496-4de1-918d-820c55ff1feb","created":"2019-12-05T03:49:39.187523+0000","modified":"2019-12-05T03:50:01.249305+0000","last_up_change":"2019-12-05T03:49:48.551934+0000","last_in_change":"2019-12-05T03:49:48.551934+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-05T03:49:52.900870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-12-05T03:49:55.801462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-12-05T03:49:58.659250+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"782c4258-e28c-4a11-9d54-3c9c7a36fba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":12192},{"type":"v1","addr":"172.21.15.158:6801","nonce":12192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":12192},{"type":"v1","addr":"172.21.15.158:6803","nonce":12192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":12192},{"type":"v1","addr":"172.21.15.158:6807","nonce":12192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":12192},{"type":"v1","addr":"172.21.15.158:6805","nonce":12192}]},"public_addr":"172.21.15.158:6801/12192","cluster_addr":"172.21.15.158:6803/12192","heartbeat_back_addr":"172.21.15.158:6807/12192","heartbeat_front_addr":"172.21.15.158:6805/12192","state":["exists","up"]},{"osd":1,"uuid":"d4426b21-b666-4158-bf34-a24b14572731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":12193},{"type":"v1","addr":"172.21.15.158:6809","nonce":12193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":12193},{"type":"v1","addr":"172.21.15.158:6811","nonce":12193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":12193},{"type":"v1","addr":"172.21.15.158:6815","nonce":12193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":12193},{"type":"v1","addr":"172.21.15.158:6813","nonce":12193}]},"public_addr":"172.21.15.158:6809/12193","cluster_addr":"172.21.15.158:6811/12193","heartbeat_back_addr":"172.21.15.158:6815/12193","heartbeat_front_addr":"172.21.15.158:6813/12193","state":["exists","up"]},{"osd":2,"uuid":"22680edd-6490-4ab0-bb15-0605830e4cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":12195},{"type":"v1","addr":"172.21.15.158:6825","nonce":12195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":12195},{"type":"v1","addr":"172.21.15.158:6827","nonce":12195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":12195},{"type":"v1","addr":"172.21.15.158:6831","nonce":12195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":12195},{"type":"v1","addr":"172.21.15.158:6829","nonce":12195}]},"public_addr":"172.21.15.158:6825/12195","cluster_addr":"172.21.15.158:6827/12195","heartbeat_back_addr":"172.21.15.158:6831/12195","heartbeat_front_addr":"172.21.15.158:6829/12195","state":["exists","up"]},{"osd":3,"uuid":"7ec999ee-ace8-4ccb-a4f9-6f5d313bbbd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":12194},{"type":"v1","addr":"172.21.15.158:6817","nonce":12194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":12194},{"type":"v1","addr":"172.21.15.158:6819","nonce":12194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":12194},{"type":"v1","addr":"172.21.15.158:6823","nonce":12194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":12194},{"type":"v1","addr":"172.21.15.158:6821","nonce":12194}]},"public_addr":"172.21.15.158:6817/12194","cluster_addr":"172.21.15.158:6819/12194","heartbeat_back_addr":"172.21.15.158:6823/12194","heartbeat_front_addr":"172.21.15.158:6821/12194","state":["exists","up"]},{"osd":4,"uuid":"186e69c4-b69f-4dd1-bb8f-faf759c60484","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":12460},{"type":"v1","addr":"172.21.15.96:6803","nonce":12460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":12460},{"type":"v1","addr":"172.21.15.96:6805","nonce":12460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":12460},{"type":"v1","addr":"172.21.15.96:6809","nonce":12460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":12460},{"type":"v1","addr":"172.21.15.96:6807","nonce":12460}]},"public_addr":"172.21.15.96:6803/12460","cluster_addr":"172.21.15.96:6805/12460","heartbeat_back_addr":"172.21.15.96:6809/12460","heartbeat_front_addr":"172.21.15.96:6807/12460","state":["exists","up"]},{"osd":5,"uuid":"86b658b2-8b40-4cea-8163-305a3982758b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":12461},{"type":"v1","addr":"172.21.15.96:6811","nonce":12461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":12461},{"type":"v1","addr":"172.21.15.96:6813","nonce":12461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":12461},{"type":"v1","addr":"172.21.15.96:6817","nonce":12461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":12461},{"type":"v1","addr":"172.21.15.96:6815","nonce":12461}]},"public_addr":"172.21.15.96:6811/12461","cluster_addr":"172.21.15.96:6813/12461","heartbeat_back_addr":"172.21.15.96:6817/12461","heartbeat_front_addr":"172.21.15.96:6815/12461","state":["exists","up"]},{"osd":6,"uuid":"bdadaea8-9296-4788-bc59-d9c9eb8defdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":12463},{"type":"v1","addr":"172.21.15.96:6827","nonce":12463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":12463},{"type":"v1","addr":"172.21.15.96:6829","nonce":12463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":12463},{"type":"v1","addr":"172.21.15.96:6833","nonce":12463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":12463},{"type":"v1","addr":"172.21.15.96:6831","nonce":12463}]},"public_addr":"172.21.15.96:6827/12463","cluster_addr":"172.21.15.96:6829/12463","heartbeat_back_addr":"172.21.15.96:6833/12463","heartbeat_front_addr":"172.21.15.96:6831/12463","state":["exists","up"]},{"osd":7,"uuid":"c6d71846-d68e-430f-ab72-0fb8ea4bf640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":12462},{"type":"v1","addr":"172.21.15.96:6819","nonce":12462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":12462},{"type":"v1","addr":"172.21.15.96:6821","nonce":12462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":12462},{"type":"v1","addr":"172.21.15.96:6825","nonce":12462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":12462},{"type":"v1","addr":"172.21.15.96:6823","nonce":12462}]},"public_addr":"172.21.15.96:6819/12462","cluster_addr":"172.21.15.96:6821/12462","heartbeat_back_addr":"172.21.15.96:6825/12462","heartbeat_front_addr":"172.21.15.96:6823/12462","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.875762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.900817+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.210347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.133973+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.864697+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.131015+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.237225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.154377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-05T03:50:12.063 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.059+0000 7f6b8861c700 1 -- 172.21.15.158:0/404907467 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f6b6803acb0 msgr2=0x7f6b6803d1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:12.064 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.059+0000 7f6b8861c700 1 --2- 172.21.15.158:0/404907467 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f6b6803acb0 0x7f6b6803d1c0 crc :-1 s=READY pgs=84 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:12.064 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.059+0000 7f6b8861c700 1 -- 172.21.15.158:0/404907467 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b801377e0 msgr2=0x7f6b80133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:12.064 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.059+0000 7f6b8861c700 1 --2- 172.21.15.158:0/404907467 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b801377e0 0x7f6b80133cd0 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7f6b801284c0 tx=0x7f6b78010e20).stop 2019-12-05T03:50:12.064 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.059+0000 7f6b8861c700 1 -- 172.21.15.158:0/404907467 shutdown_connections 2019-12-05T03:50:12.064 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.063+0000 7f6b8861c700 1 --2- 172.21.15.158:0/404907467 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6b801377e0 0x7f6b80133cd0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:12.064 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.063+0000 7f6b8861c700 1 --2- 172.21.15.158:0/404907467 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f6b6803acb0 0x7f6b6803d1c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:12.064 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.063+0000 7f6b8861c700 1 --2- 172.21.15.158:0/404907467 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6b800b34c0 0x7f6b80137290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:12.065 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.063+0000 7f6b8861c700 1 -- 172.21.15.158:0/404907467 shutdown_connections 2019-12-05T03:50:12.065 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.063+0000 7f6b8861c700 1 -- 172.21.15.158:0/404907467 wait complete. 2019-12-05T03:50:12.065 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.063+0000 7f6b8861c700 1 -- 172.21.15.158:0/404907467 >> 172.21.15.158:0/404907467 conn(0x7f6b8009a320 msgr2=0x7f6b80155320 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:12.073 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:49:52.900870+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:49:55.801462+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:49:58.659250+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-12-05T03:50:12.074 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-12-05T03:50:12.180 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.171+0000 7fc6ec2e0700 1 Processor -- start 2019-12-05T03:50:12.180 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.171+0000 7fc6ec2e0700 1 -- start start 2019-12-05T03:50:12.181 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.171+0000 7fc6ec2e0700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc6e409add0 0x7fc6e40b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:12.181 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.171+0000 7fc6ec2e0700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e4099e30 con 0x7fc6e409ba40 2019-12-05T03:50:12.181 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.171+0000 7fc6ec2e0700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e40b60c0 con 0x7fc6e40b6970 2019-12-05T03:50:12.181 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.171+0000 7fc6ec2e0700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6e409d210 con 0x7fc6e409add0 2019-12-05T03:50:12.181 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.171+0000 7fc6ea87d700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fc6e40b6970 0x7fc6e405a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48656/0 (socket says 172.21.15.158:48656) 2019-12-05T03:50:12.181 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.171+0000 7fc6ea87d700 1 -- 172.21.15.158:0/3829813439 learned_addr learned my addr 172.21.15.158:0/3829813439 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:12.182 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.171+0000 7fc6eb07e700 1 --2- 172.21.15.158:0/3829813439 >> v2:172.21.15.96:3300/0 conn(0x7fc6e409add0 0x7fc6e40b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:12.182 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.171+0000 7fc6e987b700 1 -- 172.21.15.158:0/3829813439 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1558019031 0 0) 0x7fc6e40b60c0 con 0x7fc6e40b6970 2019-12-05T03:50:12.182 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.171+0000 7fc6e987b700 1 -- 172.21.15.158:0/3829813439 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6d00030b0 con 0x7fc6e40b6970 2019-12-05T03:50:12.182 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.175+0000 7fc6eb07e700 1 -- 172.21.15.158:0/3829813439 >> v1:172.21.15.158:6789/0 conn(0x7fc6e40b6970 legacy=0x7fc6e405a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:12.182 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.175+0000 7fc6e987b700 1 -- 172.21.15.158:0/3829813439 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3021952092 0 0) 0x7fc6d00030b0 con 0x7fc6e40b6970 2019-12-05T03:50:12.182 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.175+0000 7fc6eb07e700 1 -- 172.21.15.158:0/3829813439 >> v1:172.21.15.96:6789/0 conn(0x7fc6e409ba40 legacy=0x7fc6e40b5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:12.182 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.175+0000 7fc6eb07e700 1 -- 172.21.15.158:0/3829813439 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e407e960 con 0x7fc6e409add0 2019-12-05T03:50:12.183 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.175+0000 7fc6eb07e700 1 --2- 172.21.15.158:0/3829813439 >> v2:172.21.15.96:3300/0 conn(0x7fc6e409add0 0x7fc6e40b5b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc6e0001950 tx=0x7fc6e0001990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.183 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.175+0000 7fc6eb07e700 1 --2- 172.21.15.158:0/3829813439 >> v2:172.21.15.96:3300/0 conn(0x7fc6e409add0 0x7fc6e40b5b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc6e0001950 tx=0x7fc6e0001990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.183 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.175+0000 7fc6eb07e700 1 --2- 172.21.15.158:0/3829813439 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e409add0 0x7fc6e40b5b70 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7fc6e0001950 tx=0x7fc6e0001990).ready entity=mon.0 client_cookie=81fdfbdc8b4ef41f server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:12.183 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.175+0000 7fc6eb07e700 1 --2- 172.21.15.158:0/3829813439 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e409add0 0x7fc6e40b5b70 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7fc6e0001950 tx=0x7fc6e0001990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.183 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.175+0000 7fc6e987b700 1 -- 172.21.15.158:0/3829813439 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6e0001750 con 0x7fc6e409add0 2019-12-05T03:50:12.183 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.175+0000 7fc6eb07e700 1 --2- 172.21.15.158:0/3829813439 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e409add0 0x7fc6e40b5b70 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7fc6e0001950 tx=0x7fc6e0001990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.183 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.175+0000 7fc6eb07e700 1 --2- 172.21.15.158:0/3829813439 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e409add0 0x7fc6e40b5b70 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7fc6e0001950 tx=0x7fc6e0001990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.183 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.175+0000 7fc6e987b700 1 -- 172.21.15.158:0/3829813439 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e0001560 con 0x7fc6e409add0 2019-12-05T03:50:12.184 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.175+0000 7fc6e987b700 1 -- 172.21.15.158:0/3829813439 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6dc010c60 con 0x7fc6e409add0 2019-12-05T03:50:12.184 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.175+0000 7fc6ec2e0700 1 -- 172.21.15.158:0/3829813439 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e409add0 msgr2=0x7fc6e40b5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:12.184 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.175+0000 7fc6ec2e0700 1 --2- 172.21.15.158:0/3829813439 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e409add0 0x7fc6e40b5b70 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7fc6e0001950 tx=0x7fc6e0001990).stop 2019-12-05T03:50:12.184 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.175+0000 7fc6ec2e0700 1 -- 172.21.15.158:0/3829813439 shutdown_connections 2019-12-05T03:50:12.184 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.175+0000 7fc6ec2e0700 1 --2- 172.21.15.158:0/3829813439 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e409add0 0x7fc6e40b5b70 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:12.184 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.175+0000 7fc6ec2e0700 1 -- 172.21.15.158:0/3829813439 shutdown_connections 2019-12-05T03:50:12.184 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.175+0000 7fc6ec2e0700 1 -- 172.21.15.158:0/3829813439 wait complete. 2019-12-05T03:50:12.185 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.175+0000 7fc6ec2e0700 1 -- 172.21.15.158:0/3829813439 >> 172.21.15.158:0/3829813439 conn(0x7fc6e40b7ef0 msgr2=0x7fc6e40b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:12.185 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.179+0000 7fc6ec2e0700 1 Processor -- start 2019-12-05T03:50:12.185 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.179+0000 7fc6ec2e0700 1 -- start start 2019-12-05T03:50:12.188 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.179+0000 7fc6ec2e0700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc6e40b3cb0 0x7fc6e413db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:12.188 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.179+0000 7fc6ec2e0700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc6e40ae690 0x7fc6e407d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:12.188 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.179+0000 7fc6ec2e0700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e407dec0 con 0x7fc6e412b480 2019-12-05T03:50:12.188 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.179+0000 7fc6ec2e0700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6e413d3b0 con 0x7fc6e40ae690 2019-12-05T03:50:12.189 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.179+0000 7fc6ec2e0700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e413d650 con 0x7fc6e40b3cb0 2019-12-05T03:50:12.189 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.179+0000 7fc6ea87d700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc6e40b3cb0 0x7fc6e413db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:12.189 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.179+0000 7fc6eb07e700 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fc6e412b480 0x7fc6e41404d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.158:43800/0 (socket says 172.21.15.158:43800) 2019-12-05T03:50:12.189 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.179+0000 7fc6eb07e700 1 -- 172.21.15.158:0/658896127 learned_addr learned my addr 172.21.15.158:0/658896127 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:12.189 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.179+0000 7fc6ea07c700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc6e40ae690 0x7fc6e407d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:12.189 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.179+0000 7fc6ea87d700 1 -- 172.21.15.158:0/658896127 >> v2:172.21.15.96:3300/0 conn(0x7fc6e40ae690 msgr2=0x7fc6e407d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:12.189 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.179+0000 7fc6ea87d700 1 --2- 172.21.15.158:0/658896127 >> v2:172.21.15.96:3300/0 conn(0x7fc6e40ae690 0x7fc6e407d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:12.190 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.179+0000 7fc6ea87d700 1 -- 172.21.15.158:0/658896127 >> v1:172.21.15.96:6789/0 conn(0x7fc6e412b480 legacy=0x7fc6e41404d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:12.190 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.179+0000 7fc6ea87d700 1 -- 172.21.15.158:0/658896127 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e413cf10 con 0x7fc6e40b3cb0 2019-12-05T03:50:12.190 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.179+0000 7fc6ea07c700 1 --2- 172.21.15.158:0/658896127 >> v2:172.21.15.96:3300/0 conn(0x7fc6e40ae690 0x7fc6e407d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:50:12.190 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.179+0000 7fc6ea87d700 1 --2- 172.21.15.158:0/658896127 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc6e40b3cb0 0x7fc6e413db90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc6e0001a10 tx=0x7fc6e00109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.190 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.179+0000 7fc6ea87d700 1 --2- 172.21.15.158:0/658896127 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc6e40b3cb0 0x7fc6e413db90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc6e0001a10 tx=0x7fc6e00109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.190 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.179+0000 7fc6ea87d700 1 --2- 172.21.15.158:0/658896127 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc6e40b3cb0 0x7fc6e413db90 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7fc6e0001a10 tx=0x7fc6e00109e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:12.190 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.183+0000 7fc6ea87d700 1 --2- 172.21.15.158:0/658896127 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc6e40b3cb0 0x7fc6e413db90 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7fc6e0001a10 tx=0x7fc6e00109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.191 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.183+0000 7fc6db7fe700 1 -- 172.21.15.158:0/658896127 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6e000c870 con 0x7fc6e40b3cb0 2019-12-05T03:50:12.191 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.183+0000 7fc6ea87d700 1 --2- 172.21.15.158:0/658896127 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc6e40b3cb0 0x7fc6e413db90 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7fc6e0001a10 tx=0x7fc6e00109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.191 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.183+0000 7fc6ea87d700 1 --2- 172.21.15.158:0/658896127 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc6e40b3cb0 0x7fc6e413db90 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7fc6e0001a10 tx=0x7fc6e00109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.191 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.183+0000 7fc6db7fe700 1 -- 172.21.15.158:0/658896127 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e000c490 con 0x7fc6e40b3cb0 2019-12-05T03:50:12.191 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.183+0000 7fc6ec2e0700 1 -- 172.21.15.158:0/658896127 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e412b8b0 con 0x7fc6e40b3cb0 2019-12-05T03:50:12.191 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.183+0000 7fc6db7fe700 1 -- 172.21.15.158:0/658896127 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6e0004430 con 0x7fc6e40b3cb0 2019-12-05T03:50:12.191 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.183+0000 7fc6ec2e0700 1 -- 172.21.15.158:0/658896127 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e4140cd0 con 0x7fc6e40b3cb0 2019-12-05T03:50:12.192 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.183+0000 7fc6ea87d700 1 --2- 172.21.15.158:0/658896127 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc6e40b3cb0 0x7fc6e413db90 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7fc6e0001a10 tx=0x7fc6e00109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.192 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.183+0000 7fc6db7fe700 1 -- 172.21.15.158:0/658896127 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fc6e0004740 con 0x7fc6e40b3cb0 2019-12-05T03:50:12.192 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.183+0000 7fc6ea87d700 1 --2- 172.21.15.158:0/658896127 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc6e40b3cb0 0x7fc6e413db90 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7fc6e0001a10 tx=0x7fc6e00109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.192 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.183+0000 7fc6db7fe700 1 --2- 172.21.15.158:0/658896127 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fc6cc03ade0 0x7fc6cc03d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:12.192 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.183+0000 7fc6db7fe700 1 -- 172.21.15.158:0/658896127 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fc6e004ad70 con 0x7fc6e40b3cb0 2019-12-05T03:50:12.192 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.183+0000 7fc6ea07c700 1 --2- 172.21.15.158:0/658896127 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fc6cc03ade0 0x7fc6cc03d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:12.192 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.183+0000 7fc6ea07c700 1 --2- 172.21.15.158:0/658896127 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fc6cc03ade0 0x7fc6cc03d2f0 crc :-1 s=READY pgs=85 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:12.193 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.187+0000 7fc6ec2e0700 1 -- 172.21.15.158:0/658896127 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e40554e0 con 0x7fc6e40b3cb0 2019-12-05T03:50:12.199 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.195+0000 7fc6ea87d700 1 --2- 172.21.15.158:0/658896127 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc6e40b3cb0 0x7fc6e413db90 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7fc6e0001a10 tx=0x7fc6e00109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.199 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.195+0000 7fc6db7fe700 1 -- 172.21.15.158:0/658896127 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fc6e0031df0 con 0x7fc6e40b3cb0 2019-12-05T03:50:12.357 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.355+0000 7fc6ec2e0700 1 -- 172.21.15.158:0/658896127 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fc6e4066940 con 0x7fc6e40b3cb0 2019-12-05T03:50:12.358 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.355+0000 7fc6ea87d700 1 --2- 172.21.15.158:0/658896127 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc6e40b3cb0 0x7fc6e413db90 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7fc6e0001a10 tx=0x7fc6e00109e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.358 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.355+0000 7fc6db7fe700 1 -- 172.21.15.158:0/658896127 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc6e0032050 con 0x7fc6e40b3cb0 2019-12-05T03:50:12.360 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:50:12.363 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.359+0000 7fc6ec2e0700 1 -- 172.21.15.158:0/658896127 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fc6cc03ade0 msgr2=0x7fc6cc03d2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:12.363 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.359+0000 7fc6ec2e0700 1 --2- 172.21.15.158:0/658896127 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fc6cc03ade0 0x7fc6cc03d2f0 crc :-1 s=READY pgs=85 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:12.363 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.359+0000 7fc6ec2e0700 1 -- 172.21.15.158:0/658896127 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc6e40b3cb0 msgr2=0x7fc6e413db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:12.363 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.359+0000 7fc6ec2e0700 1 --2- 172.21.15.158:0/658896127 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc6e40b3cb0 0x7fc6e413db90 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7fc6e0001a10 tx=0x7fc6e00109e0).stop 2019-12-05T03:50:12.364 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.359+0000 7fc6ec2e0700 1 -- 172.21.15.158:0/658896127 shutdown_connections 2019-12-05T03:50:12.364 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.359+0000 7fc6ec2e0700 1 --2- 172.21.15.158:0/658896127 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fc6cc03ade0 0x7fc6cc03d2f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:12.364 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.359+0000 7fc6ec2e0700 1 --2- 172.21.15.158:0/658896127 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc6e40b3cb0 0x7fc6e413db90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:12.364 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.359+0000 7fc6ec2e0700 1 --2- 172.21.15.158:0/658896127 >> v2:172.21.15.96:3300/0 conn(0x7fc6e40ae690 0x7fc6e407d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:12.364 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.359+0000 7fc6ec2e0700 1 -- 172.21.15.158:0/658896127 shutdown_connections 2019-12-05T03:50:12.364 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.359+0000 7fc6ec2e0700 1 -- 172.21.15.158:0/658896127 wait complete. 2019-12-05T03:50:12.364 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.359+0000 7fc6ec2e0700 1 -- 172.21.15.158:0/658896127 >> 172.21.15.158:0/658896127 conn(0x7fc6e405a500 msgr2=0x7fc6e407be40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:12.373 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-12-05T03:50:12.471 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.463+0000 7f66e3b4d700 1 Processor -- start 2019-12-05T03:50:12.471 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.463+0000 7f66e3b4d700 1 -- start start 2019-12-05T03:50:12.471 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.467+0000 7f66e3b4d700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f66dc0b6970 0x7f66dc09add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:12.472 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.467+0000 7f66e3b4d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f66dc09ba40 0x7f66dc05a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:12.472 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.467+0000 7f66e3b4d700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66dc099e30 con 0x7f66dc05a950 2019-12-05T03:50:12.472 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.467+0000 7f66e3b4d700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66dc09d210 con 0x7f66dc0b6970 2019-12-05T03:50:12.472 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.467+0000 7f66e3b4d700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66dc099b90 con 0x7f66dc09ba40 2019-12-05T03:50:12.472 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.467+0000 7f66e18e9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f66dc09ba40 0x7f66dc05a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:12.472 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.467+0000 7f66e18e9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f66dc09ba40 0x7f66dc05a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53892/0 (socket says 172.21.15.158:53892) 2019-12-05T03:50:12.473 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.467+0000 7f66e18e9700 1 -- 172.21.15.158:0/699560 learned_addr learned my addr 172.21.15.158:0/699560 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:12.473 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.467+0000 7f66e20ea700 1 --2- 172.21.15.158:0/699560 >> v2:172.21.15.96:3300/0 conn(0x7f66dc0b6970 0x7f66dc09add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:12.473 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.467+0000 7f66e18e9700 1 -- 172.21.15.158:0/699560 >> v2:172.21.15.96:3300/0 conn(0x7f66dc0b6970 msgr2=0x7f66dc09add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:12.473 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.467+0000 7f66e18e9700 1 --2- 172.21.15.158:0/699560 >> v2:172.21.15.96:3300/0 conn(0x7f66dc0b6970 0x7f66dc09add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:12.473 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.467+0000 7f66e18e9700 1 -- 172.21.15.158:0/699560 >> v1:172.21.15.96:6789/0 conn(0x7f66dc05a950 legacy=0x7f66dc155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:12.473 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.467+0000 7f66e18e9700 1 -- 172.21.15.158:0/699560 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66dc07e960 con 0x7f66dc09ba40 2019-12-05T03:50:12.473 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.467+0000 7f66e18e9700 1 --2- 172.21.15.158:0/699560 >> v2:172.21.15.158:3300/0 conn(0x7f66dc09ba40 0x7f66dc05a400 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f66cc002f30 tx=0x7f66cc00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.473 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.467+0000 7f66e18e9700 1 --2- 172.21.15.158:0/699560 >> v2:172.21.15.158:3300/0 conn(0x7f66dc09ba40 0x7f66dc05a400 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f66cc002f30 tx=0x7f66cc00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.474 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.467+0000 7f66e18e9700 1 --2- 172.21.15.158:0/699560 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f66dc09ba40 0x7f66dc05a400 secure :-1 s=READY pgs=157 cs=0 l=1 rx=0x7f66cc002f30 tx=0x7f66cc00fd30).ready entity=mon.1 client_cookie=bdc2f9c9a03268e server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:12.474 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.467+0000 7f66e18e9700 1 --2- 172.21.15.158:0/699560 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f66dc09ba40 0x7f66dc05a400 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f66cc002f30 tx=0x7f66cc00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.474 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.467+0000 7f66e18e9700 1 --2- 172.21.15.158:0/699560 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f66dc09ba40 0x7f66dc05a400 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f66cc002f30 tx=0x7f66cc00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.474 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.467+0000 7f66e10e8700 1 -- 172.21.15.158:0/699560 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66cc008c90 con 0x7f66dc09ba40 2019-12-05T03:50:12.474 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.467+0000 7f66e18e9700 1 --2- 172.21.15.158:0/699560 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f66dc09ba40 0x7f66dc05a400 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f66cc002f30 tx=0x7f66cc00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.474 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.467+0000 7f66e10e8700 1 -- 172.21.15.158:0/699560 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66cc0088b0 con 0x7f66dc09ba40 2019-12-05T03:50:12.474 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.467+0000 7f66e10e8700 1 -- 172.21.15.158:0/699560 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66cc011ad0 con 0x7f66dc09ba40 2019-12-05T03:50:12.475 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.467+0000 7f66e3b4d700 1 -- 172.21.15.158:0/699560 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f66dc09ba40 msgr2=0x7f66dc05a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:12.475 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.467+0000 7f66e3b4d700 1 --2- 172.21.15.158:0/699560 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f66dc09ba40 0x7f66dc05a400 secure :-1 s=READY pgs=157 cs=0 l=1 rx=0x7f66cc002f30 tx=0x7f66cc00fd30).stop 2019-12-05T03:50:12.475 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.467+0000 7f66e3b4d700 1 -- 172.21.15.158:0/699560 shutdown_connections 2019-12-05T03:50:12.475 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.467+0000 7f66e3b4d700 1 --2- 172.21.15.158:0/699560 >> v2:172.21.15.96:3300/0 conn(0x7f66dc0b6970 0x7f66dc09add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:12.475 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.467+0000 7f66e3b4d700 1 --2- 172.21.15.158:0/699560 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f66dc09ba40 0x7f66dc05a400 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:12.475 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.467+0000 7f66e3b4d700 1 -- 172.21.15.158:0/699560 shutdown_connections 2019-12-05T03:50:12.475 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.467+0000 7f66e3b4d700 1 -- 172.21.15.158:0/699560 wait complete. 2019-12-05T03:50:12.476 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.467+0000 7f66e3b4d700 1 -- 172.21.15.158:0/699560 >> 172.21.15.158:0/699560 conn(0x7f66dc0b7ef0 msgr2=0x7f66dc0b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:12.479 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.471+0000 7f66e3b4d700 1 Processor -- start 2019-12-05T03:50:12.479 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.471+0000 7f66e3b4d700 1 -- start start 2019-12-05T03:50:12.479 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.471+0000 7f66e3b4d700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f66dc0b0520 0x7f66dc138a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:12.479 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.471+0000 7f66e3b4d700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f66dc154040 0x7f66dc07ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:12.479 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.471+0000 7f66e3b4d700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66dc0ac790 con 0x7f66dc0adb20 2019-12-05T03:50:12.480 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.471+0000 7f66e3b4d700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66dc059ed0 con 0x7f66dc154040 2019-12-05T03:50:12.480 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.471+0000 7f66e3b4d700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc07b390 con 0x7f66dc0b0520 2019-12-05T03:50:12.480 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.471+0000 7f66e18e9700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f66dc154040 0x7f66dc07ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:12.480 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.471+0000 7f66e20ea700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f66dc0b0520 0x7f66dc138a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:12.480 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.471+0000 7f66e18e9700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f66dc154040 0x7f66dc07ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.158:40486/0 (socket says 172.21.15.158:40486) 2019-12-05T03:50:12.480 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.471+0000 7f66e18e9700 1 -- 172.21.15.158:0/3228933727 learned_addr learned my addr 172.21.15.158:0/3228933727 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:12.481 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.471+0000 7f66e28eb700 1 --1- 172.21.15.158:0/3228933727 >> v1:172.21.15.96:6789/0 conn(0x7f66dc0adb20 0x7f66dc098e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.158:43814/0 (socket says 172.21.15.158:43814) 2019-12-05T03:50:12.481 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.471+0000 7f66e18e9700 1 -- 172.21.15.158:0/3228933727 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f66dc0b0520 msgr2=0x7f66dc138a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:12.481 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.471+0000 7f66e18e9700 1 --2- 172.21.15.158:0/3228933727 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f66dc0b0520 0x7f66dc138a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:12.481 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.471+0000 7f66e18e9700 1 -- 172.21.15.158:0/3228933727 >> v1:172.21.15.96:6789/0 conn(0x7f66dc0adb20 legacy=0x7f66dc098e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:12.481 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.471+0000 7f66e18e9700 1 -- 172.21.15.158:0/3228933727 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66dc0b0950 con 0x7f66dc154040 2019-12-05T03:50:12.481 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.471+0000 7f66d2ffd700 1 -- 172.21.15.158:0/3228933727 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 730679867 0 0) 0x7f66dc0ac790 con 0x7f66dc0adb20 2019-12-05T03:50:12.481 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.475+0000 7f66e18e9700 1 --2- 172.21.15.158:0/3228933727 >> v2:172.21.15.96:3300/0 conn(0x7f66dc154040 0x7f66dc07ae40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f66cc002f30 tx=0x7f66cc008b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.481 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.475+0000 7f66e18e9700 1 --2- 172.21.15.158:0/3228933727 >> v2:172.21.15.96:3300/0 conn(0x7f66dc154040 0x7f66dc07ae40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f66cc002f30 tx=0x7f66cc008b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.482 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.475+0000 7f66e18e9700 1 --2- 172.21.15.158:0/3228933727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66dc154040 0x7f66dc07ae40 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7f66cc002f30 tx=0x7f66cc008b60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:12.482 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.475+0000 7f66e18e9700 1 --2- 172.21.15.158:0/3228933727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66dc154040 0x7f66dc07ae40 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7f66cc002f30 tx=0x7f66cc008b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.482 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.475+0000 7f66d2ffd700 1 -- 172.21.15.158:0/3228933727 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66cc00f470 con 0x7f66dc154040 2019-12-05T03:50:12.482 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.475+0000 7f66e18e9700 1 --2- 172.21.15.158:0/3228933727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66dc154040 0x7f66dc07ae40 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7f66cc002f30 tx=0x7f66cc008b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.482 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.475+0000 7f66e18e9700 1 --2- 172.21.15.158:0/3228933727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66dc154040 0x7f66dc07ae40 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7f66cc002f30 tx=0x7f66cc008b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.482 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.475+0000 7f66d2ffd700 1 -- 172.21.15.158:0/3228933727 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66cc0116f0 con 0x7f66dc154040 2019-12-05T03:50:12.482 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.475+0000 7f66e3b4d700 1 -- 172.21.15.158:0/3228933727 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66dc154470 con 0x7f66dc154040 2019-12-05T03:50:12.483 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.475+0000 7f66d2ffd700 1 -- 172.21.15.158:0/3228933727 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66cc005730 con 0x7f66dc154040 2019-12-05T03:50:12.483 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.475+0000 7f66e3b4d700 1 -- 172.21.15.158:0/3228933727 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66dc0b1970 con 0x7f66dc154040 2019-12-05T03:50:12.483 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.475+0000 7f66e18e9700 1 --2- 172.21.15.158:0/3228933727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66dc154040 0x7f66dc07ae40 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7f66cc002f30 tx=0x7f66cc008b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.483 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.475+0000 7f66d2ffd700 1 -- 172.21.15.158:0/3228933727 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f66cc0059d0 con 0x7f66dc154040 2019-12-05T03:50:12.483 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.475+0000 7f66e18e9700 1 --2- 172.21.15.158:0/3228933727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66dc154040 0x7f66dc07ae40 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7f66cc002f30 tx=0x7f66cc008b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.483 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.475+0000 7f66d2ffd700 1 --2- 172.21.15.158:0/3228933727 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f66c403ac10 0x7f66c403d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:12.483 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.475+0000 7f66d2ffd700 1 -- 172.21.15.158:0/3228933727 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f66cc04ba90 con 0x7f66dc154040 2019-12-05T03:50:12.484 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.475+0000 7f66e20ea700 1 --2- 172.21.15.158:0/3228933727 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f66c403ac10 0x7f66c403d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:12.484 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.475+0000 7f66e20ea700 1 --2- 172.21.15.158:0/3228933727 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f66c403ac10 0x7f66c403d120 crc :-1 s=READY pgs=86 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:12.484 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.479+0000 7f66e3b4d700 1 -- 172.21.15.158:0/3228933727 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66dc0554e0 con 0x7f66dc154040 2019-12-05T03:50:12.491 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.487+0000 7f66e18e9700 1 --2- 172.21.15.158:0/3228933727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66dc154040 0x7f66dc07ae40 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7f66cc002f30 tx=0x7f66cc008b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.491 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.487+0000 7f66d2ffd700 1 -- 172.21.15.158:0/3228933727 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f66cc008de0 con 0x7f66dc154040 2019-12-05T03:50:12.647 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.647+0000 7f66e3b4d700 1 -- 172.21.15.158:0/3228933727 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f66dc066940 con 0x7f66dc154040 2019-12-05T03:50:12.648 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.647+0000 7f66e18e9700 1 --2- 172.21.15.158:0/3228933727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66dc154040 0x7f66dc07ae40 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7f66cc002f30 tx=0x7f66cc008b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.648 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.647+0000 7f66d2ffd700 1 -- 172.21.15.158:0/3228933727 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7f66cc0306a0 con 0x7f66dc154040 2019-12-05T03:50:12.650 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:50:12.656 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.651+0000 7f66e3b4d700 1 -- 172.21.15.158:0/3228933727 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f66c403ac10 msgr2=0x7f66c403d120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:12.656 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.651+0000 7f66e3b4d700 1 --2- 172.21.15.158:0/3228933727 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f66c403ac10 0x7f66c403d120 crc :-1 s=READY pgs=86 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:12.656 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.651+0000 7f66e3b4d700 1 -- 172.21.15.158:0/3228933727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66dc154040 msgr2=0x7f66dc07ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:12.656 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.651+0000 7f66e3b4d700 1 --2- 172.21.15.158:0/3228933727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66dc154040 0x7f66dc07ae40 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7f66cc002f30 tx=0x7f66cc008b60).stop 2019-12-05T03:50:12.656 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.651+0000 7f66e3b4d700 1 -- 172.21.15.158:0/3228933727 shutdown_connections 2019-12-05T03:50:12.657 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.651+0000 7f66e3b4d700 1 --2- 172.21.15.158:0/3228933727 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f66c403ac10 0x7f66c403d120 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:12.657 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.651+0000 7f66e3b4d700 1 --2- 172.21.15.158:0/3228933727 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f66dc0b0520 0x7f66dc138a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:12.657 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.651+0000 7f66e3b4d700 1 --2- 172.21.15.158:0/3228933727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66dc154040 0x7f66dc07ae40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:12.657 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.651+0000 7f66e3b4d700 1 -- 172.21.15.158:0/3228933727 shutdown_connections 2019-12-05T03:50:12.657 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.651+0000 7f66e3b4d700 1 -- 172.21.15.158:0/3228933727 wait complete. 2019-12-05T03:50:12.657 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.651+0000 7f66e3b4d700 1 -- 172.21.15.158:0/3228933727 >> 172.21.15.158:0/3228933727 conn(0x7f66dc07b7e0 msgr2=0x7f66dc09a320 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:12.667 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-12-05T03:50:12.767 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.759+0000 7fa72d8a9700 1 Processor -- start 2019-12-05T03:50:12.767 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.759+0000 7fa72d8a9700 1 -- start start 2019-12-05T03:50:12.768 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.763+0000 7fa72d8a9700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa72809ba40 0x7fa72809add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:12.768 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.763+0000 7fa72d8a9700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa728099e30 con 0x7fa7280b5370 2019-12-05T03:50:12.768 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.763+0000 7fa72d8a9700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa72807e960 con 0x7fa7280b6970 2019-12-05T03:50:12.768 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.763+0000 7fa72d8a9700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa72809d210 con 0x7fa72809ba40 2019-12-05T03:50:12.768 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.763+0000 7fa7277fe700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fa7280b6970 0x7fa72805a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48686/0 (socket says 172.21.15.158:48686) 2019-12-05T03:50:12.768 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.763+0000 7fa726ffd700 1 --2- 172.21.15.158:0/1742521766 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa72809ba40 0x7fa72809add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:12.769 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.763+0000 7fa7277fe700 1 -- 172.21.15.158:0/1742521766 learned_addr learned my addr 172.21.15.158:0/1742521766 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:12.769 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.763+0000 7fa7267fc700 1 -- 172.21.15.158:0/1742521766 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2973754604 0 0) 0x7fa72807e960 con 0x7fa7280b6970 2019-12-05T03:50:12.769 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.763+0000 7fa7267fc700 1 -- 172.21.15.158:0/1742521766 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7140030b0 con 0x7fa7280b6970 2019-12-05T03:50:12.769 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.763+0000 7fa7267fc700 1 -- 172.21.15.158:0/1742521766 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3754513797 0 0) 0x7fa728099e30 con 0x7fa7280b5370 2019-12-05T03:50:12.769 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.763+0000 7fa7267fc700 1 -- 172.21.15.158:0/1742521766 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa72807e960 con 0x7fa7280b5370 2019-12-05T03:50:12.769 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.763+0000 7fa726ffd700 1 -- 172.21.15.158:0/1742521766 >> v1:172.21.15.158:6789/0 conn(0x7fa7280b6970 legacy=0x7fa72805a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:12.769 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.763+0000 7fa7267fc700 1 -- 172.21.15.158:0/1742521766 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3474919136 0 0) 0x7fa7140030b0 con 0x7fa7280b6970 2019-12-05T03:50:12.770 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.763+0000 7fa726ffd700 1 -- 172.21.15.158:0/1742521766 >> v1:172.21.15.96:6789/0 conn(0x7fa7280b5370 legacy=0x7fa7280b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:12.770 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.763+0000 7fa726ffd700 1 -- 172.21.15.158:0/1742521766 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7280b5fa0 con 0x7fa72809ba40 2019-12-05T03:50:12.770 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.763+0000 7fa726ffd700 1 --2- 172.21.15.158:0/1742521766 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa72809ba40 0x7fa72809add0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa718008790 tx=0x7fa710001950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.770 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.763+0000 7fa726ffd700 1 --2- 172.21.15.158:0/1742521766 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa72809ba40 0x7fa72809add0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa718008790 tx=0x7fa710001950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.770 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.763+0000 7fa726ffd700 1 --2- 172.21.15.158:0/1742521766 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa72809ba40 0x7fa72809add0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7fa718008790 tx=0x7fa710001950).ready entity=mon.2 client_cookie=817f59dd19ce6142 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:12.770 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.763+0000 7fa726ffd700 1 --2- 172.21.15.158:0/1742521766 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa72809ba40 0x7fa72809add0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7fa718008790 tx=0x7fa710001950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.770 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.763+0000 7fa726ffd700 1 --2- 172.21.15.158:0/1742521766 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa72809ba40 0x7fa72809add0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7fa718008790 tx=0x7fa710001950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.771 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.763+0000 7fa7267fc700 1 -- 172.21.15.158:0/1742521766 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa710001750 con 0x7fa72809ba40 2019-12-05T03:50:12.771 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.763+0000 7fa726ffd700 1 --2- 172.21.15.158:0/1742521766 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa72809ba40 0x7fa72809add0 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7fa718008790 tx=0x7fa710001950).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.771 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.763+0000 7fa7267fc700 1 -- 172.21.15.158:0/1742521766 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa710001560 con 0x7fa72809ba40 2019-12-05T03:50:12.771 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.763+0000 7fa7267fc700 1 -- 172.21.15.158:0/1742521766 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa718008da0 con 0x7fa72809ba40 2019-12-05T03:50:12.771 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.763+0000 7fa72d8a9700 1 -- 172.21.15.158:0/1742521766 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa72809ba40 msgr2=0x7fa72809add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:12.771 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.763+0000 7fa72d8a9700 1 --2- 172.21.15.158:0/1742521766 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa72809ba40 0x7fa72809add0 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7fa718008790 tx=0x7fa710001950).stop 2019-12-05T03:50:12.771 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.763+0000 7fa72d8a9700 1 -- 172.21.15.158:0/1742521766 shutdown_connections 2019-12-05T03:50:12.772 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.763+0000 7fa72d8a9700 1 --2- 172.21.15.158:0/1742521766 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa72809ba40 0x7fa72809add0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:12.772 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.763+0000 7fa72d8a9700 1 -- 172.21.15.158:0/1742521766 shutdown_connections 2019-12-05T03:50:12.772 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.763+0000 7fa72d8a9700 1 -- 172.21.15.158:0/1742521766 wait complete. 2019-12-05T03:50:12.772 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.763+0000 7fa72d8a9700 1 -- 172.21.15.158:0/1742521766 >> 172.21.15.158:0/1742521766 conn(0x7fa7280b7ef0 msgr2=0x7fa7280b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:12.775 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.767+0000 7fa72d8a9700 1 Processor -- start 2019-12-05T03:50:12.775 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.767+0000 7fa72d8a9700 1 -- start start 2019-12-05T03:50:12.775 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.767+0000 7fa72d8a9700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa72809a4a0 0x7fa7281409c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:12.775 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.767+0000 7fa72d8a9700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa728140f10 con 0x7fa7281326f0 2019-12-05T03:50:12.775 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.767+0000 7fa72d8a9700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7280adf50 con 0x7fa7280adb20 2019-12-05T03:50:12.776 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.767+0000 7fa72d8a9700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa728065280 con 0x7fa72809a4a0 2019-12-05T03:50:12.776 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.771+0000 7fa726ffd700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fa7280adb20 0x7fa728143530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48692/0 (socket says 172.21.15.158:48692) 2019-12-05T03:50:12.776 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.771+0000 7fa726ffd700 1 -- 172.21.15.158:0/2450388453 learned_addr learned my addr 172.21.15.158:0/2450388453 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:12.776 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.771+0000 7fa727fff700 1 --2- 172.21.15.158:0/2450388453 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa72809a4a0 0x7fa7281409c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:12.776 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.771+0000 7fa71ffff700 1 -- 172.21.15.158:0/2450388453 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1399063216 0 0) 0x7fa7280adf50 con 0x7fa7280adb20 2019-12-05T03:50:12.776 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.771+0000 7fa71ffff700 1 -- 172.21.15.158:0/2450388453 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa70c0030b0 con 0x7fa7280adb20 2019-12-05T03:50:12.776 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.771+0000 7fa71ffff700 1 -- 172.21.15.158:0/2450388453 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 759814774 0 0) 0x7fa728140f10 con 0x7fa7281326f0 2019-12-05T03:50:12.777 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.771+0000 7fa71ffff700 1 -- 172.21.15.158:0/2450388453 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7280adf50 con 0x7fa7281326f0 2019-12-05T03:50:12.777 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.771+0000 7fa71ffff700 1 -- 172.21.15.158:0/2450388453 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3238954214 0 0) 0x7fa70c0030b0 con 0x7fa7280adb20 2019-12-05T03:50:12.777 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.771+0000 7fa727fff700 1 -- 172.21.15.158:0/2450388453 >> v1:172.21.15.158:6789/0 conn(0x7fa7280adb20 legacy=0x7fa728143530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:12.777 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.771+0000 7fa727fff700 1 -- 172.21.15.158:0/2450388453 >> v1:172.21.15.96:6789/0 conn(0x7fa7281326f0 legacy=0x7fa7280b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:12.777 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.771+0000 7fa727fff700 1 -- 172.21.15.158:0/2450388453 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa728132b20 con 0x7fa72809a4a0 2019-12-05T03:50:12.777 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.771+0000 7fa727fff700 1 --2- 172.21.15.158:0/2450388453 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa72809a4a0 0x7fa7281409c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa7180081d0 tx=0x7fa718010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.777 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.771+0000 7fa727fff700 1 --2- 172.21.15.158:0/2450388453 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa72809a4a0 0x7fa7281409c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa7180081d0 tx=0x7fa718010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.778 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.771+0000 7fa727fff700 1 --2- 172.21.15.158:0/2450388453 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa72809a4a0 0x7fa7281409c0 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7fa7180081d0 tx=0x7fa718010080).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:12.778 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.771+0000 7fa727fff700 1 --2- 172.21.15.158:0/2450388453 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa72809a4a0 0x7fa7281409c0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fa7180081d0 tx=0x7fa718010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.778 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.771+0000 7fa71ffff700 1 -- 172.21.15.158:0/2450388453 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa718008470 con 0x7fa72809a4a0 2019-12-05T03:50:12.778 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.771+0000 7fa727fff700 1 --2- 172.21.15.158:0/2450388453 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa72809a4a0 0x7fa7281409c0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fa7180081d0 tx=0x7fa718010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.778 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.771+0000 7fa727fff700 1 --2- 172.21.15.158:0/2450388453 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa72809a4a0 0x7fa7281409c0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fa7180081d0 tx=0x7fa718010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.778 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.771+0000 7fa71ffff700 1 -- 172.21.15.158:0/2450388453 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7180089c0 con 0x7fa72809a4a0 2019-12-05T03:50:12.778 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.771+0000 7fa72d8a9700 1 -- 172.21.15.158:0/2450388453 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa728132f30 con 0x7fa72809a4a0 2019-12-05T03:50:12.778 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.771+0000 7fa71ffff700 1 -- 172.21.15.158:0/2450388453 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa720008350 con 0x7fa72809a4a0 2019-12-05T03:50:12.779 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.771+0000 7fa72d8a9700 1 -- 172.21.15.158:0/2450388453 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa72809a8d0 con 0x7fa72809a4a0 2019-12-05T03:50:12.779 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.771+0000 7fa727fff700 1 --2- 172.21.15.158:0/2450388453 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa72809a4a0 0x7fa7281409c0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fa7180081d0 tx=0x7fa718010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.779 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.775+0000 7fa71ffff700 1 -- 172.21.15.158:0/2450388453 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fa720008660 con 0x7fa72809a4a0 2019-12-05T03:50:12.779 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.775+0000 7fa727fff700 1 --2- 172.21.15.158:0/2450388453 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa72809a4a0 0x7fa7281409c0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fa7180081d0 tx=0x7fa718010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.780 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.775+0000 7fa71ffff700 1 --2- 172.21.15.158:0/2450388453 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa70c03b410 0x7fa70c03d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:12.780 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.775+0000 7fa71ffff700 1 -- 172.21.15.158:0/2450388453 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fa72004ab40 con 0x7fa72809a4a0 2019-12-05T03:50:12.780 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.775+0000 7fa7277fe700 1 --2- 172.21.15.158:0/2450388453 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa70c03b410 0x7fa70c03d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:12.780 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.775+0000 7fa7277fe700 1 --2- 172.21.15.158:0/2450388453 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa70c03b410 0x7fa70c03d920 crc :-1 s=READY pgs=87 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:12.780 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.775+0000 7fa72d8a9700 1 -- 172.21.15.158:0/2450388453 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7280554e0 con 0x7fa72809a4a0 2019-12-05T03:50:12.786 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.783+0000 7fa727fff700 1 --2- 172.21.15.158:0/2450388453 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa72809a4a0 0x7fa7281409c0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fa7180081d0 tx=0x7fa718010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.787 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.783+0000 7fa71ffff700 1 -- 172.21.15.158:0/2450388453 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fa720031bc0 con 0x7fa72809a4a0 2019-12-05T03:50:12.948 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.947+0000 7fa72d8a9700 1 -- 172.21.15.158:0/2450388453 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7fa728066940 con 0x7fa72809a4a0 2019-12-05T03:50:12.948 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.947+0000 7fa727fff700 1 --2- 172.21.15.158:0/2450388453 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa72809a4a0 0x7fa7281409c0 secure :-1 s=THROTTLE_DONE pgs=44 cs=0 l=1 rx=0x7fa7180081d0 tx=0x7fa718010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:12.949 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.947+0000 7fa71ffff700 1 -- 172.21.15.158:0/2450388453 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7fa720031e20 con 0x7fa72809a4a0 2019-12-05T03:50:12.951 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:50:12.954 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.951+0000 7fa72d8a9700 1 -- 172.21.15.158:0/2450388453 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa70c03b410 msgr2=0x7fa70c03d920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:12.954 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.951+0000 7fa72d8a9700 1 --2- 172.21.15.158:0/2450388453 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa70c03b410 0x7fa70c03d920 crc :-1 s=READY pgs=87 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:12.954 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.951+0000 7fa72d8a9700 1 -- 172.21.15.158:0/2450388453 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa72809a4a0 msgr2=0x7fa7281409c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:12.954 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.951+0000 7fa72d8a9700 1 --2- 172.21.15.158:0/2450388453 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa72809a4a0 0x7fa7281409c0 secure :-1 s=READY pgs=44 cs=0 l=1 rx=0x7fa7180081d0 tx=0x7fa718010080).stop 2019-12-05T03:50:12.954 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.951+0000 7fa72d8a9700 1 -- 172.21.15.158:0/2450388453 shutdown_connections 2019-12-05T03:50:12.954 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.951+0000 7fa72d8a9700 1 --2- 172.21.15.158:0/2450388453 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa70c03b410 0x7fa70c03d920 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:12.954 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.951+0000 7fa72d8a9700 1 --2- 172.21.15.158:0/2450388453 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa72809a4a0 0x7fa7281409c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:12.955 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.951+0000 7fa72d8a9700 1 -- 172.21.15.158:0/2450388453 shutdown_connections 2019-12-05T03:50:12.955 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.951+0000 7fa72d8a9700 1 -- 172.21.15.158:0/2450388453 wait complete. 2019-12-05T03:50:12.955 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:12.951+0000 7fa72d8a9700 1 -- 172.21.15.158:0/2450388453 >> 172.21.15.158:0/2450388453 conn(0x7fa72805a600 msgr2=0x7fa728154f90 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:12.963 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-12-05T03:50:13.058 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.051+0000 7f3e07740700 1 Processor -- start 2019-12-05T03:50:13.058 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.051+0000 7f3e07740700 1 -- start start 2019-12-05T03:50:13.058 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.051+0000 7f3e07740700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f3e0009cf60 0x7f3e0009a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:13.059 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.051+0000 7f3e07740700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3e001553b0 0x7f3e001557e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:13.059 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.051+0000 7f3e07740700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e000accb0 con 0x7f3e0005a740 2019-12-05T03:50:13.059 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.051+0000 7f3e07740700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e000b1730 con 0x7f3e0009cf60 2019-12-05T03:50:13.059 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.051+0000 7f3e07740700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e000b19d0 con 0x7f3e001553b0 2019-12-05T03:50:13.059 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.051+0000 7f3e05cdd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f3e0009cf60 0x7f3e0009a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:13.059 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.051+0000 7f3e05cdd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f3e0009cf60 0x7f3e0009a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53922/0 (socket says 172.21.15.158:53922) 2019-12-05T03:50:13.060 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.051+0000 7f3e05cdd700 1 -- 172.21.15.158:0/1296719803 learned_addr learned my addr 172.21.15.158:0/1296719803 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:13.060 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.051+0000 7f3e064de700 1 --2- 172.21.15.158:0/1296719803 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3e001553b0 0x7f3e001557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:13.060 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.051+0000 7f3e05cdd700 1 -- 172.21.15.158:0/1296719803 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3e001553b0 msgr2=0x7f3e001557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:13.060 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.051+0000 7f3e05cdd700 1 --2- 172.21.15.158:0/1296719803 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3e001553b0 0x7f3e001557e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:13.060 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.051+0000 7f3e05cdd700 1 -- 172.21.15.158:0/1296719803 >> v1:172.21.15.96:6789/0 conn(0x7f3e0005a740 legacy=0x7f3e00151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:13.060 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.051+0000 7f3e05cdd700 1 -- 172.21.15.158:0/1296719803 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e0005ab70 con 0x7f3e0009cf60 2019-12-05T03:50:13.060 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.051+0000 7f3e05cdd700 1 --2- 172.21.15.158:0/1296719803 >> v2:172.21.15.158:3300/0 conn(0x7f3e0009cf60 0x7f3e0009a320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3e000b1650 tx=0x7f3dfc00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:13.061 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.051+0000 7f3e05cdd700 1 --2- 172.21.15.158:0/1296719803 >> v2:172.21.15.158:3300/0 conn(0x7f3e0009cf60 0x7f3e0009a320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3e000b1650 tx=0x7f3dfc00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:13.061 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.051+0000 7f3e05cdd700 1 --2- 172.21.15.158:0/1296719803 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3e0009cf60 0x7f3e0009a320 secure :-1 s=READY pgs=160 cs=0 l=1 rx=0x7f3e000b1650 tx=0x7f3dfc00fd30).ready entity=mon.1 client_cookie=8322f7e6ccf8ee2f server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:13.061 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.055+0000 7f3e05cdd700 1 --2- 172.21.15.158:0/1296719803 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3e0009cf60 0x7f3e0009a320 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f3e000b1650 tx=0x7f3dfc00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:13.061 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.055+0000 7f3e04cdb700 1 -- 172.21.15.158:0/1296719803 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dfc0113b0 con 0x7f3e0009cf60 2019-12-05T03:50:13.061 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.055+0000 7f3e05cdd700 1 --2- 172.21.15.158:0/1296719803 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3e0009cf60 0x7f3e0009a320 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f3e000b1650 tx=0x7f3dfc00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:13.061 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.055+0000 7f3e05cdd700 1 --2- 172.21.15.158:0/1296719803 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3e0009cf60 0x7f3e0009a320 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f3e000b1650 tx=0x7f3dfc00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:13.061 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.055+0000 7f3e04cdb700 1 -- 172.21.15.158:0/1296719803 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dfc008bb0 con 0x7f3e0009cf60 2019-12-05T03:50:13.062 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.055+0000 7f3e04cdb700 1 -- 172.21.15.158:0/1296719803 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dfc011990 con 0x7f3e0009cf60 2019-12-05T03:50:13.062 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.055+0000 7f3e07740700 1 -- 172.21.15.158:0/1296719803 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3e0009cf60 msgr2=0x7f3e0009a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:13.062 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.055+0000 7f3e07740700 1 --2- 172.21.15.158:0/1296719803 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3e0009cf60 0x7f3e0009a320 secure :-1 s=READY pgs=160 cs=0 l=1 rx=0x7f3e000b1650 tx=0x7f3dfc00fd30).stop 2019-12-05T03:50:13.062 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.055+0000 7f3e07740700 1 -- 172.21.15.158:0/1296719803 shutdown_connections 2019-12-05T03:50:13.062 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.055+0000 7f3e07740700 1 --2- 172.21.15.158:0/1296719803 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3e001553b0 0x7f3e001557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:13.062 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.055+0000 7f3e07740700 1 --2- 172.21.15.158:0/1296719803 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3e0009cf60 0x7f3e0009a320 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:13.062 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.055+0000 7f3e07740700 1 -- 172.21.15.158:0/1296719803 shutdown_connections 2019-12-05T03:50:13.062 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.055+0000 7f3e07740700 1 -- 172.21.15.158:0/1296719803 wait complete. 2019-12-05T03:50:13.063 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.055+0000 7f3e07740700 1 -- 172.21.15.158:0/1296719803 >> 172.21.15.158:0/1296719803 conn(0x7f3e000b7e60 msgr2=0x7f3e000b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:13.072 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.059+0000 7f3e07740700 1 Processor -- start 2019-12-05T03:50:13.072 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.059+0000 7f3e07740700 1 -- start start 2019-12-05T03:50:13.072 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.059+0000 7f3e07740700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3e00154c70 0x7f3e0009ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:13.072 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.059+0000 7f3e07740700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e00140400 con 0x7f3e0007d4d0 2019-12-05T03:50:13.072 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.059+0000 7f3e07740700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e0007d900 con 0x7f3e0013f710 2019-12-05T03:50:13.072 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.059+0000 7f3e07740700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e0013fc20 con 0x7f3e00154c70 2019-12-05T03:50:13.073 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.059+0000 7f3e05cdd700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f3e0013f710 0x7f3e0007ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48704/0 (socket says 172.21.15.158:48704) 2019-12-05T03:50:13.073 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.059+0000 7f3e05cdd700 1 -- 172.21.15.158:0/4265851275 learned_addr learned my addr 172.21.15.158:0/4265851275 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:13.073 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.059+0000 7f3e054dc700 1 --2- 172.21.15.158:0/4265851275 >> v2:172.21.15.96:3300/0 conn(0x7f3e00154c70 0x7f3e0009ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:13.073 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.059+0000 7f3df67fc700 1 -- 172.21.15.158:0/4265851275 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 894266895 0 0) 0x7f3e0007d900 con 0x7f3e0013f710 2019-12-05T03:50:13.073 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.059+0000 7f3df67fc700 1 -- 172.21.15.158:0/4265851275 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3de80030b0 con 0x7f3e0013f710 2019-12-05T03:50:13.073 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.059+0000 7f3df67fc700 1 -- 172.21.15.158:0/4265851275 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1648067906 0 0) 0x7f3de80030b0 con 0x7f3e0013f710 2019-12-05T03:50:13.073 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.059+0000 7f3df67fc700 1 -- 172.21.15.158:0/4265851275 --> v1:172.21.15.158:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3e0007d900 con 0x7f3e0013f710 2019-12-05T03:50:13.074 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.059+0000 7f3df67fc700 1 -- 172.21.15.158:0/4265851275 <== mon.1 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 828730332 0 0) 0x7f3dfc0113b0 con 0x7f3e0013f710 2019-12-05T03:50:13.074 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.059+0000 7f3e054dc700 1 -- 172.21.15.158:0/4265851275 >> v1:172.21.15.158:6789/0 conn(0x7f3e0013f710 legacy=0x7f3e0007ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:13.074 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.059+0000 7f3e054dc700 1 -- 172.21.15.158:0/4265851275 >> v1:172.21.15.96:6789/0 conn(0x7f3e0007d4d0 legacy=0x7f3e0013c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:13.074 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.059+0000 7f3e054dc700 1 -- 172.21.15.158:0/4265851275 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e0013c950 con 0x7f3e00154c70 2019-12-05T03:50:13.074 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.059+0000 7f3e054dc700 1 --2- 172.21.15.158:0/4265851275 >> v2:172.21.15.96:3300/0 conn(0x7f3e00154c70 0x7f3e0009ac10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3df0000e90 tx=0x7f3dfc0082d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:13.074 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.063+0000 7f3e054dc700 1 --2- 172.21.15.158:0/4265851275 >> v2:172.21.15.96:3300/0 conn(0x7f3e00154c70 0x7f3e0009ac10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3df0000e90 tx=0x7f3dfc0082d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:13.074 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.063+0000 7f3e054dc700 1 --2- 172.21.15.158:0/4265851275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e00154c70 0x7f3e0009ac10 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7f3df0000e90 tx=0x7f3dfc0082d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:13.075 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.063+0000 7f3e054dc700 1 --2- 172.21.15.158:0/4265851275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e00154c70 0x7f3e0009ac10 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f3df0000e90 tx=0x7f3dfc0082d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:13.075 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.063+0000 7f3df67fc700 1 -- 172.21.15.158:0/4265851275 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3df000c960 con 0x7f3e00154c70 2019-12-05T03:50:13.076 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.063+0000 7f3e07740700 1 -- 172.21.15.158:0/4265851275 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e0013cbc0 con 0x7f3e00154c70 2019-12-05T03:50:13.076 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.063+0000 7f3e054dc700 1 --2- 172.21.15.158:0/4265851275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e00154c70 0x7f3e0009ac10 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f3df0000e90 tx=0x7f3dfc0082d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:13.077 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.063+0000 7f3e07740700 1 -- 172.21.15.158:0/4265851275 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e0013cf20 con 0x7f3e00154c70 2019-12-05T03:50:13.077 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.063+0000 7f3df67fc700 1 -- 172.21.15.158:0/4265851275 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df000c580 con 0x7f3e00154c70 2019-12-05T03:50:13.077 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.063+0000 7f3e054dc700 1 --2- 172.21.15.158:0/4265851275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e00154c70 0x7f3e0009ac10 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f3df0000e90 tx=0x7f3dfc0082d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:13.077 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.063+0000 7f3df67fc700 1 -- 172.21.15.158:0/4265851275 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3df0003140 con 0x7f3e00154c70 2019-12-05T03:50:13.077 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.063+0000 7f3e054dc700 1 --2- 172.21.15.158:0/4265851275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e00154c70 0x7f3e0009ac10 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f3df0000e90 tx=0x7f3dfc0082d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:13.077 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.063+0000 7f3df67fc700 1 -- 172.21.15.158:0/4265851275 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f3df0003410 con 0x7f3e00154c70 2019-12-05T03:50:13.077 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.063+0000 7f3e054dc700 1 --2- 172.21.15.158:0/4265851275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e00154c70 0x7f3e0009ac10 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f3df0000e90 tx=0x7f3dfc0082d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:13.078 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.063+0000 7f3df67fc700 1 --2- 172.21.15.158:0/4265851275 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f3de803b630 0x7f3de803db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:13.078 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.063+0000 7f3df67fc700 1 -- 172.21.15.158:0/4265851275 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f3df004b000 con 0x7f3e00154c70 2019-12-05T03:50:13.078 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.063+0000 7f3e05cdd700 1 --2- 172.21.15.158:0/4265851275 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f3de803b630 0x7f3de803db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:13.078 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.063+0000 7f3e05cdd700 1 --2- 172.21.15.158:0/4265851275 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f3de803b630 0x7f3de803db40 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:13.079 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.067+0000 7f3e07740700 1 -- 172.21.15.158:0/4265851275 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e000554e0 con 0x7f3e00154c70 2019-12-05T03:50:13.080 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.075+0000 7f3e054dc700 1 --2- 172.21.15.158:0/4265851275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e00154c70 0x7f3e0009ac10 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f3df0000e90 tx=0x7f3dfc0082d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:13.080 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.075+0000 7f3df67fc700 1 -- 172.21.15.158:0/4265851275 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f3df0032060 con 0x7f3e00154c70 2019-12-05T03:50:13.241 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.239+0000 7f3e07740700 1 -- 172.21.15.158:0/4265851275 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e00066940 con 0x7f3e00154c70 2019-12-05T03:50:13.242 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.239+0000 7f3e054dc700 1 --2- 172.21.15.158:0/4265851275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e00154c70 0x7f3e0009ac10 secure :-1 s=THROTTLE_DONE pgs=124 cs=0 l=1 rx=0x7f3df0000e90 tx=0x7f3dfc0082d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:13.242 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.239+0000 7f3df67fc700 1 -- 172.21.15.158:0/4265851275 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2105 (secure 0 0 0) 0x7f3df00322c0 con 0x7f3e00154c70 2019-12-05T03:50:13.244 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:13.244 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4339,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.158:6833/1485705503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":1485705503},{"type":"v1","addr":"172.21.15.158:6833","nonce":1485705503}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-12-05T03:50:01.249656+0000","modified":"2019-12-05T03:50:09.365441+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"b","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6835/3636871068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":3636871068},{"type":"v1","addr":"172.21.15.96:6835","nonce":3636871068}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2019-12-05T03:50:13.244 INFO:teuthology.orchestra.run.smithi158.stderr:dumped fsmap epoch 6 2019-12-05T03:50:13.246 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.243+0000 7f3e07740700 1 -- 172.21.15.158:0/4265851275 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f3de803b630 msgr2=0x7f3de803db40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:13.247 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.243+0000 7f3e07740700 1 --2- 172.21.15.158:0/4265851275 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f3de803b630 0x7f3de803db40 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:13.247 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.243+0000 7f3e07740700 1 -- 172.21.15.158:0/4265851275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e00154c70 msgr2=0x7f3e0009ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:13.247 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.243+0000 7f3e07740700 1 --2- 172.21.15.158:0/4265851275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e00154c70 0x7f3e0009ac10 secure :-1 s=READY pgs=124 cs=0 l=1 rx=0x7f3df0000e90 tx=0x7f3dfc0082d0).stop 2019-12-05T03:50:13.247 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.243+0000 7f3e07740700 1 -- 172.21.15.158:0/4265851275 shutdown_connections 2019-12-05T03:50:13.247 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.243+0000 7f3e07740700 1 --2- 172.21.15.158:0/4265851275 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f3de803b630 0x7f3de803db40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:13.247 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.243+0000 7f3e07740700 1 --2- 172.21.15.158:0/4265851275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e00154c70 0x7f3e0009ac10 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:13.248 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.243+0000 7f3e07740700 1 -- 172.21.15.158:0/4265851275 shutdown_connections 2019-12-05T03:50:13.248 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.243+0000 7f3e07740700 1 -- 172.21.15.158:0/4265851275 wait complete. 2019-12-05T03:50:13.248 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.243+0000 7f3e07740700 1 -- 172.21.15.158:0/4265851275 >> 172.21.15.158:0/4265851275 conn(0x7f3e000b38e0 msgr2=0x7f3e000b52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:13.459 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4241}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 6, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [3], u'info': {u'gid_4241': {u'export_targets': [], u'name': u'b', u'incarnation': 5, u'state_seq': 3, u'state': u'up:active', u'gid': 4241, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 3636871068, u'type': u'v2', u'addr': u'172.21.15.96:6834'}, {u'nonce': 3636871068, u'type': u'v1', u'addr': u'172.21.15.96:6835'}]}, u'addr': u'172.21.15.96:6835/3636871068'}}, u'fs_name': u'cephfs', u'created': u'2019-12-05T03:50:01.249656+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-12-05T03:50:09.365441+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-12-05T03:50:13.460 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-12-05T03:50:13.460 INFO:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2019-12-05T03:50:13.553 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2019-12-05T03:50:13.553 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_fsid": "a91186ae-f496-4de1-918d-820c55ff1feb", 2019-12-05T03:50:13.554 INFO:teuthology.orchestra.run.smithi096.stdout: "whoami": 0, 2019-12-05T03:50:13.554 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 4241, 2019-12-05T03:50:13.554 INFO:teuthology.orchestra.run.smithi096.stdout: "want_state": "up:active", 2019-12-05T03:50:13.554 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "up:active", 2019-12-05T03:50:13.554 INFO:teuthology.orchestra.run.smithi096.stdout: "rank_uptime": 5.188443071, 2019-12-05T03:50:13.554 INFO:teuthology.orchestra.run.smithi096.stdout: "mdsmap_epoch": 6, 2019-12-05T03:50:13.554 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch": 23, 2019-12-05T03:50:13.555 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch_barrier": 23, 2019-12-05T03:50:13.555 INFO:teuthology.orchestra.run.smithi096.stdout: "uptime": 9.904587888 2019-12-05T03:50:13.555 INFO:teuthology.orchestra.run.smithi096.stdout:} 2019-12-05T03:50:13.560 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "a91186ae-f496-4de1-918d-820c55ff1feb", "whoami": 0, "id": 4241, "want_state": "up:active", "state": "up:active", "rank_uptime": 5.188443071, "mdsmap_epoch": 6, "osdmap_epoch": 23, "osdmap_epoch_barrier": 23, "uptime": 9.904587888 } 2019-12-05T03:50:13.560 INFO:teuthology.run_tasks:Running task ceph-fuse... 2019-12-05T03:50:13.584 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2019-12-05T03:50:13.585 INFO:tasks.ceph_fuse:config is None 2019-12-05T03:50:13.585 INFO:tasks.ceph_fuse:new config is {'client.3': None, 'client.2': None, 'client.1': None, 'client.0': None} 2019-12-05T03:50:13.585 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2019-12-05T03:50:13.585 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-05T03:50:13.695 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.683+0000 7fe7a15af700 1 Processor -- start 2019-12-05T03:50:13.696 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.683+0000 7fe7a15af700 1 -- start start 2019-12-05T03:50:13.696 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.687+0000 7fe7a15af700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe79c09cf60 0x7fe79c09a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:13.696 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.687+0000 7fe7a15af700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe79c05a740 0x7fe79c151460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:13.697 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.687+0000 7fe7a15af700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe79c0accb0 con 0x7fe79c1519b0 2019-12-05T03:50:13.697 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.687+0000 7fe7a15af700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe79c0b1730 con 0x7fe79c09cf60 2019-12-05T03:50:13.697 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.687+0000 7fe7a15af700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c0b19d0 con 0x7fe79c05a740 2019-12-05T03:50:13.697 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.687+0000 7fe79b7fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe79c09cf60 0x7fe79c09a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:13.697 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.687+0000 7fe79bfff700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fe79c1519b0 0x7fe79c0b52e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48716/0 (socket says 172.21.15.158:48716) 2019-12-05T03:50:13.697 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.687+0000 7fe79bfff700 1 -- 172.21.15.158:0/650600597 learned_addr learned my addr 172.21.15.158:0/650600597 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:13.698 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.687+0000 7fe79b7fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe79c09cf60 0x7fe79c09a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53932/0 (socket says 172.21.15.158:53932) 2019-12-05T03:50:13.698 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.687+0000 7fe79affd700 1 --2- 172.21.15.158:0/650600597 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe79c05a740 0x7fe79c151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:13.698 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.687+0000 7fe79b7fe700 1 -- 172.21.15.158:0/650600597 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe79c05a740 msgr2=0x7fe79c151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:13.698 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.687+0000 7fe79b7fe700 1 --2- 172.21.15.158:0/650600597 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe79c05a740 0x7fe79c151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:13.698 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.687+0000 7fe79b7fe700 1 -- 172.21.15.158:0/650600597 >> v1:172.21.15.158:6789/0 conn(0x7fe79c1519b0 legacy=0x7fe79c0b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:13.698 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.687+0000 7fe79b7fe700 1 -- 172.21.15.158:0/650600597 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79c05ab70 con 0x7fe79c09cf60 2019-12-05T03:50:13.698 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.687+0000 7fe79b7fe700 1 --2- 172.21.15.158:0/650600597 >> v2:172.21.15.158:3300/0 conn(0x7fe79c09cf60 0x7fe79c09a320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe79c0b18f0 tx=0x7fe78c00fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:13.699 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.687+0000 7fe79b7fe700 1 --2- 172.21.15.158:0/650600597 >> v2:172.21.15.158:3300/0 conn(0x7fe79c09cf60 0x7fe79c09a320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe79c0b18f0 tx=0x7fe78c00fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:13.699 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.687+0000 7fe79b7fe700 1 --2- 172.21.15.158:0/650600597 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe79c09cf60 0x7fe79c09a320 secure :-1 s=READY pgs=163 cs=0 l=1 rx=0x7fe79c0b18f0 tx=0x7fe78c00fc70).ready entity=mon.1 client_cookie=b54d36756b32a5a0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:13.699 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.687+0000 7fe79b7fe700 1 --2- 172.21.15.158:0/650600597 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe79c09cf60 0x7fe79c09a320 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7fe79c0b18f0 tx=0x7fe78c00fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:13.699 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.687+0000 7fe79a7fc700 1 -- 172.21.15.158:0/650600597 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe78c0112f0 con 0x7fe79c09cf60 2019-12-05T03:50:13.699 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.687+0000 7fe79b7fe700 1 --2- 172.21.15.158:0/650600597 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe79c09cf60 0x7fe79c09a320 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7fe79c0b18f0 tx=0x7fe78c00fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:13.699 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.687+0000 7fe79b7fe700 1 --2- 172.21.15.158:0/650600597 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe79c09cf60 0x7fe79c09a320 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7fe79c0b18f0 tx=0x7fe78c00fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:13.699 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.687+0000 7fe79a7fc700 1 -- 172.21.15.158:0/650600597 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78c008ad0 con 0x7fe79c09cf60 2019-12-05T03:50:13.700 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.687+0000 7fe79a7fc700 1 -- 172.21.15.158:0/650600597 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe78c0118d0 con 0x7fe79c09cf60 2019-12-05T03:50:13.700 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.687+0000 7fe7a15af700 1 -- 172.21.15.158:0/650600597 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe79c09cf60 msgr2=0x7fe79c09a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:13.700 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.687+0000 7fe7a15af700 1 --2- 172.21.15.158:0/650600597 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe79c09cf60 0x7fe79c09a320 secure :-1 s=READY pgs=163 cs=0 l=1 rx=0x7fe79c0b18f0 tx=0x7fe78c00fc70).stop 2019-12-05T03:50:13.700 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.687+0000 7fe7a15af700 1 -- 172.21.15.158:0/650600597 shutdown_connections 2019-12-05T03:50:13.700 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.687+0000 7fe7a15af700 1 --2- 172.21.15.158:0/650600597 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe79c09cf60 0x7fe79c09a320 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:13.700 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.687+0000 7fe7a15af700 1 --2- 172.21.15.158:0/650600597 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe79c05a740 0x7fe79c151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:13.700 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.687+0000 7fe7a15af700 1 -- 172.21.15.158:0/650600597 shutdown_connections 2019-12-05T03:50:13.701 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.687+0000 7fe7a15af700 1 -- 172.21.15.158:0/650600597 wait complete. 2019-12-05T03:50:13.701 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.687+0000 7fe7a15af700 1 -- 172.21.15.158:0/650600597 >> 172.21.15.158:0/650600597 conn(0x7fe79c0b7e60 msgr2=0x7fe79c0b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:13.701 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.691+0000 7fe7a15af700 1 Processor -- start 2019-12-05T03:50:13.701 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.691+0000 7fe7a15af700 1 -- start start 2019-12-05T03:50:13.701 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.695+0000 7fe7a15af700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe79c13a580 0x7fe79c07b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:13.701 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.695+0000 7fe7a15af700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe79c151920 0x7fe79c151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:13.701 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.695+0000 7fe7a15af700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe79c136ca0 con 0x7fe79c127b50 2019-12-05T03:50:13.702 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.695+0000 7fe7a15af700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe79c064d20 con 0x7fe79c151920 2019-12-05T03:50:13.702 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.695+0000 7fe7a15af700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c136760 con 0x7fe79c13a580 2019-12-05T03:50:13.702 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.695+0000 7fe79b7fe700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fe79c127b50 0x7fe79c125880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48718/0 (socket says 172.21.15.158:48718) 2019-12-05T03:50:13.702 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.695+0000 7fe79b7fe700 1 -- 172.21.15.158:0/296334400 learned_addr learned my addr 172.21.15.158:0/296334400 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:13.702 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.695+0000 7fe79bfff700 1 --2- 172.21.15.158:0/296334400 >> v2:172.21.15.158:3300/0 conn(0x7fe79c151920 0x7fe79c151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:13.702 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.695+0000 7fe79affd700 1 --2- 172.21.15.158:0/296334400 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe79c13a580 0x7fe79c07b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:13.705 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.695+0000 7fe79bfff700 1 -- 172.21.15.158:0/296334400 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe79c13a580 msgr2=0x7fe79c07b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:13.705 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.695+0000 7fe79bfff700 1 --2- 172.21.15.158:0/296334400 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe79c13a580 0x7fe79c07b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:13.705 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.695+0000 7fe79bfff700 1 -- 172.21.15.158:0/296334400 >> v1:172.21.15.158:6789/0 conn(0x7fe79c127b50 legacy=0x7fe79c125880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:13.706 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.695+0000 7fe783fff700 1 -- 172.21.15.158:0/296334400 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 757281206 0 0) 0x7fe79c136ca0 con 0x7fe79c127b50 2019-12-05T03:50:13.706 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.695+0000 7fe79bfff700 1 -- 172.21.15.158:0/296334400 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79c136ed0 con 0x7fe79c151920 2019-12-05T03:50:13.707 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.695+0000 7fe79affd700 1 --2- 172.21.15.158:0/296334400 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe79c13a580 0x7fe79c07b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:50:13.707 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.695+0000 7fe79bfff700 1 --2- 172.21.15.158:0/296334400 >> v2:172.21.15.158:3300/0 conn(0x7fe79c151920 0x7fe79c151d50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe79c136920 tx=0x7fe794010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:13.707 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.695+0000 7fe79bfff700 1 --2- 172.21.15.158:0/296334400 >> v2:172.21.15.158:3300/0 conn(0x7fe79c151920 0x7fe79c151d50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe79c136920 tx=0x7fe794010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:13.707 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.695+0000 7fe79bfff700 1 --2- 172.21.15.158:0/296334400 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe79c151920 0x7fe79c151d50 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7fe79c136920 tx=0x7fe794010bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:13.708 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.695+0000 7fe79bfff700 1 --2- 172.21.15.158:0/296334400 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe79c151920 0x7fe79c151d50 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fe79c136920 tx=0x7fe794010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:13.708 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.695+0000 7fe783fff700 1 -- 172.21.15.158:0/296334400 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe794004b90 con 0x7fe79c151920 2019-12-05T03:50:13.708 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.695+0000 7fe79bfff700 1 --2- 172.21.15.158:0/296334400 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe79c151920 0x7fe79c151d50 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fe79c136920 tx=0x7fe794010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:13.708 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.695+0000 7fe79bfff700 1 --2- 172.21.15.158:0/296334400 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe79c151920 0x7fe79c151d50 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fe79c136920 tx=0x7fe794010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:13.708 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.695+0000 7fe783fff700 1 -- 172.21.15.158:0/296334400 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7940047b0 con 0x7fe79c151920 2019-12-05T03:50:13.708 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.695+0000 7fe7a15af700 1 -- 172.21.15.158:0/296334400 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe79c1371a0 con 0x7fe79c151920 2019-12-05T03:50:13.709 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.695+0000 7fe783fff700 1 -- 172.21.15.158:0/296334400 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe794012740 con 0x7fe79c151920 2019-12-05T03:50:13.709 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.695+0000 7fe7a15af700 1 -- 172.21.15.158:0/296334400 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe79c140d40 con 0x7fe79c151920 2019-12-05T03:50:13.709 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.695+0000 7fe79bfff700 1 --2- 172.21.15.158:0/296334400 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe79c151920 0x7fe79c151d50 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fe79c136920 tx=0x7fe794010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:13.709 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.695+0000 7fe783fff700 1 -- 172.21.15.158:0/296334400 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fe794012a10 con 0x7fe79c151920 2019-12-05T03:50:13.709 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.695+0000 7fe79bfff700 1 --2- 172.21.15.158:0/296334400 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe79c151920 0x7fe79c151d50 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fe79c136920 tx=0x7fe794010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:13.709 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.695+0000 7fe783fff700 1 --2- 172.21.15.158:0/296334400 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fe77c03ac00 0x7fe77c03d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:13.709 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.695+0000 7fe783fff700 1 -- 172.21.15.158:0/296334400 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fe79404b390 con 0x7fe79c151920 2019-12-05T03:50:13.710 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.699+0000 7fe79b7fe700 1 --2- 172.21.15.158:0/296334400 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fe77c03ac00 0x7fe77c03d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:13.710 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.699+0000 7fe79b7fe700 1 --2- 172.21.15.158:0/296334400 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fe77c03ac00 0x7fe77c03d110 crc :-1 s=READY pgs=89 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:13.710 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.699+0000 7fe7a15af700 1 -- 172.21.15.158:0/296334400 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe79c0554e0 con 0x7fe79c151920 2019-12-05T03:50:13.711 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.707+0000 7fe79bfff700 1 --2- 172.21.15.158:0/296334400 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe79c151920 0x7fe79c151d50 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fe79c136920 tx=0x7fe794010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:13.711 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.707+0000 7fe783fff700 1 -- 172.21.15.158:0/296334400 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fe794032410 con 0x7fe79c151920 2019-12-05T03:50:13.881 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.879+0000 7fe7a15af700 1 -- 172.21.15.158:0/296334400 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe79c0b8070 con 0x7fe79c151920 2019-12-05T03:50:13.883 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.879+0000 7fe79bfff700 1 --2- 172.21.15.158:0/296334400 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe79c151920 0x7fe79c151d50 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7fe79c136920 tx=0x7fe794010bd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:13.883 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.879+0000 7fe783fff700 1 -- 172.21.15.158:0/296334400 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+14933 (secure 0 0 0) 0x7fe794032670 con 0x7fe79c151920 2019-12-05T03:50:13.884 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:13.885 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":23,"fsid":"a91186ae-f496-4de1-918d-820c55ff1feb","created":"2019-12-05T03:49:39.187523+0000","modified":"2019-12-05T03:50:01.249305+0000","last_up_change":"2019-12-05T03:49:48.551934+0000","last_in_change":"2019-12-05T03:49:48.551934+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-05T03:49:52.900870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-12-05T03:49:55.801462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-12-05T03:49:58.659250+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"782c4258-e28c-4a11-9d54-3c9c7a36fba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":12192},{"type":"v1","addr":"172.21.15.158:6801","nonce":12192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":12192},{"type":"v1","addr":"172.21.15.158:6803","nonce":12192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":12192},{"type":"v1","addr":"172.21.15.158:6807","nonce":12192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":12192},{"type":"v1","addr":"172.21.15.158:6805","nonce":12192}]},"public_addr":"172.21.15.158:6801/12192","cluster_addr":"172.21.15.158:6803/12192","heartbeat_back_addr":"172.21.15.158:6807/12192","heartbeat_front_addr":"172.21.15.158:6805/12192","state":["exists","up"]},{"osd":1,"uuid":"d4426b21-b666-4158-bf34-a24b14572731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":12193},{"type":"v1","addr":"172.21.15.158:6809","nonce":12193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":12193},{"type":"v1","addr":"172.21.15.158:6811","nonce":12193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":12193},{"type":"v1","addr":"172.21.15.158:6815","nonce":12193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":12193},{"type":"v1","addr":"172.21.15.158:6813","nonce":12193}]},"public_addr":"172.21.15.158:6809/12193","cluster_addr":"172.21.15.158:6811/12193","heartbeat_back_addr":"172.21.15.158:6815/12193","heartbeat_front_addr":"172.21.15.158:6813/12193","state":["exists","up"]},{"osd":2,"uuid":"22680edd-6490-4ab0-bb15-0605830e4cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":12195},{"type":"v1","addr":"172.21.15.158:6825","nonce":12195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":12195},{"type":"v1","addr":"172.21.15.158:6827","nonce":12195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":12195},{"type":"v1","addr":"172.21.15.158:6831","nonce":12195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":12195},{"type":"v1","addr":"172.21.15.158:6829","nonce":12195}]},"public_addr":"172.21.15.158:6825/12195","cluster_addr":"172.21.15.158:6827/12195","heartbeat_back_addr":"172.21.15.158:6831/12195","heartbeat_front_addr":"172.21.15.158:6829/12195","state":["exists","up"]},{"osd":3,"uuid":"7ec999ee-ace8-4ccb-a4f9-6f5d313bbbd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":12194},{"type":"v1","addr":"172.21.15.158:6817","nonce":12194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":12194},{"type":"v1","addr":"172.21.15.158:6819","nonce":12194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":12194},{"type":"v1","addr":"172.21.15.158:6823","nonce":12194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":12194},{"type":"v1","addr":"172.21.15.158:6821","nonce":12194}]},"public_addr":"172.21.15.158:6817/12194","cluster_addr":"172.21.15.158:6819/12194","heartbeat_back_addr":"172.21.15.158:6823/12194","heartbeat_front_addr":"172.21.15.158:6821/12194","state":["exists","up"]},{"osd":4,"uuid":"186e69c4-b69f-4dd1-bb8f-faf759c60484","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":12460},{"type":"v1","addr":"172.21.15.96:6803","nonce":12460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":12460},{"type":"v1","addr":"172.21.15.96:6805","nonce":12460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":12460},{"type":"v1","addr":"172.21.15.96:6809","nonce":12460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":12460},{"type":"v1","addr":"172.21.15.96:6807","nonce":12460}]},"public_addr":"172.21.15.96:6803/12460","cluster_addr":"172.21.15.96:6805/12460","heartbeat_back_addr":"172.21.15.96:6809/12460","heartbeat_front_addr":"172.21.15.96:6807/12460","state":["exists","up"]},{"osd":5,"uuid":"86b658b2-8b40-4cea-8163-305a3982758b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":12461},{"type":"v1","addr":"172.21.15.96:6811","nonce":12461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":12461},{"type":"v1","addr":"172.21.15.96:6813","nonce":12461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":12461},{"type":"v1","addr":"172.21.15.96:6817","nonce":12461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":12461},{"type":"v1","addr":"172.21.15.96:6815","nonce":12461}]},"public_addr":"172.21.15.96:6811/12461","cluster_addr":"172.21.15.96:6813/12461","heartbeat_back_addr":"172.21.15.96:6817/12461","heartbeat_front_addr":"172.21.15.96:6815/12461","state":["exists","up"]},{"osd":6,"uuid":"bdadaea8-9296-4788-bc59-d9c9eb8defdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":12463},{"type":"v1","addr":"172.21.15.96:6827","nonce":12463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":12463},{"type":"v1","addr":"172.21.15.96:6829","nonce":12463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":12463},{"type":"v1","addr":"172.21.15.96:6833","nonce":12463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":12463},{"type":"v1","addr":"172.21.15.96:6831","nonce":12463}]},"public_addr":"172.21.15.96:6827/12463","cluster_addr":"172.21.15.96:6829/12463","heartbeat_back_addr":"172.21.15.96:6833/12463","heartbeat_front_addr":"172.21.15.96:6831/12463","state":["exists","up"]},{"osd":7,"uuid":"c6d71846-d68e-430f-ab72-0fb8ea4bf640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":12462},{"type":"v1","addr":"172.21.15.96:6819","nonce":12462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":12462},{"type":"v1","addr":"172.21.15.96:6821","nonce":12462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":12462},{"type":"v1","addr":"172.21.15.96:6825","nonce":12462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":12462},{"type":"v1","addr":"172.21.15.96:6823","nonce":12462}]},"public_addr":"172.21.15.96:6819/12462","cluster_addr":"172.21.15.96:6821/12462","heartbeat_back_addr":"172.21.15.96:6825/12462","heartbeat_front_addr":"172.21.15.96:6823/12462","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.875762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.900817+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.210347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.133973+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.864697+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.131015+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.237225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.154377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-05T03:50:13.887 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.883+0000 7fe7a15af700 1 -- 172.21.15.158:0/296334400 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fe77c03ac00 msgr2=0x7fe77c03d110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:13.887 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.883+0000 7fe7a15af700 1 --2- 172.21.15.158:0/296334400 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fe77c03ac00 0x7fe77c03d110 crc :-1 s=READY pgs=89 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:13.887 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.883+0000 7fe7a15af700 1 -- 172.21.15.158:0/296334400 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe79c151920 msgr2=0x7fe79c151d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:13.888 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.883+0000 7fe7a15af700 1 --2- 172.21.15.158:0/296334400 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe79c151920 0x7fe79c151d50 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7fe79c136920 tx=0x7fe794010bd0).stop 2019-12-05T03:50:13.888 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.883+0000 7fe7a15af700 1 -- 172.21.15.158:0/296334400 shutdown_connections 2019-12-05T03:50:13.888 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.883+0000 7fe7a15af700 1 --2- 172.21.15.158:0/296334400 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fe77c03ac00 0x7fe77c03d110 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:13.888 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.883+0000 7fe7a15af700 1 --2- 172.21.15.158:0/296334400 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe79c151920 0x7fe79c151d50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:13.888 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.883+0000 7fe7a15af700 1 --2- 172.21.15.158:0/296334400 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe79c13a580 0x7fe79c07b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:13.888 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.883+0000 7fe7a15af700 1 -- 172.21.15.158:0/296334400 shutdown_connections 2019-12-05T03:50:13.888 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.887+0000 7fe7a15af700 1 -- 172.21.15.158:0/296334400 wait complete. 2019-12-05T03:50:13.889 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.887+0000 7fe7a15af700 1 -- 172.21.15.158:0/296334400 >> 172.21.15.158:0/296334400 conn(0x7fe79c07e300 msgr2=0x7fe79c0b2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:13.897 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:49:52.900870+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:49:55.801462+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:49:58.659250+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-12-05T03:50:13.898 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-12-05T03:50:14.006 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.999+0000 7f65b2103700 1 Processor -- start 2019-12-05T03:50:14.006 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.999+0000 7f65b2103700 1 -- start start 2019-12-05T03:50:14.006 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.999+0000 7f65b2103700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f65ac09ba40 0x7f65ac09add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:14.006 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.999+0000 7f65b2103700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f65ac0b5370 0x7f65ac0b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:14.006 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.999+0000 7f65b2103700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65ac099e30 con 0x7f65ac0b6970 2019-12-05T03:50:14.007 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.999+0000 7f65b2103700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65ac09d210 con 0x7f65ac09ba40 2019-12-05T03:50:14.007 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.999+0000 7f65b2103700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac099b90 con 0x7f65ac0b5370 2019-12-05T03:50:14.007 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.999+0000 7f65abfff700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f65ac0b6970 0x7f65ac05a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48726/0 (socket says 172.21.15.158:48726) 2019-12-05T03:50:14.007 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.999+0000 7f65abfff700 1 -- 172.21.15.158:0/485806077 learned_addr learned my addr 172.21.15.158:0/485806077 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:14.007 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.999+0000 7f65ab7fe700 1 --2- 172.21.15.158:0/485806077 >> v2:172.21.15.96:3300/0 conn(0x7f65ac09ba40 0x7f65ac09add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:14.007 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.999+0000 7f65b0ea1700 1 --2- 172.21.15.158:0/485806077 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f65ac0b5370 0x7f65ac0b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:14.007 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.999+0000 7f65aaffd700 1 -- 172.21.15.158:0/485806077 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3203230910 0 0) 0x7f65ac099e30 con 0x7f65ac0b6970 2019-12-05T03:50:14.008 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.999+0000 7f65aaffd700 1 -- 172.21.15.158:0/485806077 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65940030b0 con 0x7f65ac0b6970 2019-12-05T03:50:14.008 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.999+0000 7f65ab7fe700 1 -- 172.21.15.158:0/485806077 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f65ac0b5370 msgr2=0x7f65ac0b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:14.008 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.999+0000 7f65ab7fe700 1 --2- 172.21.15.158:0/485806077 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f65ac0b5370 0x7f65ac0b57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:14.008 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.999+0000 7f65ab7fe700 1 -- 172.21.15.158:0/485806077 >> v1:172.21.15.158:6789/0 conn(0x7f65ac0b6970 legacy=0x7f65ac05a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:14.008 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.999+0000 7f65ab7fe700 1 -- 172.21.15.158:0/485806077 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ac07e960 con 0x7f65ac09ba40 2019-12-05T03:50:14.008 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:13.999+0000 7f65ab7fe700 1 --2- 172.21.15.158:0/485806077 >> v2:172.21.15.96:3300/0 conn(0x7f65ac09ba40 0x7f65ac09add0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f65a0008790 tx=0x7f65a000fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.009 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.003+0000 7f65ab7fe700 1 --2- 172.21.15.158:0/485806077 >> v2:172.21.15.96:3300/0 conn(0x7f65ac09ba40 0x7f65ac09add0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f65a0008790 tx=0x7f65a000fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.009 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.003+0000 7f65ab7fe700 1 --2- 172.21.15.158:0/485806077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65ac09ba40 0x7f65ac09add0 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7f65a0008790 tx=0x7f65a000fc70).ready entity=mon.0 client_cookie=5ad096f2fd8b5efe server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:14.009 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.003+0000 7f65ab7fe700 1 --2- 172.21.15.158:0/485806077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65ac09ba40 0x7f65ac09add0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f65a0008790 tx=0x7f65a000fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.009 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.003+0000 7f65aaffd700 1 -- 172.21.15.158:0/485806077 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65a0008bb0 con 0x7f65ac09ba40 2019-12-05T03:50:14.009 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.003+0000 7f65ab7fe700 1 --2- 172.21.15.158:0/485806077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65ac09ba40 0x7f65ac09add0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f65a0008790 tx=0x7f65a000fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.009 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.003+0000 7f65ab7fe700 1 --2- 172.21.15.158:0/485806077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65ac09ba40 0x7f65ac09add0 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f65a0008790 tx=0x7f65a000fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.009 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.003+0000 7f65aaffd700 1 -- 172.21.15.158:0/485806077 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a00087d0 con 0x7f65ac09ba40 2019-12-05T03:50:14.010 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.003+0000 7f65aaffd700 1 -- 172.21.15.158:0/485806077 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65a0011860 con 0x7f65ac09ba40 2019-12-05T03:50:14.010 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.003+0000 7f65b2103700 1 -- 172.21.15.158:0/485806077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65ac09ba40 msgr2=0x7f65ac09add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:14.010 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.003+0000 7f65b2103700 1 --2- 172.21.15.158:0/485806077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65ac09ba40 0x7f65ac09add0 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7f65a0008790 tx=0x7f65a000fc70).stop 2019-12-05T03:50:14.010 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.003+0000 7f65b2103700 1 -- 172.21.15.158:0/485806077 shutdown_connections 2019-12-05T03:50:14.010 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.003+0000 7f65b2103700 1 --2- 172.21.15.158:0/485806077 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f65ac0b5370 0x7f65ac0b57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:14.010 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.003+0000 7f65b2103700 1 --2- 172.21.15.158:0/485806077 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65ac09ba40 0x7f65ac09add0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:14.010 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.003+0000 7f65b2103700 1 -- 172.21.15.158:0/485806077 shutdown_connections 2019-12-05T03:50:14.011 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.003+0000 7f65b2103700 1 -- 172.21.15.158:0/485806077 wait complete. 2019-12-05T03:50:14.011 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.003+0000 7f65b2103700 1 -- 172.21.15.158:0/485806077 >> 172.21.15.158:0/485806077 conn(0x7f65ac0b7ef0 msgr2=0x7f65ac0b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:14.014 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.007+0000 7f65b2103700 1 Processor -- start 2019-12-05T03:50:14.015 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.007+0000 7f65b2103700 1 -- start start 2019-12-05T03:50:14.015 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.007+0000 7f65b2103700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f65ac152db0 0x7f65ac152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:14.015 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.007+0000 7f65b2103700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65ac0b1ae0 con 0x7f65ac0b29c0 2019-12-05T03:50:14.015 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.007+0000 7f65b2103700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65ac152ae0 con 0x7f65ac0b16b0 2019-12-05T03:50:14.015 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.007+0000 7f65b2103700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65ac0b3070 con 0x7f65ac152db0 2019-12-05T03:50:14.015 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.007+0000 7f65b0ea1700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f65ac152db0 0x7f65ac152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:14.016 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.007+0000 7f65ab7fe700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f65ac0b16b0 0x7f65ac151d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48736/0 (socket says 172.21.15.158:48736) 2019-12-05T03:50:14.016 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.007+0000 7f65ab7fe700 1 -- 172.21.15.158:0/148335623 learned_addr learned my addr 172.21.15.158:0/148335623 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:14.016 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.007+0000 7f65a8ff9700 1 -- 172.21.15.158:0/148335623 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1342248731 0 0) 0x7f65ac152ae0 con 0x7f65ac0b16b0 2019-12-05T03:50:14.016 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.007+0000 7f65a8ff9700 1 -- 172.21.15.158:0/148335623 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f658c0030b0 con 0x7f65ac0b16b0 2019-12-05T03:50:14.016 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.007+0000 7f65a8ff9700 1 -- 172.21.15.158:0/148335623 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3195125622 0 0) 0x7f65940030b0 con 0x7f65ac0b29c0 2019-12-05T03:50:14.016 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.007+0000 7f65a8ff9700 1 -- 172.21.15.158:0/148335623 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65ac152ae0 con 0x7f65ac0b29c0 2019-12-05T03:50:14.016 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.007+0000 7f65b0ea1700 1 -- 172.21.15.158:0/148335623 >> v1:172.21.15.158:6789/0 conn(0x7f65ac0b16b0 legacy=0x7f65ac151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:14.017 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.007+0000 7f65b0ea1700 1 -- 172.21.15.158:0/148335623 >> v1:172.21.15.96:6789/0 conn(0x7f65ac0b29c0 legacy=0x7f65ac07b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:14.017 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.007+0000 7f65b0ea1700 1 -- 172.21.15.158:0/148335623 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ac0b2df0 con 0x7f65ac152db0 2019-12-05T03:50:14.017 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.007+0000 7f65b0ea1700 1 --2- 172.21.15.158:0/148335623 >> v2:172.21.15.158:3300/0 conn(0x7f65ac152db0 0x7f65ac152590 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f65a40032b0 tx=0x7f65a4010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.017 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.007+0000 7f65b0ea1700 1 --2- 172.21.15.158:0/148335623 >> v2:172.21.15.158:3300/0 conn(0x7f65ac152db0 0x7f65ac152590 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f65a40032b0 tx=0x7f65a4010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.017 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.007+0000 7f65b0ea1700 1 --2- 172.21.15.158:0/148335623 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65ac152db0 0x7f65ac152590 secure :-1 s=READY pgs=168 cs=0 l=1 rx=0x7f65a40032b0 tx=0x7f65a4010cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:14.017 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.007+0000 7f65b0ea1700 1 --2- 172.21.15.158:0/148335623 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65ac152db0 0x7f65ac152590 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f65a40032b0 tx=0x7f65a4010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.017 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.007+0000 7f65a8ff9700 1 -- 172.21.15.158:0/148335623 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65a4007350 con 0x7f65ac152db0 2019-12-05T03:50:14.018 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.007+0000 7f65b0ea1700 1 --2- 172.21.15.158:0/148335623 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65ac152db0 0x7f65ac152590 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f65a40032b0 tx=0x7f65a4010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.018 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.007+0000 7f65b0ea1700 1 --2- 172.21.15.158:0/148335623 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65ac152db0 0x7f65ac152590 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f65a40032b0 tx=0x7f65a4010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.018 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.007+0000 7f65a8ff9700 1 -- 172.21.15.158:0/148335623 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a4005cb0 con 0x7f65ac152db0 2019-12-05T03:50:14.018 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.007+0000 7f65b2103700 1 -- 172.21.15.158:0/148335623 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65ac0ac840 con 0x7f65ac152db0 2019-12-05T03:50:14.018 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.007+0000 7f65a8ff9700 1 -- 172.21.15.158:0/148335623 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65a4012370 con 0x7f65ac152db0 2019-12-05T03:50:14.018 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.007+0000 7f65b2103700 1 -- 172.21.15.158:0/148335623 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65ac1531e0 con 0x7f65ac152db0 2019-12-05T03:50:14.019 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.011+0000 7f65b0ea1700 1 --2- 172.21.15.158:0/148335623 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65ac152db0 0x7f65ac152590 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f65a40032b0 tx=0x7f65a4010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.019 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.011+0000 7f65a8ff9700 1 -- 172.21.15.158:0/148335623 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f65a4012640 con 0x7f65ac152db0 2019-12-05T03:50:14.019 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.011+0000 7f65b0ea1700 1 --2- 172.21.15.158:0/148335623 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65ac152db0 0x7f65ac152590 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f65a40032b0 tx=0x7f65a4010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.019 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.011+0000 7f65a8ff9700 1 --2- 172.21.15.158:0/148335623 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f658c03b4c0 0x7f658c03d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:14.019 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.011+0000 7f65a8ff9700 1 -- 172.21.15.158:0/148335623 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f65a404b680 con 0x7f65ac152db0 2019-12-05T03:50:14.019 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.011+0000 7f65abfff700 1 --2- 172.21.15.158:0/148335623 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f658c03b4c0 0x7f658c03d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:14.019 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.011+0000 7f65abfff700 1 --2- 172.21.15.158:0/148335623 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f658c03b4c0 0x7f658c03d9d0 crc :-1 s=READY pgs=90 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:14.020 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.015+0000 7f65b2103700 1 -- 172.21.15.158:0/148335623 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65ac0554e0 con 0x7f65ac152db0 2019-12-05T03:50:14.020 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.019+0000 7f65b0ea1700 1 --2- 172.21.15.158:0/148335623 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65ac152db0 0x7f65ac152590 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f65a40032b0 tx=0x7f65a4010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.020 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.019+0000 7f65a8ff9700 1 -- 172.21.15.158:0/148335623 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f65a4032700 con 0x7f65ac152db0 2019-12-05T03:50:14.178 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.175+0000 7f65b2103700 1 -- 172.21.15.158:0/148335623 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f65ac066940 con 0x7f65ac152db0 2019-12-05T03:50:14.179 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.175+0000 7f65b0ea1700 1 --2- 172.21.15.158:0/148335623 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65ac152db0 0x7f65ac152590 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f65a40032b0 tx=0x7f65a4010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.179 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.175+0000 7f65a8ff9700 1 -- 172.21.15.158:0/148335623 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f65a4032960 con 0x7f65ac152db0 2019-12-05T03:50:14.179 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:50:14.182 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.179+0000 7f65b2103700 1 -- 172.21.15.158:0/148335623 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f658c03b4c0 msgr2=0x7f658c03d9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:14.182 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.179+0000 7f65b2103700 1 --2- 172.21.15.158:0/148335623 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f658c03b4c0 0x7f658c03d9d0 crc :-1 s=READY pgs=90 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:14.182 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.179+0000 7f65b2103700 1 -- 172.21.15.158:0/148335623 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65ac152db0 msgr2=0x7f65ac152590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:14.182 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.179+0000 7f65b2103700 1 --2- 172.21.15.158:0/148335623 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65ac152db0 0x7f65ac152590 secure :-1 s=READY pgs=168 cs=0 l=1 rx=0x7f65a40032b0 tx=0x7f65a4010cb0).stop 2019-12-05T03:50:14.182 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.179+0000 7f65b2103700 1 -- 172.21.15.158:0/148335623 shutdown_connections 2019-12-05T03:50:14.182 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.179+0000 7f65b2103700 1 --2- 172.21.15.158:0/148335623 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f65ac152db0 0x7f65ac152590 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:14.183 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.179+0000 7f65b2103700 1 --2- 172.21.15.158:0/148335623 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f658c03b4c0 0x7f658c03d9d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:14.183 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.179+0000 7f65b2103700 1 -- 172.21.15.158:0/148335623 shutdown_connections 2019-12-05T03:50:14.183 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.179+0000 7f65b2103700 1 -- 172.21.15.158:0/148335623 wait complete. 2019-12-05T03:50:14.183 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.179+0000 7f65b2103700 1 -- 172.21.15.158:0/148335623 >> 172.21.15.158:0/148335623 conn(0x7f65ac155c90 msgr2=0x7f65ac05a500 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:14.192 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-12-05T03:50:14.302 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.291+0000 7fddbe5ce700 1 Processor -- start 2019-12-05T03:50:14.302 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.291+0000 7fddbe5ce700 1 -- start start 2019-12-05T03:50:14.302 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.291+0000 7fddbe5ce700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fddb809ba40 0x7fddb809add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:14.302 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.291+0000 7fddbe5ce700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb8099e30 con 0x7fddb80b5370 2019-12-05T03:50:14.303 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.291+0000 7fddbe5ce700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb807e960 con 0x7fddb80b6970 2019-12-05T03:50:14.303 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.291+0000 7fddbe5ce700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb809d210 con 0x7fddb809ba40 2019-12-05T03:50:14.303 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.291+0000 7fddb7fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fddb809ba40 0x7fddb809add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:14.303 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.291+0000 7fddb7fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fddb809ba40 0x7fddb809add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:53964/0 (socket says 172.21.15.158:53964) 2019-12-05T03:50:14.303 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.291+0000 7fddb7fff700 1 -- 172.21.15.158:0/1164705125 learned_addr learned my addr 172.21.15.158:0/1164705125 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:14.303 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.291+0000 7fddbcb6b700 1 --1- 172.21.15.158:0/1164705125 >> v1:172.21.15.158:6789/0 conn(0x7fddb80b6970 0x7fddb805a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48742/0 (socket says 172.21.15.158:48742) 2019-12-05T03:50:14.304 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.291+0000 7fddb7fff700 1 -- 172.21.15.158:0/1164705125 >> v1:172.21.15.158:6789/0 conn(0x7fddb80b6970 legacy=0x7fddb805a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:14.304 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.291+0000 7fddb7fff700 1 -- 172.21.15.158:0/1164705125 >> v1:172.21.15.96:6789/0 conn(0x7fddb80b5370 legacy=0x7fddb80b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:14.304 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.291+0000 7fddb7fff700 1 -- 172.21.15.158:0/1164705125 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb80b5fa0 con 0x7fddb809ba40 2019-12-05T03:50:14.304 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.291+0000 7fddb7fff700 1 --2- 172.21.15.158:0/1164705125 >> v2:172.21.15.158:3300/0 conn(0x7fddb809ba40 0x7fddb809add0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdda4008790 tx=0x7fdda400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.304 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.291+0000 7fddb7fff700 1 --2- 172.21.15.158:0/1164705125 >> v2:172.21.15.158:3300/0 conn(0x7fddb809ba40 0x7fddb809add0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdda4008790 tx=0x7fdda400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.304 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.291+0000 7fddb7fff700 1 --2- 172.21.15.158:0/1164705125 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fddb809ba40 0x7fddb809add0 secure :-1 s=READY pgs=170 cs=0 l=1 rx=0x7fdda4008790 tx=0x7fdda400fcb0).ready entity=mon.1 client_cookie=7d7c4fa262b0f56f server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:14.304 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.291+0000 7fddb7fff700 1 --2- 172.21.15.158:0/1164705125 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fddb809ba40 0x7fddb809add0 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7fdda4008790 tx=0x7fdda400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.305 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.291+0000 7fddb7fff700 1 --2- 172.21.15.158:0/1164705125 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fddb809ba40 0x7fddb809add0 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7fdda4008790 tx=0x7fdda400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.305 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.291+0000 7fddb77fe700 1 -- 172.21.15.158:0/1164705125 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdda4008c90 con 0x7fddb809ba40 2019-12-05T03:50:14.305 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.291+0000 7fddb7fff700 1 --2- 172.21.15.158:0/1164705125 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fddb809ba40 0x7fddb809add0 secure :-1 s=THROTTLE_DONE pgs=170 cs=0 l=1 rx=0x7fdda4008790 tx=0x7fdda400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.305 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.291+0000 7fddb77fe700 1 -- 172.21.15.158:0/1164705125 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda40088b0 con 0x7fddb809ba40 2019-12-05T03:50:14.305 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.295+0000 7fddb77fe700 1 -- 172.21.15.158:0/1164705125 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdda4011b80 con 0x7fddb809ba40 2019-12-05T03:50:14.305 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.295+0000 7fddbe5ce700 1 -- 172.21.15.158:0/1164705125 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fddb809ba40 msgr2=0x7fddb809add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:14.305 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.295+0000 7fddbe5ce700 1 --2- 172.21.15.158:0/1164705125 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fddb809ba40 0x7fddb809add0 secure :-1 s=READY pgs=170 cs=0 l=1 rx=0x7fdda4008790 tx=0x7fdda400fcb0).stop 2019-12-05T03:50:14.306 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.295+0000 7fddbe5ce700 1 -- 172.21.15.158:0/1164705125 shutdown_connections 2019-12-05T03:50:14.306 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.295+0000 7fddbe5ce700 1 --2- 172.21.15.158:0/1164705125 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fddb809ba40 0x7fddb809add0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:14.306 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.295+0000 7fddbe5ce700 1 -- 172.21.15.158:0/1164705125 shutdown_connections 2019-12-05T03:50:14.306 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.295+0000 7fddbe5ce700 1 -- 172.21.15.158:0/1164705125 wait complete. 2019-12-05T03:50:14.306 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.295+0000 7fddbe5ce700 1 -- 172.21.15.158:0/1164705125 >> 172.21.15.158:0/1164705125 conn(0x7fddb80b7ef0 msgr2=0x7fddb80b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:14.306 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.295+0000 7fddbe5ce700 1 Processor -- start 2019-12-05T03:50:14.306 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.295+0000 7fddbe5ce700 1 -- start start 2019-12-05T03:50:14.307 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.295+0000 7fddbe5ce700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fddb80b0010 0x7fddb81552d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:14.307 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.295+0000 7fddbe5ce700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fddb80b3770 0x7fddb80ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:14.307 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.295+0000 7fddbe5ce700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb80b0990 con 0x7fddb80aea30 2019-12-05T03:50:14.307 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.295+0000 7fddbe5ce700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb8136d60 con 0x7fddb80b0010 2019-12-05T03:50:14.307 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.295+0000 7fddbe5ce700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb8136fc0 con 0x7fddb80b3770 2019-12-05T03:50:14.307 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.295+0000 7fddb7fff700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fddb80b3770 0x7fddb80ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:14.307 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.295+0000 7fddbd36c700 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fddb80aea30 0x7fddb81360e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.158:43880/0 (socket says 172.21.15.158:43880) 2019-12-05T03:50:14.308 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.295+0000 7fddbd36c700 1 -- 172.21.15.158:0/3563441900 learned_addr learned my addr 172.21.15.158:0/3563441900 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:14.308 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.295+0000 7fddbcb6b700 1 --2- 172.21.15.158:0/3563441900 >> v2:172.21.15.96:3300/0 conn(0x7fddb80b0010 0x7fddb81552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:14.308 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.295+0000 7fddb57fa700 1 -- 172.21.15.158:0/3563441900 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2976913924 0 0) 0x7fddb8099e30 con 0x7fddb80aea30 2019-12-05T03:50:14.308 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.295+0000 7fddb57fa700 1 -- 172.21.15.158:0/3563441900 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd980030b0 con 0x7fddb80aea30 2019-12-05T03:50:14.308 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.295+0000 7fddb7fff700 1 -- 172.21.15.158:0/3563441900 >> v2:172.21.15.96:3300/0 conn(0x7fddb80b0010 msgr2=0x7fddb81552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:14.308 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.295+0000 7fddb7fff700 1 --2- 172.21.15.158:0/3563441900 >> v2:172.21.15.96:3300/0 conn(0x7fddb80b0010 0x7fddb81552d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:14.308 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.295+0000 7fddb7fff700 1 -- 172.21.15.158:0/3563441900 >> v1:172.21.15.96:6789/0 conn(0x7fddb80aea30 legacy=0x7fddb81360e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:14.309 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.295+0000 7fddb7fff700 1 -- 172.21.15.158:0/3563441900 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb81368e0 con 0x7fddb80b3770 2019-12-05T03:50:14.309 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.295+0000 7fddb7fff700 1 --2- 172.21.15.158:0/3563441900 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fddb80b3770 0x7fddb80ae4e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdda4008790 tx=0x7fdda4008e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.309 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.295+0000 7fddb7fff700 1 --2- 172.21.15.158:0/3563441900 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fddb80b3770 0x7fddb80ae4e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdda4008790 tx=0x7fdda4008e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.309 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.295+0000 7fddb7fff700 1 --2- 172.21.15.158:0/3563441900 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fddb80b3770 0x7fddb80ae4e0 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7fdda4008790 tx=0x7fdda4008e30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:14.309 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.299+0000 7fddb7fff700 1 --2- 172.21.15.158:0/3563441900 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fddb80b3770 0x7fddb80ae4e0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fdda4008790 tx=0x7fdda4008e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.309 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.299+0000 7fddb57fa700 1 -- 172.21.15.158:0/3563441900 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdda400f680 con 0x7fddb80b3770 2019-12-05T03:50:14.309 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.299+0000 7fddb7fff700 1 --2- 172.21.15.158:0/3563441900 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fddb80b3770 0x7fddb80ae4e0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fdda4008790 tx=0x7fdda4008e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.310 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.299+0000 7fddb57fa700 1 -- 172.21.15.158:0/3563441900 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda40117a0 con 0x7fddb80b3770 2019-12-05T03:50:14.310 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.299+0000 7fddb7fff700 1 --2- 172.21.15.158:0/3563441900 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fddb80b3770 0x7fddb80ae4e0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fdda4008790 tx=0x7fdda4008e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.310 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.299+0000 7fddbe5ce700 1 -- 172.21.15.158:0/3563441900 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb80b3ba0 con 0x7fddb80b3770 2019-12-05T03:50:14.310 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.299+0000 7fddb57fa700 1 -- 172.21.15.158:0/3563441900 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdda4005920 con 0x7fddb80b3770 2019-12-05T03:50:14.310 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.299+0000 7fddbe5ce700 1 -- 172.21.15.158:0/3563441900 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb8137400 con 0x7fddb80b3770 2019-12-05T03:50:14.310 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.299+0000 7fddb7fff700 1 --2- 172.21.15.158:0/3563441900 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fddb80b3770 0x7fddb80ae4e0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fdda4008790 tx=0x7fdda4008e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.310 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.299+0000 7fddb57fa700 1 -- 172.21.15.158:0/3563441900 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fdda4005bc0 con 0x7fddb80b3770 2019-12-05T03:50:14.311 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.299+0000 7fddb7fff700 1 --2- 172.21.15.158:0/3563441900 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fddb80b3770 0x7fddb80ae4e0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fdda4008790 tx=0x7fdda4008e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.311 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.299+0000 7fddb57fa700 1 --2- 172.21.15.158:0/3563441900 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fdd9803b220 0x7fdd9803d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:14.311 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.299+0000 7fddb57fa700 1 -- 172.21.15.158:0/3563441900 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fdda404b9e0 con 0x7fddb80b3770 2019-12-05T03:50:14.311 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.299+0000 7fddbcb6b700 1 --2- 172.21.15.158:0/3563441900 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fdd9803b220 0x7fdd9803d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:14.311 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.299+0000 7fddbcb6b700 1 --2- 172.21.15.158:0/3563441900 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fdd9803b220 0x7fdd9803d730 crc :-1 s=READY pgs=91 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:14.312 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.307+0000 7fddbe5ce700 1 -- 172.21.15.158:0/3563441900 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb80554e0 con 0x7fddb80b3770 2019-12-05T03:50:14.318 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.315+0000 7fddb7fff700 1 --2- 172.21.15.158:0/3563441900 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fddb80b3770 0x7fddb80ae4e0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fdda4008790 tx=0x7fdda4008e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.318 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.315+0000 7fddb57fa700 1 -- 172.21.15.158:0/3563441900 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fdda4032ca0 con 0x7fddb80b3770 2019-12-05T03:50:14.485 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.483+0000 7fddbe5ce700 1 -- 172.21.15.158:0/3563441900 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fddb80b1ab0 con 0x7fddb80b3770 2019-12-05T03:50:14.486 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.483+0000 7fddb7fff700 1 --2- 172.21.15.158:0/3563441900 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fddb80b3770 0x7fddb80ae4e0 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fdda4008790 tx=0x7fdda4008e30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.486 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.483+0000 7fddb57fa700 1 -- 172.21.15.158:0/3563441900 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7fdda4033850 con 0x7fddb80b3770 2019-12-05T03:50:14.488 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:50:14.492 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.491+0000 7fddbe5ce700 1 -- 172.21.15.158:0/3563441900 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fdd9803b220 msgr2=0x7fdd9803d730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:14.492 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.491+0000 7fddbe5ce700 1 --2- 172.21.15.158:0/3563441900 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fdd9803b220 0x7fdd9803d730 crc :-1 s=READY pgs=91 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:14.492 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.491+0000 7fddbe5ce700 1 -- 172.21.15.158:0/3563441900 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fddb80b3770 msgr2=0x7fddb80ae4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:14.493 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.491+0000 7fddbe5ce700 1 --2- 172.21.15.158:0/3563441900 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fddb80b3770 0x7fddb80ae4e0 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7fdda4008790 tx=0x7fdda4008e30).stop 2019-12-05T03:50:14.493 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.491+0000 7fddbe5ce700 1 -- 172.21.15.158:0/3563441900 shutdown_connections 2019-12-05T03:50:14.493 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.491+0000 7fddbe5ce700 1 --2- 172.21.15.158:0/3563441900 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fdd9803b220 0x7fdd9803d730 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:14.493 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.491+0000 7fddbe5ce700 1 --2- 172.21.15.158:0/3563441900 >> v2:172.21.15.96:3300/0 conn(0x7fddb80b0010 0x7fddb81552d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:14.493 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.491+0000 7fddbe5ce700 1 --2- 172.21.15.158:0/3563441900 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fddb80b3770 0x7fddb80ae4e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:14.493 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.491+0000 7fddbe5ce700 1 -- 172.21.15.158:0/3563441900 shutdown_connections 2019-12-05T03:50:14.493 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.491+0000 7fddbe5ce700 1 -- 172.21.15.158:0/3563441900 wait complete. 2019-12-05T03:50:14.494 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.491+0000 7fddbe5ce700 1 -- 172.21.15.158:0/3563441900 >> 172.21.15.158:0/3563441900 conn(0x7fddb807c260 msgr2=0x7fddb809a320 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:14.504 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-12-05T03:50:14.607 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.602+0000 7fc536d6b700 1 Processor -- start 2019-12-05T03:50:14.608 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.602+0000 7fc536d6b700 1 -- start start 2019-12-05T03:50:14.608 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.602+0000 7fc536d6b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fc53009ba40 0x7fc53009add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:14.608 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.602+0000 7fc536d6b700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc5300b5370 0x7fc5300b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:14.608 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.602+0000 7fc536d6b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc530099e30 con 0x7fc5300b6970 2019-12-05T03:50:14.608 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.602+0000 7fc536d6b700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc53009d210 con 0x7fc5300b5370 2019-12-05T03:50:14.608 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.602+0000 7fc536d6b700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc530099b90 con 0x7fc53009ba40 2019-12-05T03:50:14.608 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.602+0000 7fc535308700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fc5300b6970 0x7fc53005a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48754/0 (socket says 172.21.15.158:48754) 2019-12-05T03:50:14.609 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.602+0000 7fc535308700 1 -- 172.21.15.158:0/3248745126 learned_addr learned my addr 172.21.15.158:0/3248745126 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:14.609 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.602+0000 7fc534b07700 1 --2- 172.21.15.158:0/3248745126 >> v2:172.21.15.158:3300/0 conn(0x7fc53009ba40 0x7fc53009add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:14.609 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.602+0000 7fc527fff700 1 -- 172.21.15.158:0/3248745126 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 958896080 0 0) 0x7fc530099e30 con 0x7fc5300b6970 2019-12-05T03:50:14.609 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.602+0000 7fc527fff700 1 -- 172.21.15.158:0/3248745126 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc51c0030b0 con 0x7fc5300b6970 2019-12-05T03:50:14.609 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.602+0000 7fc535b09700 1 --2- 172.21.15.158:0/3248745126 >> v2:172.21.15.96:3300/0 conn(0x7fc5300b5370 0x7fc5300b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:14.609 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.602+0000 7fc527fff700 1 -- 172.21.15.158:0/3248745126 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2595754916 0 0) 0x7fc51c0030b0 con 0x7fc5300b6970 2019-12-05T03:50:14.609 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.602+0000 7fc534b07700 1 -- 172.21.15.158:0/3248745126 >> v2:172.21.15.96:3300/0 conn(0x7fc5300b5370 msgr2=0x7fc5300b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:14.610 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.602+0000 7fc534b07700 1 --2- 172.21.15.158:0/3248745126 >> v2:172.21.15.96:3300/0 conn(0x7fc5300b5370 0x7fc5300b57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:14.610 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.602+0000 7fc534b07700 1 -- 172.21.15.158:0/3248745126 >> v1:172.21.15.158:6789/0 conn(0x7fc5300b6970 legacy=0x7fc53005a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:14.610 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.602+0000 7fc534b07700 1 -- 172.21.15.158:0/3248745126 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc53007e960 con 0x7fc53009ba40 2019-12-05T03:50:14.610 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.602+0000 7fc534b07700 1 --2- 172.21.15.158:0/3248745126 >> v2:172.21.15.158:3300/0 conn(0x7fc53009ba40 0x7fc53009add0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc528001d10 tx=0x7fc528001d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.610 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.602+0000 7fc534b07700 1 --2- 172.21.15.158:0/3248745126 >> v2:172.21.15.158:3300/0 conn(0x7fc53009ba40 0x7fc53009add0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc528001d10 tx=0x7fc528001d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.610 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.602+0000 7fc534b07700 1 --2- 172.21.15.158:0/3248745126 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc53009ba40 0x7fc53009add0 secure :-1 s=READY pgs=172 cs=0 l=1 rx=0x7fc528001d10 tx=0x7fc528001d50).ready entity=mon.1 client_cookie=4d362b7989e9136b server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:14.610 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.602+0000 7fc534b07700 1 --2- 172.21.15.158:0/3248745126 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc53009ba40 0x7fc53009add0 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7fc528001d10 tx=0x7fc528001d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.611 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.602+0000 7fc527fff700 1 -- 172.21.15.158:0/3248745126 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc528001ad0 con 0x7fc53009ba40 2019-12-05T03:50:14.611 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.602+0000 7fc534b07700 1 --2- 172.21.15.158:0/3248745126 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc53009ba40 0x7fc53009add0 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7fc528001d10 tx=0x7fc528001d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.611 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.602+0000 7fc534b07700 1 --2- 172.21.15.158:0/3248745126 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc53009ba40 0x7fc53009add0 secure :-1 s=THROTTLE_DONE pgs=172 cs=0 l=1 rx=0x7fc528001d10 tx=0x7fc528001d50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.611 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.602+0000 7fc527fff700 1 -- 172.21.15.158:0/3248745126 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5280018e0 con 0x7fc53009ba40 2019-12-05T03:50:14.611 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.602+0000 7fc527fff700 1 -- 172.21.15.158:0/3248745126 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc520011480 con 0x7fc53009ba40 2019-12-05T03:50:14.611 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.602+0000 7fc536d6b700 1 -- 172.21.15.158:0/3248745126 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc53009ba40 msgr2=0x7fc53009add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:14.611 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.602+0000 7fc536d6b700 1 --2- 172.21.15.158:0/3248745126 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc53009ba40 0x7fc53009add0 secure :-1 s=READY pgs=172 cs=0 l=1 rx=0x7fc528001d10 tx=0x7fc528001d50).stop 2019-12-05T03:50:14.612 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.602+0000 7fc536d6b700 1 -- 172.21.15.158:0/3248745126 shutdown_connections 2019-12-05T03:50:14.612 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.602+0000 7fc536d6b700 1 --2- 172.21.15.158:0/3248745126 >> v2:172.21.15.96:3300/0 conn(0x7fc5300b5370 0x7fc5300b57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:14.612 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.602+0000 7fc536d6b700 1 --2- 172.21.15.158:0/3248745126 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc53009ba40 0x7fc53009add0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:14.612 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.602+0000 7fc536d6b700 1 -- 172.21.15.158:0/3248745126 shutdown_connections 2019-12-05T03:50:14.612 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.602+0000 7fc536d6b700 1 -- 172.21.15.158:0/3248745126 wait complete. 2019-12-05T03:50:14.612 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.602+0000 7fc536d6b700 1 -- 172.21.15.158:0/3248745126 >> 172.21.15.158:0/3248745126 conn(0x7fc5300b7ef0 msgr2=0x7fc5300b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:14.616 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.606+0000 7fc536d6b700 1 Processor -- start 2019-12-05T03:50:14.616 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.606+0000 7fc536d6b700 1 -- start start 2019-12-05T03:50:14.616 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.606+0000 7fc536d6b700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc5300ac2d0 0x7fc53013cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:14.616 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.606+0000 7fc536d6b700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc5300ae470 0x7fc53007b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:14.617 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.606+0000 7fc536d6b700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc53013d8d0 con 0x7fc530153e10 2019-12-05T03:50:14.617 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.606+0000 7fc536d6b700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc530154390 con 0x7fc5300ae470 2019-12-05T03:50:14.617 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.606+0000 7fc536d6b700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc53007ce50 con 0x7fc5300ac2d0 2019-12-05T03:50:14.617 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.606+0000 7fc535308700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc5300ac2d0 0x7fc53013cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:14.617 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.606+0000 7fc535308700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc5300ac2d0 0x7fc53013cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.158:36720/0 (socket says 172.21.15.158:36720) 2019-12-05T03:50:14.617 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.606+0000 7fc535308700 1 -- 172.21.15.158:0/1512259410 learned_addr learned my addr 172.21.15.158:0/1512259410 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:14.617 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.606+0000 7fc534b07700 1 --2- 172.21.15.158:0/1512259410 >> v2:172.21.15.96:3300/0 conn(0x7fc5300ae470 0x7fc53007b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:14.618 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.610+0000 7fc535308700 1 -- 172.21.15.158:0/1512259410 >> v2:172.21.15.96:3300/0 conn(0x7fc5300ae470 msgr2=0x7fc53007b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:14.618 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.610+0000 7fc535308700 1 --2- 172.21.15.158:0/1512259410 >> v2:172.21.15.96:3300/0 conn(0x7fc5300ae470 0x7fc53007b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:14.618 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.610+0000 7fc535308700 1 -- 172.21.15.158:0/1512259410 >> v1:172.21.15.96:6789/0 conn(0x7fc530153e10 legacy=0x7fc530139530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:14.618 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.610+0000 7fc535308700 1 -- 172.21.15.158:0/1512259410 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc53007b870 con 0x7fc5300ac2d0 2019-12-05T03:50:14.618 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.610+0000 7fc534b07700 1 --2- 172.21.15.158:0/1512259410 >> v2:172.21.15.96:3300/0 conn(0x7fc5300ae470 0x7fc53007b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:50:14.618 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.610+0000 7fc535308700 1 --2- 172.21.15.158:0/1512259410 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc5300ac2d0 0x7fc53013cdb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc528001dd0 tx=0x7fc528010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.618 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.610+0000 7fc535308700 1 --2- 172.21.15.158:0/1512259410 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc5300ac2d0 0x7fc53013cdb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc528001dd0 tx=0x7fc528010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.619 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.610+0000 7fc535308700 1 --2- 172.21.15.158:0/1512259410 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc5300ac2d0 0x7fc53013cdb0 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7fc528001dd0 tx=0x7fc528010e10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:14.619 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.610+0000 7fc535308700 1 --2- 172.21.15.158:0/1512259410 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc5300ac2d0 0x7fc53013cdb0 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fc528001dd0 tx=0x7fc528010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.619 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.610+0000 7fc525ffb700 1 -- 172.21.15.158:0/1512259410 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc52800cc10 con 0x7fc5300ac2d0 2019-12-05T03:50:14.619 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.610+0000 7fc535308700 1 --2- 172.21.15.158:0/1512259410 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc5300ac2d0 0x7fc53013cdb0 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fc528001dd0 tx=0x7fc528010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.619 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.610+0000 7fc536d6b700 1 -- 172.21.15.158:0/1512259410 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc53007bb40 con 0x7fc5300ac2d0 2019-12-05T03:50:14.619 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.610+0000 7fc535308700 1 --2- 172.21.15.158:0/1512259410 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc5300ac2d0 0x7fc53013cdb0 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fc528001dd0 tx=0x7fc528010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.619 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.610+0000 7fc525ffb700 1 -- 172.21.15.158:0/1512259410 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52800c830 con 0x7fc5300ac2d0 2019-12-05T03:50:14.620 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.610+0000 7fc525ffb700 1 -- 172.21.15.158:0/1512259410 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5280129c0 con 0x7fc5300ac2d0 2019-12-05T03:50:14.620 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.610+0000 7fc536d6b700 1 -- 172.21.15.158:0/1512259410 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc530139d30 con 0x7fc5300ac2d0 2019-12-05T03:50:14.620 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.610+0000 7fc535308700 1 --2- 172.21.15.158:0/1512259410 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc5300ac2d0 0x7fc53013cdb0 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fc528001dd0 tx=0x7fc528010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.620 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.610+0000 7fc535308700 1 --2- 172.21.15.158:0/1512259410 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc5300ac2d0 0x7fc53013cdb0 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fc528001dd0 tx=0x7fc528010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.620 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.610+0000 7fc525ffb700 1 -- 172.21.15.158:0/1512259410 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fc5280047b0 con 0x7fc5300ac2d0 2019-12-05T03:50:14.620 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.610+0000 7fc525ffb700 1 --2- 172.21.15.158:0/1512259410 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fc51003ac40 0x7fc51003d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:14.620 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.610+0000 7fc525ffb700 1 -- 172.21.15.158:0/1512259410 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fc52804b2e0 con 0x7fc5300ac2d0 2019-12-05T03:50:14.621 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.610+0000 7fc534b07700 1 --2- 172.21.15.158:0/1512259410 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fc51003ac40 0x7fc51003d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:14.621 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.610+0000 7fc534b07700 1 --2- 172.21.15.158:0/1512259410 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fc51003ac40 0x7fc51003d150 crc :-1 s=READY pgs=92 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:14.621 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.618+0000 7fc536d6b700 1 -- 172.21.15.158:0/1512259410 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5300554e0 con 0x7fc5300ac2d0 2019-12-05T03:50:14.629 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.626+0000 7fc535308700 1 --2- 172.21.15.158:0/1512259410 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc5300ac2d0 0x7fc53013cdb0 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fc528001dd0 tx=0x7fc528010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.629 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.626+0000 7fc525ffb700 1 -- 172.21.15.158:0/1512259410 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fc5280322a0 con 0x7fc5300ac2d0 2019-12-05T03:50:14.787 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.782+0000 7fc536d6b700 1 -- 172.21.15.158:0/1512259410 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7fc530066940 con 0x7fc5300ac2d0 2019-12-05T03:50:14.788 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.786+0000 7fc535308700 1 --2- 172.21.15.158:0/1512259410 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc5300ac2d0 0x7fc53013cdb0 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fc528001dd0 tx=0x7fc528010e10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.788 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.786+0000 7fc525ffb700 1 -- 172.21.15.158:0/1512259410 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7fc528032500 con 0x7fc5300ac2d0 2019-12-05T03:50:14.790 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:50:14.793 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.790+0000 7fc536d6b700 1 -- 172.21.15.158:0/1512259410 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fc51003ac40 msgr2=0x7fc51003d150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:14.793 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.790+0000 7fc536d6b700 1 --2- 172.21.15.158:0/1512259410 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fc51003ac40 0x7fc51003d150 crc :-1 s=READY pgs=92 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:14.793 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.790+0000 7fc536d6b700 1 -- 172.21.15.158:0/1512259410 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc5300ac2d0 msgr2=0x7fc53013cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:14.794 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.790+0000 7fc536d6b700 1 --2- 172.21.15.158:0/1512259410 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc5300ac2d0 0x7fc53013cdb0 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7fc528001dd0 tx=0x7fc528010e10).stop 2019-12-05T03:50:14.794 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.790+0000 7fc536d6b700 1 -- 172.21.15.158:0/1512259410 shutdown_connections 2019-12-05T03:50:14.794 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.790+0000 7fc536d6b700 1 --2- 172.21.15.158:0/1512259410 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fc51003ac40 0x7fc51003d150 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:14.794 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.790+0000 7fc536d6b700 1 --2- 172.21.15.158:0/1512259410 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc5300ac2d0 0x7fc53013cdb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:14.794 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.790+0000 7fc536d6b700 1 --2- 172.21.15.158:0/1512259410 >> v2:172.21.15.96:3300/0 conn(0x7fc5300ae470 0x7fc53007b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:14.794 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.790+0000 7fc536d6b700 1 -- 172.21.15.158:0/1512259410 shutdown_connections 2019-12-05T03:50:14.795 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.790+0000 7fc536d6b700 1 -- 172.21.15.158:0/1512259410 wait complete. 2019-12-05T03:50:14.795 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.790+0000 7fc536d6b700 1 -- 172.21.15.158:0/1512259410 >> 172.21.15.158:0/1512259410 conn(0x7fc5300b6840 msgr2=0x7fc53009a320 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:14.803 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-12-05T03:50:14.804 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-12-05T03:50:14.912 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.902+0000 7fa27b5dc700 1 Processor -- start 2019-12-05T03:50:14.912 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.902+0000 7fa27b5dc700 1 -- start start 2019-12-05T03:50:14.912 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.902+0000 7fa27b5dc700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa27409cf60 0x7fa27409a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:14.913 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.902+0000 7fa27b5dc700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa27405a740 0x7fa274151460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:14.913 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.902+0000 7fa27b5dc700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2740accb0 con 0x7fa2741519b0 2019-12-05T03:50:14.913 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.902+0000 7fa27b5dc700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2740b1730 con 0x7fa27405a740 2019-12-05T03:50:14.913 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.902+0000 7fa27b5dc700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2740b19d0 con 0x7fa27409cf60 2019-12-05T03:50:14.913 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.902+0000 7fa27a37a700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fa2741519b0 0x7fa2740b52e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48772/0 (socket says 172.21.15.158:48772) 2019-12-05T03:50:14.913 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.902+0000 7fa27a37a700 1 -- 172.21.15.158:0/2548966266 learned_addr learned my addr 172.21.15.158:0/2548966266 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:14.914 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.902+0000 7fa279b79700 1 --2- 172.21.15.158:0/2548966266 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa27409cf60 0x7fa27409a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:14.914 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.902+0000 7fa279378700 1 --2- 172.21.15.158:0/2548966266 >> v2:172.21.15.96:3300/0 conn(0x7fa27405a740 0x7fa274151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:14.914 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.902+0000 7fa278b77700 1 -- 172.21.15.158:0/2548966266 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3697148655 0 0) 0x7fa2740accb0 con 0x7fa2741519b0 2019-12-05T03:50:14.914 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.902+0000 7fa278b77700 1 -- 172.21.15.158:0/2548966266 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2600030b0 con 0x7fa2741519b0 2019-12-05T03:50:14.914 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.902+0000 7fa278b77700 1 -- 172.21.15.158:0/2548966266 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3440971126 0 0) 0x7fa2600030b0 con 0x7fa2741519b0 2019-12-05T03:50:14.915 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.902+0000 7fa278b77700 1 -- 172.21.15.158:0/2548966266 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa27409cf60 msgr2=0x7fa27409a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:14.915 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.902+0000 7fa278b77700 1 --2- 172.21.15.158:0/2548966266 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa27409cf60 0x7fa27409a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:14.915 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.902+0000 7fa278b77700 1 -- 172.21.15.158:0/2548966266 >> v2:172.21.15.96:3300/0 conn(0x7fa27405a740 msgr2=0x7fa274151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:14.915 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.902+0000 7fa278b77700 1 --2- 172.21.15.158:0/2548966266 >> v2:172.21.15.96:3300/0 conn(0x7fa27405a740 0x7fa274151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:14.915 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.902+0000 7fa278b77700 1 -- 172.21.15.158:0/2548966266 --> v1:172.21.15.158:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa27405ab70 con 0x7fa2741519b0 2019-12-05T03:50:14.916 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.902+0000 7fa278b77700 1 -- 172.21.15.158:0/2548966266 <== mon.1 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 828730332 0 0) 0x7fa26c001ad0 con 0x7fa2741519b0 2019-12-05T03:50:14.916 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.902+0000 7fa278b77700 1 -- 172.21.15.158:0/2548966266 >> v1:172.21.15.158:6789/0 conn(0x7fa2741519b0 legacy=0x7fa2740b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:14.916 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.902+0000 7fa278b77700 1 --2- 172.21.15.158:0/2548966266 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa260003710 0x7fa260003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:14.916 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.902+0000 7fa278b77700 1 --2- 172.21.15.158:0/2548966266 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa260004420 0x7fa260004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:14.916 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.902+0000 7fa278b77700 1 --2- 172.21.15.158:0/2548966266 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa260004da0 0x7fa26004f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:14.917 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.902+0000 7fa278b77700 1 -- 172.21.15.158:0/2548966266 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2740b1730 con 0x7fa260004da0 2019-12-05T03:50:14.917 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.902+0000 7fa278b77700 1 -- 172.21.15.158:0/2548966266 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2740b19d0 con 0x7fa260004420 2019-12-05T03:50:14.923 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.902+0000 7fa278b77700 1 -- 172.21.15.158:0/2548966266 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26004fbd0 con 0x7fa260003710 2019-12-05T03:50:14.923 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.902+0000 7fa279378700 1 --2- 172.21.15.158:0/2548966266 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa260004420 0x7fa260004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:14.924 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.902+0000 7fa279b79700 1 --2- 172.21.15.158:0/2548966266 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa260003710 0x7fa260003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:14.924 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.902+0000 7fa27a37a700 1 --2- 172.21.15.158:0/2548966266 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa260004da0 0x7fa26004f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:14.924 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.902+0000 7fa279378700 1 -- 172.21.15.158:0/2548966266 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa260003710 msgr2=0x7fa260003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:14.924 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.902+0000 7fa279378700 1 --2- 172.21.15.158:0/2548966266 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa260003710 0x7fa260003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:14.924 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.902+0000 7fa279378700 1 -- 172.21.15.158:0/2548966266 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa260004da0 msgr2=0x7fa26004f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:14.924 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.902+0000 7fa279378700 1 --2- 172.21.15.158:0/2548966266 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa260004da0 0x7fa26004f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:14.925 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.902+0000 7fa279378700 1 -- 172.21.15.158:0/2548966266 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa26004fdf0 con 0x7fa260004420 2019-12-05T03:50:14.925 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.902+0000 7fa279378700 1 --2- 172.21.15.158:0/2548966266 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa260004420 0x7fa260004850 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa270002f30 tx=0x7fa27000ffe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.925 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.902+0000 7fa279378700 1 --2- 172.21.15.158:0/2548966266 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa260004420 0x7fa260004850 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa270002f30 tx=0x7fa27000ffe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.925 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.902+0000 7fa279378700 1 --2- 172.21.15.158:0/2548966266 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa260004420 0x7fa260004850 secure :-1 s=READY pgs=174 cs=0 l=1 rx=0x7fa270002f30 tx=0x7fa27000ffe0).ready entity=mon.1 client_cookie=f64a806c514473a2 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:14.925 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.906+0000 7fa279378700 1 --2- 172.21.15.158:0/2548966266 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa260004420 0x7fa260004850 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7fa270002f30 tx=0x7fa27000ffe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.925 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.906+0000 7fa278b77700 1 -- 172.21.15.158:0/2548966266 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa270010d10 con 0x7fa260004420 2019-12-05T03:50:14.925 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.906+0000 7fa279378700 1 --2- 172.21.15.158:0/2548966266 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa260004420 0x7fa260004850 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7fa270002f30 tx=0x7fa27000ffe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.926 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.906+0000 7fa279378700 1 --2- 172.21.15.158:0/2548966266 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa260004420 0x7fa260004850 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7fa270002f30 tx=0x7fa27000ffe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.926 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.906+0000 7fa278b77700 1 -- 172.21.15.158:0/2548966266 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa270010930 con 0x7fa260004420 2019-12-05T03:50:14.926 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.906+0000 7fa278b77700 1 -- 172.21.15.158:0/2548966266 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa270008bd0 con 0x7fa260004420 2019-12-05T03:50:14.926 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.906+0000 7fa27b5dc700 1 -- 172.21.15.158:0/2548966266 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa260004420 msgr2=0x7fa260004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:14.926 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.906+0000 7fa27b5dc700 1 --2- 172.21.15.158:0/2548966266 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa260004420 0x7fa260004850 secure :-1 s=READY pgs=174 cs=0 l=1 rx=0x7fa270002f30 tx=0x7fa27000ffe0).stop 2019-12-05T03:50:14.926 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.906+0000 7fa27a37a700 1 -- 172.21.15.158:0/2548966266 reap_dead start 2019-12-05T03:50:14.926 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.906+0000 7fa27b5dc700 1 -- 172.21.15.158:0/2548966266 shutdown_connections 2019-12-05T03:50:14.927 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.906+0000 7fa27b5dc700 1 -- 172.21.15.158:0/2548966266 shutdown_connections 2019-12-05T03:50:14.927 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.906+0000 7fa27b5dc700 1 -- 172.21.15.158:0/2548966266 wait complete. 2019-12-05T03:50:14.927 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.906+0000 7fa27b5dc700 1 -- 172.21.15.158:0/2548966266 >> 172.21.15.158:0/2548966266 conn(0x7fa2740b7e60 msgr2=0x7fa2740b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:14.927 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.906+0000 7fa27b5dc700 1 Processor -- start 2019-12-05T03:50:14.927 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.906+0000 7fa27b5dc700 1 -- start start 2019-12-05T03:50:14.928 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.910+0000 7fa27b5dc700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa2740acfc0 0x7fa2740b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:14.928 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.910+0000 7fa27b5dc700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa2740b22f0 0x7fa274140fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:14.928 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.910+0000 7fa27b5dc700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2740ae3f0 con 0x7fa27407e300 2019-12-05T03:50:14.928 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.910+0000 7fa27b5dc700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa27413e9f0 con 0x7fa2740acfc0 2019-12-05T03:50:14.928 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.910+0000 7fa27b5dc700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2740ad4d0 con 0x7fa2740b22f0 2019-12-05T03:50:14.928 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.910+0000 7fa279b79700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa2740acfc0 0x7fa2740b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:14.928 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.910+0000 7fa279b79700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa2740acfc0 0x7fa2740b1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54000/0 (socket says 172.21.15.158:54000) 2019-12-05T03:50:14.929 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.910+0000 7fa279b79700 1 -- 172.21.15.158:0/325491609 learned_addr learned my addr 172.21.15.158:0/325491609 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:14.929 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.910+0000 7fa279378700 1 --2- 172.21.15.158:0/325491609 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa2740b22f0 0x7fa274140fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:14.931 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.910+0000 7fa279b79700 1 -- 172.21.15.158:0/325491609 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa2740b22f0 msgr2=0x7fa274140fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:14.931 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.910+0000 7fa279b79700 1 --2- 172.21.15.158:0/325491609 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa2740b22f0 0x7fa274140fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:14.932 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.910+0000 7fa279b79700 1 -- 172.21.15.158:0/325491609 >> v1:172.21.15.158:6789/0 conn(0x7fa27407e300 legacy=0x7fa2741414f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:14.932 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.910+0000 7fa279b79700 1 -- 172.21.15.158:0/325491609 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa274141cf0 con 0x7fa2740acfc0 2019-12-05T03:50:14.932 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.910+0000 7fa279b79700 1 --2- 172.21.15.158:0/325491609 >> v2:172.21.15.158:3300/0 conn(0x7fa2740acfc0 0x7fa2740b1da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa2740ad690 tx=0x7fa264010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.932 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.910+0000 7fa279b79700 1 --2- 172.21.15.158:0/325491609 >> v2:172.21.15.158:3300/0 conn(0x7fa2740acfc0 0x7fa2740b1da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa2740ad690 tx=0x7fa264010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.932 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.910+0000 7fa279b79700 1 --2- 172.21.15.158:0/325491609 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa2740acfc0 0x7fa2740b1da0 secure :-1 s=READY pgs=176 cs=0 l=1 rx=0x7fa2740ad690 tx=0x7fa264010bc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:14.932 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.910+0000 7fa279b79700 1 --2- 172.21.15.158:0/325491609 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa2740acfc0 0x7fa2740b1da0 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7fa2740ad690 tx=0x7fa264010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.932 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.910+0000 7fa26a7fc700 1 -- 172.21.15.158:0/325491609 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa264005930 con 0x7fa2740acfc0 2019-12-05T03:50:14.933 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.910+0000 7fa279b79700 1 --2- 172.21.15.158:0/325491609 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa2740acfc0 0x7fa2740b1da0 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7fa2740ad690 tx=0x7fa264010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.933 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.910+0000 7fa279b79700 1 --2- 172.21.15.158:0/325491609 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa2740acfc0 0x7fa2740b1da0 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7fa2740ad690 tx=0x7fa264010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.933 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.910+0000 7fa26a7fc700 1 -- 172.21.15.158:0/325491609 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa264007160 con 0x7fa2740acfc0 2019-12-05T03:50:14.933 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.910+0000 7fa27b5dc700 1 -- 172.21.15.158:0/325491609 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2740adcb0 con 0x7fa2740acfc0 2019-12-05T03:50:14.933 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.910+0000 7fa26a7fc700 1 -- 172.21.15.158:0/325491609 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa264008260 con 0x7fa2740acfc0 2019-12-05T03:50:14.933 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.910+0000 7fa27b5dc700 1 -- 172.21.15.158:0/325491609 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2740b00b0 con 0x7fa2740acfc0 2019-12-05T03:50:14.934 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.910+0000 7fa279b79700 1 --2- 172.21.15.158:0/325491609 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa2740acfc0 0x7fa2740b1da0 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7fa2740ad690 tx=0x7fa264010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.934 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.910+0000 7fa26a7fc700 1 -- 172.21.15.158:0/325491609 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fa264008570 con 0x7fa2740acfc0 2019-12-05T03:50:14.934 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.910+0000 7fa279b79700 1 --2- 172.21.15.158:0/325491609 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa2740acfc0 0x7fa2740b1da0 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7fa2740ad690 tx=0x7fa264010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.934 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.910+0000 7fa26a7fc700 1 --2- 172.21.15.158:0/325491609 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa25c03ad20 0x7fa25c03d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:14.934 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.910+0000 7fa26a7fc700 1 -- 172.21.15.158:0/325491609 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fa26404b750 con 0x7fa2740acfc0 2019-12-05T03:50:14.934 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.914+0000 7fa279378700 1 --2- 172.21.15.158:0/325491609 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa25c03ad20 0x7fa25c03d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:14.935 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.914+0000 7fa279378700 1 --2- 172.21.15.158:0/325491609 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa25c03ad20 0x7fa25c03d230 crc :-1 s=READY pgs=93 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:14.935 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.918+0000 7fa27b5dc700 1 -- 172.21.15.158:0/325491609 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2740554e0 con 0x7fa2740acfc0 2019-12-05T03:50:14.935 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.922+0000 7fa279b79700 1 --2- 172.21.15.158:0/325491609 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa2740acfc0 0x7fa2740b1da0 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7fa2740ad690 tx=0x7fa264010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:14.935 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:14.922+0000 7fa26a7fc700 1 -- 172.21.15.158:0/325491609 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fa264032a30 con 0x7fa2740acfc0 2019-12-05T03:50:15.093 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:15.090+0000 7fa27b5dc700 1 -- 172.21.15.158:0/325491609 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa274066940 con 0x7fa2740acfc0 2019-12-05T03:50:15.095 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:15.090+0000 7fa279b79700 1 --2- 172.21.15.158:0/325491609 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa2740acfc0 0x7fa2740b1da0 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7fa2740ad690 tx=0x7fa264010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:15.095 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:15.090+0000 7fa26a7fc700 1 -- 172.21.15.158:0/325491609 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2105 (secure 0 0 0) 0x7fa2640335e0 con 0x7fa2740acfc0 2019-12-05T03:50:15.095 INFO:teuthology.orchestra.run.smithi158.stderr:dumped fsmap epoch 6 2019-12-05T03:50:15.096 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:15.096 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4339,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.158:6833/1485705503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":1485705503},{"type":"v1","addr":"172.21.15.158:6833","nonce":1485705503}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-12-05T03:50:01.249656+0000","modified":"2019-12-05T03:50:09.365441+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"b","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6835/3636871068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":3636871068},{"type":"v1","addr":"172.21.15.96:6835","nonce":3636871068}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2019-12-05T03:50:15.098 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:15.094+0000 7fa27b5dc700 1 -- 172.21.15.158:0/325491609 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa25c03ad20 msgr2=0x7fa25c03d230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:15.098 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:15.094+0000 7fa27b5dc700 1 --2- 172.21.15.158:0/325491609 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa25c03ad20 0x7fa25c03d230 crc :-1 s=READY pgs=93 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:15.098 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:15.094+0000 7fa27b5dc700 1 -- 172.21.15.158:0/325491609 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa2740acfc0 msgr2=0x7fa2740b1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:15.099 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:15.094+0000 7fa27b5dc700 1 --2- 172.21.15.158:0/325491609 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa2740acfc0 0x7fa2740b1da0 secure :-1 s=READY pgs=176 cs=0 l=1 rx=0x7fa2740ad690 tx=0x7fa264010bc0).stop 2019-12-05T03:50:15.099 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:15.094+0000 7fa27b5dc700 1 -- 172.21.15.158:0/325491609 shutdown_connections 2019-12-05T03:50:15.099 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:15.094+0000 7fa27b5dc700 1 --2- 172.21.15.158:0/325491609 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa25c03ad20 0x7fa25c03d230 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:15.099 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:15.094+0000 7fa27b5dc700 1 --2- 172.21.15.158:0/325491609 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa2740acfc0 0x7fa2740b1da0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:15.099 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:15.094+0000 7fa27b5dc700 1 --2- 172.21.15.158:0/325491609 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa2740b22f0 0x7fa274140fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:15.099 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:15.094+0000 7fa27b5dc700 1 -- 172.21.15.158:0/325491609 shutdown_connections 2019-12-05T03:50:15.100 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:15.094+0000 7fa27b5dc700 1 -- 172.21.15.158:0/325491609 wait complete. 2019-12-05T03:50:15.100 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:15.094+0000 7fa27b5dc700 1 -- 172.21.15.158:0/325491609 >> 172.21.15.158:0/325491609 conn(0x7fa274155320 msgr2=0x7fa2740b52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:15.313 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4241}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 6, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [3], u'info': {u'gid_4241': {u'export_targets': [], u'name': u'b', u'incarnation': 5, u'state_seq': 3, u'state': u'up:active', u'gid': 4241, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 3636871068, u'type': u'v2', u'addr': u'172.21.15.96:6834'}, {u'nonce': 3636871068, u'type': u'v1', u'addr': u'172.21.15.96:6835'}]}, u'addr': u'172.21.15.96:6835/3636871068'}}, u'fs_name': u'cephfs', u'created': u'2019-12-05T03:50:01.249656+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-12-05T03:50:09.365441+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-12-05T03:50:15.314 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-12-05T03:50:15.314 INFO:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2019-12-05T03:50:15.417 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2019-12-05T03:50:15.417 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_fsid": "a91186ae-f496-4de1-918d-820c55ff1feb", 2019-12-05T03:50:15.417 INFO:teuthology.orchestra.run.smithi096.stdout: "whoami": 0, 2019-12-05T03:50:15.418 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 4241, 2019-12-05T03:50:15.418 INFO:teuthology.orchestra.run.smithi096.stdout: "want_state": "up:active", 2019-12-05T03:50:15.418 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "up:active", 2019-12-05T03:50:15.418 INFO:teuthology.orchestra.run.smithi096.stdout: "rank_uptime": 7.0447966690000001, 2019-12-05T03:50:15.418 INFO:teuthology.orchestra.run.smithi096.stdout: "mdsmap_epoch": 6, 2019-12-05T03:50:15.418 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch": 23, 2019-12-05T03:50:15.418 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch_barrier": 23, 2019-12-05T03:50:15.419 INFO:teuthology.orchestra.run.smithi096.stdout: "uptime": 11.760934741 2019-12-05T03:50:15.419 INFO:teuthology.orchestra.run.smithi096.stdout:} 2019-12-05T03:50:15.419 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "a91186ae-f496-4de1-918d-820c55ff1feb", "whoami": 0, "id": 4241, "want_state": "up:active", "state": "up:active", "rank_uptime": 7.0447966690000001, "mdsmap_epoch": 6, "osdmap_epoch": 23, "osdmap_epoch_barrier": 23, "uptime": 11.760934741 } 2019-12-05T03:50:15.419 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2019-12-05T03:50:15.419 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2019-12-05T03:50:15.420 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi158.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2019-12-05T03:50:15.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:15.420 INFO:teuthology.orchestra.run.smithi158:> mkdir -- /home/ubuntu/cephtest/mnt.1 2019-12-05T03:50:15.432 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:15.433 INFO:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2019-12-05T03:50:15.511 DEBUG:teuthology.orchestra.run:got remote process result: 32 2019-12-05T03:50:15.516 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2019-12-05T03:50:15.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:15.517 INFO:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2019-12-05T03:50:15.589 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2019-12-05T03:50:15.590 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1 2019-12-05T03:50:15.657 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:15.657 INFO:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2019-12-05T03:50:15.675 DEBUG:teuthology.orchestra.run:got remote process result: 32 2019-12-05T03:50:15.677 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2019-12-05T03:50:15.677 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:15.677 INFO:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2019-12-05T03:50:15.711 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:2019-12-05T03:50:15.706+0000 7f1d855e5f40 -1 init, newargv = 0x55654655ffa0 newargc=7ceph-fuse[ 2019-12-05T03:50:15.711 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:14316]: starting ceph client 2019-12-05T03:50:15.720 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi158.stderr:ceph-fuse[14316]: starting fuse 2019-12-05T03:50:15.748 INFO:teuthology.orchestra.run.smithi158.stdout:49 2019-12-05T03:50:15.748 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2019-12-05T03:50:15.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:15.749 INFO:teuthology.orchestra.run.smithi158:> sudo python2 -c ' 2019-12-05T03:50:15.749 INFO:teuthology.orchestra.run.smithi158:> import glob 2019-12-05T03:50:15.749 INFO:teuthology.orchestra.run.smithi158:> import re 2019-12-05T03:50:15.749 INFO:teuthology.orchestra.run.smithi158:> import os 2019-12-05T03:50:15.749 INFO:teuthology.orchestra.run.smithi158:> import subprocess 2019-12-05T03:50:15.749 INFO:teuthology.orchestra.run.smithi158:> 2019-12-05T03:50:15.749 INFO:teuthology.orchestra.run.smithi158:> def find_socket(client_name): 2019-12-05T03:50:15.750 INFO:teuthology.orchestra.run.smithi158:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2019-12-05T03:50:15.750 INFO:teuthology.orchestra.run.smithi158:> files = glob.glob(asok_path) 2019-12-05T03:50:15.750 INFO:teuthology.orchestra.run.smithi158:> 2019-12-05T03:50:15.750 INFO:teuthology.orchestra.run.smithi158:> # Given a non-glob path, it better be there 2019-12-05T03:50:15.750 INFO:teuthology.orchestra.run.smithi158:> if "*" not in asok_path: 2019-12-05T03:50:15.750 INFO:teuthology.orchestra.run.smithi158:> assert(len(files) == 1) 2019-12-05T03:50:15.750 INFO:teuthology.orchestra.run.smithi158:> return files[0] 2019-12-05T03:50:15.750 INFO:teuthology.orchestra.run.smithi158:> 2019-12-05T03:50:15.751 INFO:teuthology.orchestra.run.smithi158:> for f in files: 2019-12-05T03:50:15.751 INFO:teuthology.orchestra.run.smithi158:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2019-12-05T03:50:15.751 INFO:teuthology.orchestra.run.smithi158:> if os.path.exists("/proc/{0}".format(pid)): 2019-12-05T03:50:15.751 INFO:teuthology.orchestra.run.smithi158:> return f 2019-12-05T03:50:15.751 INFO:teuthology.orchestra.run.smithi158:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2019-12-05T03:50:15.751 INFO:teuthology.orchestra.run.smithi158:> 2019-12-05T03:50:15.751 INFO:teuthology.orchestra.run.smithi158:> print(find_socket("client.1")) 2019-12-05T03:50:15.751 INFO:teuthology.orchestra.run.smithi158:> ' 2019-12-05T03:50:15.852 INFO:teuthology.orchestra.run.smithi158.stdout:/var/run/ceph/ceph-client.1.14316.asok 2019-12-05T03:50:15.852 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14316.asok 2019-12-05T03:50:15.852 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:15.853 INFO:teuthology.orchestra.run.smithi158:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14316.asok status 2019-12-05T03:50:16.036 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2019-12-05T03:50:16.036 INFO:teuthology.orchestra.run.smithi158.stdout: "metadata": { 2019-12-05T03:50:16.036 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_sha1": "c5290805033483ba0cec165c06bde07dae5f19ec", 2019-12-05T03:50:16.037 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_version": "ceph version 15.0.0-8014-gc529080 (c5290805033483ba0cec165c06bde07dae5f19ec) octopus (dev)", 2019-12-05T03:50:16.037 INFO:teuthology.orchestra.run.smithi158.stdout: "entity_id": "1", 2019-12-05T03:50:16.037 INFO:teuthology.orchestra.run.smithi158.stdout: "hostname": "smithi158", 2019-12-05T03:50:16.037 INFO:teuthology.orchestra.run.smithi158.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2019-12-05T03:50:16.037 INFO:teuthology.orchestra.run.smithi158.stdout: "pid": "14316", 2019-12-05T03:50:16.037 INFO:teuthology.orchestra.run.smithi158.stdout: "root": "/" 2019-12-05T03:50:16.037 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:16.038 INFO:teuthology.orchestra.run.smithi158.stdout: "dentry_count": 0, 2019-12-05T03:50:16.038 INFO:teuthology.orchestra.run.smithi158.stdout: "dentry_pinned_count": 0, 2019-12-05T03:50:16.038 INFO:teuthology.orchestra.run.smithi158.stdout: "id": 4611, 2019-12-05T03:50:16.038 INFO:teuthology.orchestra.run.smithi158.stdout: "inst": { 2019-12-05T03:50:16.038 INFO:teuthology.orchestra.run.smithi158.stdout: "name": { 2019-12-05T03:50:16.038 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "client", 2019-12-05T03:50:16.038 INFO:teuthology.orchestra.run.smithi158.stdout: "num": 4611 2019-12-05T03:50:16.039 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:16.039 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": { 2019-12-05T03:50:16.039 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:50:16.039 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:0", 2019-12-05T03:50:16.039 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 3937515371 2019-12-05T03:50:16.039 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:16.039 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:16.040 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": { 2019-12-05T03:50:16.040 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:50:16.040 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:0", 2019-12-05T03:50:16.040 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 3937515371 2019-12-05T03:50:16.040 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:16.040 INFO:teuthology.orchestra.run.smithi158.stdout: "inst_str": "client.4611 172.21.15.158:0/3937515371", 2019-12-05T03:50:16.041 INFO:teuthology.orchestra.run.smithi158.stdout: "addr_str": "172.21.15.158:0/3937515371", 2019-12-05T03:50:16.041 INFO:teuthology.orchestra.run.smithi158.stdout: "inode_count": 1, 2019-12-05T03:50:16.041 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_epoch": 6, 2019-12-05T03:50:16.041 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_epoch": 23, 2019-12-05T03:50:16.041 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_epoch_barrier": 0, 2019-12-05T03:50:16.041 INFO:teuthology.orchestra.run.smithi158.stdout: "blacklisted": false 2019-12-05T03:50:16.042 INFO:teuthology.orchestra.run.smithi158.stdout:} 2019-12-05T03:50:16.042 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-05T03:50:16.165 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.142+0000 7fca16c1a700 1 Processor -- start 2019-12-05T03:50:16.165 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.142+0000 7fca16c1a700 1 -- start start 2019-12-05T03:50:16.165 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca16c1a700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fca1005a740 0x7fca10155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:16.165 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca16c1a700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca100accb0 con 0x7fca1009cf60 2019-12-05T03:50:16.166 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca16c1a700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca10156100 con 0x7fca1009a320 2019-12-05T03:50:16.166 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca16c1a700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca1009a750 con 0x7fca1005a740 2019-12-05T03:50:16.166 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca149b6700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fca1009a320 0x7fca101553b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48802/0 (socket says 172.21.15.158:48802) 2019-12-05T03:50:16.166 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca149b6700 1 -- 172.21.15.158:0/2268092553 learned_addr learned my addr 172.21.15.158:0/2268092553 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:16.167 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca159b8700 1 --2- 172.21.15.158:0/2268092553 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fca1005a740 0x7fca10155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:16.167 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca07fff700 1 -- 172.21.15.158:0/2268092553 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4279759794 0 0) 0x7fca10156100 con 0x7fca1009a320 2019-12-05T03:50:16.167 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca07fff700 1 -- 172.21.15.158:0/2268092553 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9fc0030b0 con 0x7fca1009a320 2019-12-05T03:50:16.167 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca07fff700 1 -- 172.21.15.158:0/2268092553 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2483068664 0 0) 0x7fc9fc0030b0 con 0x7fca1009a320 2019-12-05T03:50:16.168 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca07fff700 1 -- 172.21.15.158:0/2268092553 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fca1005a740 msgr2=0x7fca10155bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:16.168 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca07fff700 1 --2- 172.21.15.158:0/2268092553 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fca1005a740 0x7fca10155bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:16.168 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca07fff700 1 -- 172.21.15.158:0/2268092553 >> v1:172.21.15.96:6789/0 conn(0x7fca1009cf60 legacy=0x7fca10151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:16.168 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca07fff700 1 -- 172.21.15.158:0/2268092553 --> v1:172.21.15.158:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca1005ab70 con 0x7fca1009a320 2019-12-05T03:50:16.169 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca07fff700 1 -- 172.21.15.158:0/2268092553 <== mon.1 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 828730332 0 0) 0x7fca00001750 con 0x7fca1009a320 2019-12-05T03:50:16.169 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca07fff700 1 -- 172.21.15.158:0/2268092553 >> v1:172.21.15.158:6789/0 conn(0x7fca1009a320 legacy=0x7fca101553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:16.169 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca07fff700 1 --2- 172.21.15.158:0/2268092553 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc9fc003710 0x7fc9fc003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:16.169 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca07fff700 1 --2- 172.21.15.158:0/2268092553 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9fc004420 0x7fc9fc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:16.169 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca07fff700 1 --2- 172.21.15.158:0/2268092553 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9fc004da0 0x7fc9fc00b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:16.170 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca07fff700 1 -- 172.21.15.158:0/2268092553 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1009a750 con 0x7fc9fc004da0 2019-12-05T03:50:16.170 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca07fff700 1 -- 172.21.15.158:0/2268092553 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc0051d0 con 0x7fc9fc003710 2019-12-05T03:50:16.171 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca07fff700 1 -- 172.21.15.158:0/2268092553 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9fc04fbd0 con 0x7fc9fc004420 2019-12-05T03:50:16.171 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca151b7700 1 --2- 172.21.15.158:0/2268092553 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc9fc003710 0x7fc9fc003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:16.172 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca149b6700 1 --2- 172.21.15.158:0/2268092553 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9fc004420 0x7fc9fc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:16.172 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca159b8700 1 --2- 172.21.15.158:0/2268092553 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9fc004da0 0x7fc9fc00b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:16.172 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca149b6700 1 -- 172.21.15.158:0/2268092553 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc9fc003710 msgr2=0x7fc9fc003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:16.172 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca149b6700 1 --2- 172.21.15.158:0/2268092553 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc9fc003710 0x7fc9fc003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:16.173 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca149b6700 1 -- 172.21.15.158:0/2268092553 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9fc004da0 msgr2=0x7fc9fc00b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:16.173 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca149b6700 1 --2- 172.21.15.158:0/2268092553 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9fc004da0 0x7fc9fc00b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:16.173 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca149b6700 1 -- 172.21.15.158:0/2268092553 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9fc04fe50 con 0x7fc9fc004420 2019-12-05T03:50:16.174 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca151b7700 1 --2- 172.21.15.158:0/2268092553 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc9fc003710 0x7fc9fc003b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:50:16.174 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca149b6700 1 --2- 172.21.15.158:0/2268092553 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9fc004420 0x7fc9fc004850 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fca00001950 tx=0x7fca0000c210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.174 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca149b6700 1 --2- 172.21.15.158:0/2268092553 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9fc004420 0x7fc9fc004850 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fca00001950 tx=0x7fca0000c210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.174 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca149b6700 1 --2- 172.21.15.158:0/2268092553 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9fc004420 0x7fc9fc004850 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7fca00001950 tx=0x7fca0000c210).ready entity=mon.2 client_cookie=ee48159043e2b22d server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:16.174 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca149b6700 1 --2- 172.21.15.158:0/2268092553 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9fc004420 0x7fc9fc004850 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fca00001950 tx=0x7fca0000c210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.175 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca07fff700 1 -- 172.21.15.158:0/2268092553 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca0000ed60 con 0x7fc9fc004420 2019-12-05T03:50:16.175 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca149b6700 1 --2- 172.21.15.158:0/2268092553 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9fc004420 0x7fc9fc004850 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7fca00001950 tx=0x7fca0000c210).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.175 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca07fff700 1 -- 172.21.15.158:0/2268092553 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca0000e980 con 0x7fc9fc004420 2019-12-05T03:50:16.175 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca16c1a700 1 -- 172.21.15.158:0/2268092553 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9fc004420 msgr2=0x7fc9fc004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:16.176 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca16c1a700 1 --2- 172.21.15.158:0/2268092553 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9fc004420 0x7fc9fc004850 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7fca00001950 tx=0x7fca0000c210).stop 2019-12-05T03:50:16.176 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.146+0000 7fca159b8700 1 -- 172.21.15.158:0/2268092553 reap_dead start 2019-12-05T03:50:16.176 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.150+0000 7fca16c1a700 1 -- 172.21.15.158:0/2268092553 shutdown_connections 2019-12-05T03:50:16.176 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.150+0000 7fca16c1a700 1 -- 172.21.15.158:0/2268092553 shutdown_connections 2019-12-05T03:50:16.177 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.150+0000 7fca16c1a700 1 -- 172.21.15.158:0/2268092553 wait complete. 2019-12-05T03:50:16.177 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.150+0000 7fca16c1a700 1 -- 172.21.15.158:0/2268092553 >> 172.21.15.158:0/2268092553 conn(0x7fca100b7e60 msgr2=0x7fca100b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:16.177 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.150+0000 7fca16c1a700 1 Processor -- start 2019-12-05T03:50:16.177 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.150+0000 7fca16c1a700 1 -- start start 2019-12-05T03:50:16.178 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.150+0000 7fca16c1a700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fca1013bd20 0x7fca1013c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:16.178 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.150+0000 7fca16c1a700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca100654c0 con 0x7fca100b0460 2019-12-05T03:50:16.178 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.150+0000 7fca16c1a700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca1013ff00 con 0x7fca10150b60 2019-12-05T03:50:16.178 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.150+0000 7fca16c1a700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca1013f460 con 0x7fca1013bd20 2019-12-05T03:50:16.179 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.150+0000 7fca151b7700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fca10150b60 0x7fca1009a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48814/0 (socket says 172.21.15.158:48814) 2019-12-05T03:50:16.179 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.150+0000 7fca151b7700 1 -- 172.21.15.158:0/2026452852 learned_addr learned my addr 172.21.15.158:0/2026452852 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:16.179 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.150+0000 7fca149b6700 1 --2- 172.21.15.158:0/2026452852 >> v2:172.21.15.96:3300/0 conn(0x7fca1013bd20 0x7fca1013c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:16.179 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.150+0000 7fca05ffb700 1 -- 172.21.15.158:0/2026452852 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3032566008 0 0) 0x7fca1013ff00 con 0x7fca10150b60 2019-12-05T03:50:16.180 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.150+0000 7fca05ffb700 1 -- 172.21.15.158:0/2026452852 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9f00030b0 con 0x7fca10150b60 2019-12-05T03:50:16.180 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.154+0000 7fca05ffb700 1 -- 172.21.15.158:0/2026452852 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 496344502 0 0) 0x7fc9f00030b0 con 0x7fca10150b60 2019-12-05T03:50:16.180 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.154+0000 7fca05ffb700 1 -- 172.21.15.158:0/2026452852 --> v1:172.21.15.158:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fca1013ff00 con 0x7fca10150b60 2019-12-05T03:50:16.180 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.154+0000 7fca05ffb700 1 -- 172.21.15.158:0/2026452852 <== mon.1 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 828730332 0 0) 0x7fca0c0024c0 con 0x7fca10150b60 2019-12-05T03:50:16.181 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.154+0000 7fca05ffb700 1 -- 172.21.15.158:0/2026452852 >> v2:172.21.15.96:3300/0 conn(0x7fca1013bd20 msgr2=0x7fca1013c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:16.181 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.154+0000 7fca05ffb700 1 --2- 172.21.15.158:0/2026452852 >> v2:172.21.15.96:3300/0 conn(0x7fca1013bd20 0x7fca1013c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:16.181 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.154+0000 7fca05ffb700 1 -- 172.21.15.158:0/2026452852 >> v1:172.21.15.158:6789/0 conn(0x7fca10150b60 legacy=0x7fca1009a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:16.181 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.154+0000 7fca05ffb700 1 -- 172.21.15.158:0/2026452852 >> v1:172.21.15.96:6789/0 conn(0x7fca100b0460 legacy=0x7fca1013f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:16.181 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.154+0000 7fca05ffb700 1 --2- 172.21.15.158:0/2026452852 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9f00038a0 0x7fc9f0003cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:16.182 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.154+0000 7fca05ffb700 1 --2- 172.21.15.158:0/2026452852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9f0004420 0x7fc9f0004850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:16.182 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.154+0000 7fca05ffb700 1 --2- 172.21.15.158:0/2026452852 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc9f0004da0 0x7fc9f000b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:16.182 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.154+0000 7fca05ffb700 1 -- 172.21.15.158:0/2026452852 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1013f460 con 0x7fc9f0004420 2019-12-05T03:50:16.182 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.154+0000 7fca05ffb700 1 -- 172.21.15.158:0/2026452852 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f000bbc0 con 0x7fc9f0004da0 2019-12-05T03:50:16.183 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.154+0000 7fca05ffb700 1 -- 172.21.15.158:0/2026452852 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f000bdb0 con 0x7fc9f00038a0 2019-12-05T03:50:16.183 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.154+0000 7fca149b6700 1 --2- 172.21.15.158:0/2026452852 >> v2:172.21.15.96:3300/0 conn(0x7fca1013bd20 0x7fca1013c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:50:16.183 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.154+0000 7fca159b8700 1 --2- 172.21.15.158:0/2026452852 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc9f0004da0 0x7fc9f000b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:16.183 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.154+0000 7fca151b7700 1 --2- 172.21.15.158:0/2026452852 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9f00038a0 0x7fc9f0003cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:16.183 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.154+0000 7fca149b6700 1 --2- 172.21.15.158:0/2026452852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9f0004420 0x7fc9f0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:16.184 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.154+0000 7fca159b8700 1 -- 172.21.15.158:0/2026452852 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9f00038a0 msgr2=0x7fc9f0003cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:16.184 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.154+0000 7fca159b8700 1 --2- 172.21.15.158:0/2026452852 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fc9f00038a0 0x7fc9f0003cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:16.184 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.154+0000 7fca159b8700 1 -- 172.21.15.158:0/2026452852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9f0004420 msgr2=0x7fc9f0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:16.184 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.154+0000 7fca159b8700 1 --2- 172.21.15.158:0/2026452852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9f0004420 0x7fc9f0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:16.185 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.154+0000 7fca159b8700 1 -- 172.21.15.158:0/2026452852 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca10140130 con 0x7fc9f0004da0 2019-12-05T03:50:16.185 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.154+0000 7fca16c1a700 1 -- 172.21.15.158:0/2026452852 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca100b0890 con 0x7fc9f0004da0 2019-12-05T03:50:16.185 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.154+0000 7fca159b8700 1 --2- 172.21.15.158:0/2026452852 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc9f0004da0 0x7fc9f000b670 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fca080032b0 tx=0x7fca08010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.185 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.154+0000 7fca16c1a700 1 -- 172.21.15.158:0/2026452852 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca10074d00 con 0x7fc9f0004da0 2019-12-05T03:50:16.186 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.154+0000 7fca159b8700 1 -- 172.21.15.158:0/2026452852 reap_dead start 2019-12-05T03:50:16.186 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.154+0000 7fca159b8700 1 --2- 172.21.15.158:0/2026452852 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc9f0004da0 0x7fc9f000b670 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fca080032b0 tx=0x7fca08010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.186 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.154+0000 7fca159b8700 1 --2- 172.21.15.158:0/2026452852 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc9f0004da0 0x7fc9f000b670 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7fca080032b0 tx=0x7fca08010d70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:16.186 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.154+0000 7fca159b8700 1 --2- 172.21.15.158:0/2026452852 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc9f0004da0 0x7fc9f000b670 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7fca080032b0 tx=0x7fca08010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.187 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.154+0000 7fca05ffb700 1 -- 172.21.15.158:0/2026452852 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca08005ca0 con 0x7fc9f0004da0 2019-12-05T03:50:16.187 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.154+0000 7fca159b8700 1 --2- 172.21.15.158:0/2026452852 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc9f0004da0 0x7fc9f000b670 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7fca080032b0 tx=0x7fca08010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.187 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.154+0000 7fca05ffb700 1 -- 172.21.15.158:0/2026452852 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca080058c0 con 0x7fc9f0004da0 2019-12-05T03:50:16.187 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.154+0000 7fca159b8700 1 --2- 172.21.15.158:0/2026452852 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc9f0004da0 0x7fc9f000b670 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7fca080032b0 tx=0x7fca08010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.188 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.154+0000 7fca05ffb700 1 -- 172.21.15.158:0/2026452852 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca08012c80 con 0x7fc9f0004da0 2019-12-05T03:50:16.188 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.154+0000 7fca159b8700 1 --2- 172.21.15.158:0/2026452852 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc9f0004da0 0x7fc9f000b670 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7fca080032b0 tx=0x7fca08010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.188 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.154+0000 7fca05ffb700 1 -- 172.21.15.158:0/2026452852 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fca08007140 con 0x7fc9f0004da0 2019-12-05T03:50:16.189 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.154+0000 7fca159b8700 1 --2- 172.21.15.158:0/2026452852 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc9f0004da0 0x7fc9f000b670 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7fca080032b0 tx=0x7fca08010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.189 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.154+0000 7fca05ffb700 1 --2- 172.21.15.158:0/2026452852 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fc9f003e8b0 0x7fc9f0040dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:16.189 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.154+0000 7fca05ffb700 1 -- 172.21.15.158:0/2026452852 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fca0c001b60 con 0x7fc9f0004da0 2019-12-05T03:50:16.189 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.158+0000 7fca151b7700 1 --2- 172.21.15.158:0/2026452852 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fc9f003e8b0 0x7fc9f0040dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:16.190 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.158+0000 7fca151b7700 1 --2- 172.21.15.158:0/2026452852 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fc9f003e8b0 0x7fc9f0040dc0 crc :-1 s=READY pgs=94 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:16.190 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.158+0000 7fca16c1a700 1 -- 172.21.15.158:0/2026452852 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9e8003200 con 0x7fc9f0004da0 2019-12-05T03:50:16.191 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.166+0000 7fca159b8700 1 --2- 172.21.15.158:0/2026452852 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc9f0004da0 0x7fc9f000b670 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7fca080032b0 tx=0x7fca08010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.191 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.166+0000 7fca05ffb700 1 -- 172.21.15.158:0/2026452852 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fca08032280 con 0x7fc9f0004da0 2019-12-05T03:50:16.335 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.330+0000 7fca16c1a700 1 -- 172.21.15.158:0/2026452852 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9e8003640 con 0x7fc9f0004da0 2019-12-05T03:50:16.336 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.330+0000 7fca159b8700 1 --2- 172.21.15.158:0/2026452852 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc9f0004da0 0x7fc9f000b670 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7fca080032b0 tx=0x7fca08010d70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.336 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.330+0000 7fca05ffb700 1 -- 172.21.15.158:0/2026452852 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+14933 (secure 0 0 0) 0x7fca080324e0 con 0x7fc9f0004da0 2019-12-05T03:50:16.338 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:16.338 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":23,"fsid":"a91186ae-f496-4de1-918d-820c55ff1feb","created":"2019-12-05T03:49:39.187523+0000","modified":"2019-12-05T03:50:01.249305+0000","last_up_change":"2019-12-05T03:49:48.551934+0000","last_in_change":"2019-12-05T03:49:48.551934+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-05T03:49:52.900870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-12-05T03:49:55.801462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-12-05T03:49:58.659250+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"782c4258-e28c-4a11-9d54-3c9c7a36fba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":12192},{"type":"v1","addr":"172.21.15.158:6801","nonce":12192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":12192},{"type":"v1","addr":"172.21.15.158:6803","nonce":12192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":12192},{"type":"v1","addr":"172.21.15.158:6807","nonce":12192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":12192},{"type":"v1","addr":"172.21.15.158:6805","nonce":12192}]},"public_addr":"172.21.15.158:6801/12192","cluster_addr":"172.21.15.158:6803/12192","heartbeat_back_addr":"172.21.15.158:6807/12192","heartbeat_front_addr":"172.21.15.158:6805/12192","state":["exists","up"]},{"osd":1,"uuid":"d4426b21-b666-4158-bf34-a24b14572731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":12193},{"type":"v1","addr":"172.21.15.158:6809","nonce":12193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":12193},{"type":"v1","addr":"172.21.15.158:6811","nonce":12193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":12193},{"type":"v1","addr":"172.21.15.158:6815","nonce":12193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":12193},{"type":"v1","addr":"172.21.15.158:6813","nonce":12193}]},"public_addr":"172.21.15.158:6809/12193","cluster_addr":"172.21.15.158:6811/12193","heartbeat_back_addr":"172.21.15.158:6815/12193","heartbeat_front_addr":"172.21.15.158:6813/12193","state":["exists","up"]},{"osd":2,"uuid":"22680edd-6490-4ab0-bb15-0605830e4cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":12195},{"type":"v1","addr":"172.21.15.158:6825","nonce":12195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":12195},{"type":"v1","addr":"172.21.15.158:6827","nonce":12195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":12195},{"type":"v1","addr":"172.21.15.158:6831","nonce":12195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":12195},{"type":"v1","addr":"172.21.15.158:6829","nonce":12195}]},"public_addr":"172.21.15.158:6825/12195","cluster_addr":"172.21.15.158:6827/12195","heartbeat_back_addr":"172.21.15.158:6831/12195","heartbeat_front_addr":"172.21.15.158:6829/12195","state":["exists","up"]},{"osd":3,"uuid":"7ec999ee-ace8-4ccb-a4f9-6f5d313bbbd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":12194},{"type":"v1","addr":"172.21.15.158:6817","nonce":12194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":12194},{"type":"v1","addr":"172.21.15.158:6819","nonce":12194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":12194},{"type":"v1","addr":"172.21.15.158:6823","nonce":12194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":12194},{"type":"v1","addr":"172.21.15.158:6821","nonce":12194}]},"public_addr":"172.21.15.158:6817/12194","cluster_addr":"172.21.15.158:6819/12194","heartbeat_back_addr":"172.21.15.158:6823/12194","heartbeat_front_addr":"172.21.15.158:6821/12194","state":["exists","up"]},{"osd":4,"uuid":"186e69c4-b69f-4dd1-bb8f-faf759c60484","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":12460},{"type":"v1","addr":"172.21.15.96:6803","nonce":12460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":12460},{"type":"v1","addr":"172.21.15.96:6805","nonce":12460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":12460},{"type":"v1","addr":"172.21.15.96:6809","nonce":12460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":12460},{"type":"v1","addr":"172.21.15.96:6807","nonce":12460}]},"public_addr":"172.21.15.96:6803/12460","cluster_addr":"172.21.15.96:6805/12460","heartbeat_back_addr":"172.21.15.96:6809/12460","heartbeat_front_addr":"172.21.15.96:6807/12460","state":["exists","up"]},{"osd":5,"uuid":"86b658b2-8b40-4cea-8163-305a3982758b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":12461},{"type":"v1","addr":"172.21.15.96:6811","nonce":12461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":12461},{"type":"v1","addr":"172.21.15.96:6813","nonce":12461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":12461},{"type":"v1","addr":"172.21.15.96:6817","nonce":12461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":12461},{"type":"v1","addr":"172.21.15.96:6815","nonce":12461}]},"public_addr":"172.21.15.96:6811/12461","cluster_addr":"172.21.15.96:6813/12461","heartbeat_back_addr":"172.21.15.96:6817/12461","heartbeat_front_addr":"172.21.15.96:6815/12461","state":["exists","up"]},{"osd":6,"uuid":"bdadaea8-9296-4788-bc59-d9c9eb8defdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":12463},{"type":"v1","addr":"172.21.15.96:6827","nonce":12463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":12463},{"type":"v1","addr":"172.21.15.96:6829","nonce":12463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":12463},{"type":"v1","addr":"172.21.15.96:6833","nonce":12463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":12463},{"type":"v1","addr":"172.21.15.96:6831","nonce":12463}]},"public_addr":"172.21.15.96:6827/12463","cluster_addr":"172.21.15.96:6829/12463","heartbeat_back_addr":"172.21.15.96:6833/12463","heartbeat_front_addr":"172.21.15.96:6831/12463","state":["exists","up"]},{"osd":7,"uuid":"c6d71846-d68e-430f-ab72-0fb8ea4bf640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":12462},{"type":"v1","addr":"172.21.15.96:6819","nonce":12462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":12462},{"type":"v1","addr":"172.21.15.96:6821","nonce":12462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":12462},{"type":"v1","addr":"172.21.15.96:6825","nonce":12462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":12462},{"type":"v1","addr":"172.21.15.96:6823","nonce":12462}]},"public_addr":"172.21.15.96:6819/12462","cluster_addr":"172.21.15.96:6821/12462","heartbeat_back_addr":"172.21.15.96:6825/12462","heartbeat_front_addr":"172.21.15.96:6823/12462","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.875762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.900817+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.210347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.133973+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.864697+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.131015+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.237225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.154377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-05T03:50:16.340 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.334+0000 7fca16c1a700 1 -- 172.21.15.158:0/2026452852 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fc9f003e8b0 msgr2=0x7fc9f0040dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:16.341 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.334+0000 7fca16c1a700 1 --2- 172.21.15.158:0/2026452852 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fc9f003e8b0 0x7fc9f0040dc0 crc :-1 s=READY pgs=94 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:16.341 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.334+0000 7fca16c1a700 1 -- 172.21.15.158:0/2026452852 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc9f0004da0 msgr2=0x7fc9f000b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:16.341 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.334+0000 7fca16c1a700 1 --2- 172.21.15.158:0/2026452852 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc9f0004da0 0x7fc9f000b670 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7fca080032b0 tx=0x7fca08010d70).stop 2019-12-05T03:50:16.342 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.334+0000 7fca16c1a700 1 -- 172.21.15.158:0/2026452852 shutdown_connections 2019-12-05T03:50:16.342 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.334+0000 7fca16c1a700 1 --2- 172.21.15.158:0/2026452852 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fc9f003e8b0 0x7fc9f0040dc0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:16.342 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.334+0000 7fca16c1a700 1 --2- 172.21.15.158:0/2026452852 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fc9f0004da0 0x7fc9f000b670 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:16.342 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.334+0000 7fca16c1a700 1 -- 172.21.15.158:0/2026452852 shutdown_connections 2019-12-05T03:50:16.343 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.334+0000 7fca16c1a700 1 -- 172.21.15.158:0/2026452852 wait complete. 2019-12-05T03:50:16.343 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.334+0000 7fca16c1a700 1 -- 172.21.15.158:0/2026452852 >> 172.21.15.158:0/2026452852 conn(0x7fca10154080 msgr2=0x7fca10153440 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:16.356 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:49:52.900870+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:49:55.801462+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:49:58.659250+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-12-05T03:50:16.357 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-12-05T03:50:16.463 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.454+0000 7f2749c88700 1 Processor -- start 2019-12-05T03:50:16.463 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.454+0000 7f2749c88700 1 -- start start 2019-12-05T03:50:16.463 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.454+0000 7f2749c88700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f274409ba40 0x7f274409add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:16.463 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.454+0000 7f2749c88700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f27440b5370 0x7f27440b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:16.463 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.454+0000 7f2749c88700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2744099e30 con 0x7f27440b6970 2019-12-05T03:50:16.464 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.454+0000 7f2749c88700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f274409d210 con 0x7f274409ba40 2019-12-05T03:50:16.464 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.454+0000 7f2749c88700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2744099b90 con 0x7f27440b5370 2019-12-05T03:50:16.464 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.454+0000 7f2748a26700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f27440b5370 0x7f27440b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:16.464 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.454+0000 7f2743fff700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f27440b6970 0x7f274405a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48828/0 (socket says 172.21.15.158:48828) 2019-12-05T03:50:16.464 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.454+0000 7f2743fff700 1 -- 172.21.15.158:0/3661607815 learned_addr learned my addr 172.21.15.158:0/3661607815 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:16.464 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.454+0000 7f27437fe700 1 --2- 172.21.15.158:0/3661607815 >> v2:172.21.15.96:3300/0 conn(0x7f274409ba40 0x7f274409add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:16.465 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.454+0000 7f2748a26700 1 -- 172.21.15.158:0/3661607815 >> v2:172.21.15.96:3300/0 conn(0x7f274409ba40 msgr2=0x7f274409add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:16.465 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.454+0000 7f2748a26700 1 --2- 172.21.15.158:0/3661607815 >> v2:172.21.15.96:3300/0 conn(0x7f274409ba40 0x7f274409add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:16.465 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.454+0000 7f2748a26700 1 -- 172.21.15.158:0/3661607815 >> v1:172.21.15.158:6789/0 conn(0x7f27440b6970 legacy=0x7f274405a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:16.465 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.454+0000 7f2748a26700 1 -- 172.21.15.158:0/3661607815 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274407e960 con 0x7f27440b5370 2019-12-05T03:50:16.465 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.454+0000 7f2748a26700 1 --2- 172.21.15.158:0/3661607815 >> v2:172.21.15.158:3300/0 conn(0x7f27440b5370 0x7f27440b57a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f27340032b0 tx=0x7f273400fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.466 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.454+0000 7f2748a26700 1 --2- 172.21.15.158:0/3661607815 >> v2:172.21.15.158:3300/0 conn(0x7f27440b5370 0x7f27440b57a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f27340032b0 tx=0x7f273400fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.466 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.454+0000 7f2748a26700 1 --2- 172.21.15.158:0/3661607815 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f27440b5370 0x7f27440b57a0 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7f27340032b0 tx=0x7f273400fff0).ready entity=mon.1 client_cookie=d18b0685b6899a84 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:16.466 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.454+0000 7f2748a26700 1 --2- 172.21.15.158:0/3661607815 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f27440b5370 0x7f27440b57a0 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f27340032b0 tx=0x7f273400fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.466 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.454+0000 7f2742ffd700 1 -- 172.21.15.158:0/3661607815 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27340108c0 con 0x7f27440b5370 2019-12-05T03:50:16.466 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.454+0000 7f2748a26700 1 --2- 172.21.15.158:0/3661607815 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f27440b5370 0x7f27440b57a0 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f27340032b0 tx=0x7f273400fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.467 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.454+0000 7f2742ffd700 1 -- 172.21.15.158:0/3661607815 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2734008b50 con 0x7f27440b5370 2019-12-05T03:50:16.467 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.454+0000 7f2748a26700 1 --2- 172.21.15.158:0/3661607815 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f27440b5370 0x7f27440b57a0 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f27340032b0 tx=0x7f273400fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.467 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.454+0000 7f2742ffd700 1 -- 172.21.15.158:0/3661607815 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27340110c0 con 0x7f27440b5370 2019-12-05T03:50:16.467 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.458+0000 7f2749c88700 1 -- 172.21.15.158:0/3661607815 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f27440b5370 msgr2=0x7f27440b57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:16.467 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.458+0000 7f2749c88700 1 --2- 172.21.15.158:0/3661607815 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f27440b5370 0x7f27440b57a0 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7f27340032b0 tx=0x7f273400fff0).stop 2019-12-05T03:50:16.467 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.458+0000 7f2749c88700 1 -- 172.21.15.158:0/3661607815 shutdown_connections 2019-12-05T03:50:16.468 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.458+0000 7f2749c88700 1 --2- 172.21.15.158:0/3661607815 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f27440b5370 0x7f27440b57a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:16.468 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.458+0000 7f2749c88700 1 --2- 172.21.15.158:0/3661607815 >> v2:172.21.15.96:3300/0 conn(0x7f274409ba40 0x7f274409add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:16.468 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.458+0000 7f2749c88700 1 -- 172.21.15.158:0/3661607815 shutdown_connections 2019-12-05T03:50:16.468 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.458+0000 7f2749c88700 1 -- 172.21.15.158:0/3661607815 wait complete. 2019-12-05T03:50:16.468 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.458+0000 7f2749c88700 1 -- 172.21.15.158:0/3661607815 >> 172.21.15.158:0/3661607815 conn(0x7f27440b7ef0 msgr2=0x7f27440b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:16.471 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.462+0000 7f2749c88700 1 Processor -- start 2019-12-05T03:50:16.472 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.462+0000 7f2749c88700 1 -- start start 2019-12-05T03:50:16.472 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.462+0000 7f2749c88700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f27441387b0 0x7f2744154040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:16.472 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.462+0000 7f2749c88700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f27440ae780 0x7f27440ac470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:16.472 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.462+0000 7f2749c88700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27440aebb0 con 0x7f274407b420 2019-12-05T03:50:16.472 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.462+0000 7f2749c88700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27440afd60 con 0x7f27441387b0 2019-12-05T03:50:16.472 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.462+0000 7f2749c88700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27440b1300 con 0x7f27440ae780 2019-12-05T03:50:16.473 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.462+0000 7f27437fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f27440ae780 0x7f27440ac470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:16.473 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.462+0000 7f27437fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f27440ae780 0x7f27440ac470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54056/0 (socket says 172.21.15.158:54056) 2019-12-05T03:50:16.473 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.462+0000 7f27437fe700 1 -- 172.21.15.158:0/1011135787 learned_addr learned my addr 172.21.15.158:0/1011135787 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:16.473 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.462+0000 7f2743fff700 1 --2- 172.21.15.158:0/1011135787 >> v2:172.21.15.96:3300/0 conn(0x7f27441387b0 0x7f2744154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:16.473 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.462+0000 7f27437fe700 1 -- 172.21.15.158:0/1011135787 >> v2:172.21.15.96:3300/0 conn(0x7f27441387b0 msgr2=0x7f2744154040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:16.473 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.462+0000 7f27437fe700 1 --2- 172.21.15.158:0/1011135787 >> v2:172.21.15.96:3300/0 conn(0x7f27441387b0 0x7f2744154040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:16.473 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.462+0000 7f27437fe700 1 -- 172.21.15.158:0/1011135787 >> v1:172.21.15.96:6789/0 conn(0x7f274407b420 legacy=0x7f274407b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:16.474 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.462+0000 7f27437fe700 1 -- 172.21.15.158:0/1011135787 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274413ef40 con 0x7f27440ae780 2019-12-05T03:50:16.474 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.462+0000 7f2743fff700 1 --2- 172.21.15.158:0/1011135787 >> v2:172.21.15.96:3300/0 conn(0x7f27441387b0 0x7f2744154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-12-05T03:50:16.474 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.462+0000 7f27437fe700 1 --2- 172.21.15.158:0/1011135787 >> v2:172.21.15.158:3300/0 conn(0x7f27440ae780 0x7f27440ac470 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f272c002f30 tx=0x7f272c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.474 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.462+0000 7f27437fe700 1 --2- 172.21.15.158:0/1011135787 >> v2:172.21.15.158:3300/0 conn(0x7f27440ae780 0x7f27440ac470 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f272c002f30 tx=0x7f272c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.474 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.462+0000 7f27437fe700 1 --2- 172.21.15.158:0/1011135787 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f27440ae780 0x7f27440ac470 secure :-1 s=READY pgs=185 cs=0 l=1 rx=0x7f272c002f30 tx=0x7f272c010af0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:16.474 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.462+0000 7f27437fe700 1 --2- 172.21.15.158:0/1011135787 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f27440ae780 0x7f27440ac470 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f272c002f30 tx=0x7f272c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.475 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.462+0000 7f2740ff9700 1 -- 172.21.15.158:0/1011135787 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f272c0091a0 con 0x7f27440ae780 2019-12-05T03:50:16.475 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.462+0000 7f27437fe700 1 --2- 172.21.15.158:0/1011135787 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f27440ae780 0x7f27440ac470 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f272c002f30 tx=0x7f272c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.475 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.462+0000 7f2749c88700 1 -- 172.21.15.158:0/1011135787 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27440b0000 con 0x7f27440ae780 2019-12-05T03:50:16.475 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.462+0000 7f2740ff9700 1 -- 172.21.15.158:0/1011135787 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272c009b40 con 0x7f27440ae780 2019-12-05T03:50:16.475 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.462+0000 7f27437fe700 1 --2- 172.21.15.158:0/1011135787 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f27440ae780 0x7f27440ac470 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f272c002f30 tx=0x7f272c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.476 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.462+0000 7f2740ff9700 1 -- 172.21.15.158:0/1011135787 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f272c009780 con 0x7f27440ae780 2019-12-05T03:50:16.476 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.462+0000 7f2749c88700 1 -- 172.21.15.158:0/1011135787 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27440b05b0 con 0x7f27440ae780 2019-12-05T03:50:16.476 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.462+0000 7f27437fe700 1 --2- 172.21.15.158:0/1011135787 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f27440ae780 0x7f27440ac470 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f272c002f30 tx=0x7f272c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.476 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.462+0000 7f2740ff9700 1 -- 172.21.15.158:0/1011135787 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f272c007170 con 0x7f27440ae780 2019-12-05T03:50:16.477 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.462+0000 7f27437fe700 1 --2- 172.21.15.158:0/1011135787 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f27440ae780 0x7f27440ac470 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f272c002f30 tx=0x7f272c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.477 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.462+0000 7f2740ff9700 1 --2- 172.21.15.158:0/1011135787 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f272803acd0 0x7f272803d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:16.477 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.462+0000 7f2740ff9700 1 -- 172.21.15.158:0/1011135787 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f272c04aee0 con 0x7f27440ae780 2019-12-05T03:50:16.477 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.466+0000 7f2743fff700 1 --2- 172.21.15.158:0/1011135787 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f272803acd0 0x7f272803d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:16.477 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.466+0000 7f2743fff700 1 --2- 172.21.15.158:0/1011135787 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f272803acd0 0x7f272803d1e0 crc :-1 s=READY pgs=95 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:16.477 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.466+0000 7f2749c88700 1 -- 172.21.15.158:0/1011135787 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27440554e0 con 0x7f27440ae780 2019-12-05T03:50:16.478 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.470+0000 7f27437fe700 1 --2- 172.21.15.158:0/1011135787 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f27440ae780 0x7f27440ac470 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f272c002f30 tx=0x7f272c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.478 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.470+0000 7f2740ff9700 1 -- 172.21.15.158:0/1011135787 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f272c031f40 con 0x7f27440ae780 2019-12-05T03:50:16.632 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.629+0000 7f2749c88700 1 -- 172.21.15.158:0/1011135787 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f2744066940 con 0x7f27440ae780 2019-12-05T03:50:16.633 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.629+0000 7f27437fe700 1 --2- 172.21.15.158:0/1011135787 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f27440ae780 0x7f27440ac470 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f272c002f30 tx=0x7f272c010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.633 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.629+0000 7f2740ff9700 1 -- 172.21.15.158:0/1011135787 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f272c0321a0 con 0x7f27440ae780 2019-12-05T03:50:16.634 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:50:16.637 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.629+0000 7f2749c88700 1 -- 172.21.15.158:0/1011135787 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f272803acd0 msgr2=0x7f272803d1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:16.637 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.629+0000 7f2749c88700 1 --2- 172.21.15.158:0/1011135787 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f272803acd0 0x7f272803d1e0 crc :-1 s=READY pgs=95 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:16.637 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.629+0000 7f2749c88700 1 -- 172.21.15.158:0/1011135787 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f27440ae780 msgr2=0x7f27440ac470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:16.638 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.629+0000 7f2749c88700 1 --2- 172.21.15.158:0/1011135787 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f27440ae780 0x7f27440ac470 secure :-1 s=READY pgs=185 cs=0 l=1 rx=0x7f272c002f30 tx=0x7f272c010af0).stop 2019-12-05T03:50:16.638 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.629+0000 7f2749c88700 1 -- 172.21.15.158:0/1011135787 shutdown_connections 2019-12-05T03:50:16.638 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.629+0000 7f2749c88700 1 --2- 172.21.15.158:0/1011135787 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f272803acd0 0x7f272803d1e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:16.638 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.629+0000 7f2749c88700 1 --2- 172.21.15.158:0/1011135787 >> v2:172.21.15.96:3300/0 conn(0x7f27441387b0 0x7f2744154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:16.639 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.629+0000 7f2749c88700 1 --2- 172.21.15.158:0/1011135787 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f27440ae780 0x7f27440ac470 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:16.639 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.629+0000 7f2749c88700 1 -- 172.21.15.158:0/1011135787 shutdown_connections 2019-12-05T03:50:16.639 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.629+0000 7f2749c88700 1 -- 172.21.15.158:0/1011135787 wait complete. 2019-12-05T03:50:16.639 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.629+0000 7f2749c88700 1 -- 172.21.15.158:0/1011135787 >> 172.21.15.158:0/1011135787 conn(0x7f274409bd70 msgr2=0x7f2744155200 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:16.646 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-12-05T03:50:16.752 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.741+0000 7f0a9c76d700 1 Processor -- start 2019-12-05T03:50:16.753 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.741+0000 7f0a9c76d700 1 -- start start 2019-12-05T03:50:16.753 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.745+0000 7f0a9c76d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f0a940b6970 0x7f0a9409add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:16.753 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.745+0000 7f0a9c76d700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0a9409ba40 0x7f0a9405a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:16.753 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.745+0000 7f0a9c76d700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0a9405a950 0x7f0a94155290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:16.753 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.745+0000 7f0a9c76d700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a9409d210 con 0x7f0a9409ba40 2019-12-05T03:50:16.754 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.745+0000 7f0a9c76d700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a94099b90 con 0x7f0a940b6970 2019-12-05T03:50:16.754 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.745+0000 7f0a9c76d700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a94099e30 con 0x7f0a9405a950 2019-12-05T03:50:16.754 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.745+0000 7f0a9ad0a700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f0a940b6970 0x7f0a9409add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:16.754 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.745+0000 7f0a9ad0a700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f0a940b6970 0x7f0a9409add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54062/0 (socket says 172.21.15.158:54062) 2019-12-05T03:50:16.754 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.745+0000 7f0a9ad0a700 1 -- 172.21.15.158:0/3134868108 learned_addr learned my addr 172.21.15.158:0/3134868108 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:16.755 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.745+0000 7f0a9a509700 1 --2- 172.21.15.158:0/3134868108 >> v2:172.21.15.96:3300/0 conn(0x7f0a9409ba40 0x7f0a9405a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:16.755 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.745+0000 7f0a9b50b700 1 --2- 172.21.15.158:0/3134868108 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0a9405a950 0x7f0a94155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:16.755 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.745+0000 7f0a9ad0a700 1 -- 172.21.15.158:0/3134868108 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0a9405a950 msgr2=0x7f0a94155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:16.755 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.745+0000 7f0a9ad0a700 1 --2- 172.21.15.158:0/3134868108 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0a9405a950 0x7f0a94155290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:16.755 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.745+0000 7f0a9ad0a700 1 -- 172.21.15.158:0/3134868108 >> v2:172.21.15.96:3300/0 conn(0x7f0a9409ba40 msgr2=0x7f0a9405a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:16.755 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.745+0000 7f0a9ad0a700 1 --2- 172.21.15.158:0/3134868108 >> v2:172.21.15.96:3300/0 conn(0x7f0a9409ba40 0x7f0a9405a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:16.755 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.745+0000 7f0a9ad0a700 1 -- 172.21.15.158:0/3134868108 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9407e960 con 0x7f0a940b6970 2019-12-05T03:50:16.756 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.745+0000 7f0a9ad0a700 1 --2- 172.21.15.158:0/3134868108 >> v2:172.21.15.158:3300/0 conn(0x7f0a940b6970 0x7f0a9409add0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0a90002f30 tx=0x7f0a9000fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.756 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.745+0000 7f0a9ad0a700 1 --2- 172.21.15.158:0/3134868108 >> v2:172.21.15.158:3300/0 conn(0x7f0a940b6970 0x7f0a9409add0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0a90002f30 tx=0x7f0a9000fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.756 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.745+0000 7f0a9ad0a700 1 --2- 172.21.15.158:0/3134868108 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0a940b6970 0x7f0a9409add0 secure :-1 s=READY pgs=186 cs=0 l=1 rx=0x7f0a90002f30 tx=0x7f0a9000fdb0).ready entity=mon.1 client_cookie=36db275b007dacdf server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:16.756 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.745+0000 7f0a9ad0a700 1 --2- 172.21.15.158:0/3134868108 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0a940b6970 0x7f0a9409add0 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f0a90002f30 tx=0x7f0a9000fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.756 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.745+0000 7f0a9ad0a700 1 --2- 172.21.15.158:0/3134868108 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0a940b6970 0x7f0a9409add0 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f0a90002f30 tx=0x7f0a9000fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.757 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.745+0000 7f0a9ad0a700 1 --2- 172.21.15.158:0/3134868108 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0a940b6970 0x7f0a9409add0 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f0a90002f30 tx=0x7f0a9000fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.757 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.745+0000 7f0a99d08700 1 -- 172.21.15.158:0/3134868108 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a90008c90 con 0x7f0a940b6970 2019-12-05T03:50:16.757 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.745+0000 7f0a99d08700 1 -- 172.21.15.158:0/3134868108 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a900088b0 con 0x7f0a940b6970 2019-12-05T03:50:16.757 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.745+0000 7f0a99d08700 1 -- 172.21.15.158:0/3134868108 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a90011b50 con 0x7f0a940b6970 2019-12-05T03:50:16.757 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.745+0000 7f0a9c76d700 1 -- 172.21.15.158:0/3134868108 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0a940b6970 msgr2=0x7f0a9409add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:16.757 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.745+0000 7f0a9c76d700 1 --2- 172.21.15.158:0/3134868108 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0a940b6970 0x7f0a9409add0 secure :-1 s=READY pgs=186 cs=0 l=1 rx=0x7f0a90002f30 tx=0x7f0a9000fdb0).stop 2019-12-05T03:50:16.757 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.745+0000 7f0a9c76d700 1 -- 172.21.15.158:0/3134868108 shutdown_connections 2019-12-05T03:50:16.758 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.745+0000 7f0a9c76d700 1 --2- 172.21.15.158:0/3134868108 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0a9405a950 0x7f0a94155290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:16.758 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.745+0000 7f0a9c76d700 1 --2- 172.21.15.158:0/3134868108 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0a940b6970 0x7f0a9409add0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:16.758 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.745+0000 7f0a9c76d700 1 --2- 172.21.15.158:0/3134868108 >> v2:172.21.15.96:3300/0 conn(0x7f0a9409ba40 0x7f0a9405a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:16.758 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.745+0000 7f0a9c76d700 1 -- 172.21.15.158:0/3134868108 shutdown_connections 2019-12-05T03:50:16.758 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.745+0000 7f0a9c76d700 1 -- 172.21.15.158:0/3134868108 wait complete. 2019-12-05T03:50:16.759 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.745+0000 7f0a9c76d700 1 -- 172.21.15.158:0/3134868108 >> 172.21.15.158:0/3134868108 conn(0x7f0a940b7ef0 msgr2=0x7f0a940b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:16.762 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.749+0000 7f0a9c76d700 1 Processor -- start 2019-12-05T03:50:16.762 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.749+0000 7f0a9c76d700 1 -- start start 2019-12-05T03:50:16.762 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.749+0000 7f0a9c76d700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0a940b1540 0x7f0a9407cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:16.762 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.749+0000 7f0a9c76d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f0a94123850 0x7f0a9413e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:16.762 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.749+0000 7f0a9c76d700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a94153da0 con 0x7f0a94123420 2019-12-05T03:50:16.763 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.749+0000 7f0a9c76d700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a9413dd00 con 0x7f0a94123850 2019-12-05T03:50:16.763 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.749+0000 7f0a9c76d700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9413dfa0 con 0x7f0a940b1540 2019-12-05T03:50:16.763 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.749+0000 7f0a9b50b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f0a94123850 0x7f0a9413e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:16.763 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.749+0000 7f0a9b50b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f0a94123850 0x7f0a9413e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54072/0 (socket says 172.21.15.158:54072) 2019-12-05T03:50:16.763 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.749+0000 7f0a9a509700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f0a94123420 0x7f0a9405f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48850/0 (socket says 172.21.15.158:48850) 2019-12-05T03:50:16.763 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.749+0000 7f0a9ad0a700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0a940b1540 0x7f0a9407cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:16.763 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.749+0000 7f0a9b50b700 1 -- 172.21.15.158:0/3210567440 learned_addr learned my addr 172.21.15.158:0/3210567440 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:16.764 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.749+0000 7f0a9b50b700 1 -- 172.21.15.158:0/3210567440 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0a940b1540 msgr2=0x7f0a9407cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:16.764 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.749+0000 7f0a9b50b700 1 --2- 172.21.15.158:0/3210567440 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0a940b1540 0x7f0a9407cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:16.764 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.749+0000 7f0a8b7fe700 1 -- 172.21.15.158:0/3210567440 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3862067914 0 0) 0x7f0a94153da0 con 0x7f0a94123420 2019-12-05T03:50:16.764 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.749+0000 7f0a9b50b700 1 -- 172.21.15.158:0/3210567440 >> v1:172.21.15.158:6789/0 conn(0x7f0a94123420 legacy=0x7f0a9405f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:16.764 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.749+0000 7f0a9b50b700 1 -- 172.21.15.158:0/3210567440 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a940600b0 con 0x7f0a94123850 2019-12-05T03:50:16.765 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.749+0000 7f0a9b50b700 1 --2- 172.21.15.158:0/3210567440 >> v2:172.21.15.158:3300/0 conn(0x7f0a94123850 0x7f0a9413e240 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0a9413dec0 tx=0x7f0a8c010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.765 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.749+0000 7f0a9b50b700 1 --2- 172.21.15.158:0/3210567440 >> v2:172.21.15.158:3300/0 conn(0x7f0a94123850 0x7f0a9413e240 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0a9413dec0 tx=0x7f0a8c010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.765 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.749+0000 7f0a9b50b700 1 --2- 172.21.15.158:0/3210567440 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0a94123850 0x7f0a9413e240 secure :-1 s=READY pgs=188 cs=0 l=1 rx=0x7f0a9413dec0 tx=0x7f0a8c010e90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:16.765 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.749+0000 7f0a9b50b700 1 --2- 172.21.15.158:0/3210567440 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0a94123850 0x7f0a9413e240 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f0a9413dec0 tx=0x7f0a8c010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.765 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.749+0000 7f0a9b50b700 1 --2- 172.21.15.158:0/3210567440 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0a94123850 0x7f0a9413e240 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f0a9413dec0 tx=0x7f0a8c010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.765 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.749+0000 7f0a9b50b700 1 --2- 172.21.15.158:0/3210567440 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0a94123850 0x7f0a9413e240 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f0a9413dec0 tx=0x7f0a8c010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.765 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.749+0000 7f0a8b7fe700 1 -- 172.21.15.158:0/3210567440 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a8c012af0 con 0x7f0a94123850 2019-12-05T03:50:16.766 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.749+0000 7f0a8b7fe700 1 -- 172.21.15.158:0/3210567440 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8c00e160 con 0x7f0a94123850 2019-12-05T03:50:16.766 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.749+0000 7f0a8b7fe700 1 -- 172.21.15.158:0/3210567440 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a8c005ab0 con 0x7f0a94123850 2019-12-05T03:50:16.766 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.749+0000 7f0a9c76d700 1 -- 172.21.15.158:0/3210567440 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a94141c30 con 0x7f0a94123850 2019-12-05T03:50:16.766 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.753+0000 7f0a9c76d700 1 -- 172.21.15.158:0/3210567440 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a9413e790 con 0x7f0a94123850 2019-12-05T03:50:16.766 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.753+0000 7f0a9b50b700 1 --2- 172.21.15.158:0/3210567440 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0a94123850 0x7f0a9413e240 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f0a9413dec0 tx=0x7f0a8c010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.766 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.753+0000 7f0a8b7fe700 1 -- 172.21.15.158:0/3210567440 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f0a8c005cb0 con 0x7f0a94123850 2019-12-05T03:50:16.767 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.753+0000 7f0a9b50b700 1 --2- 172.21.15.158:0/3210567440 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0a94123850 0x7f0a9413e240 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f0a9413dec0 tx=0x7f0a8c010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.767 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.753+0000 7f0a8b7fe700 1 --2- 172.21.15.158:0/3210567440 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f0a7c03ad70 0x7f0a7c03d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:16.767 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.753+0000 7f0a8b7fe700 1 -- 172.21.15.158:0/3210567440 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f0a8c04aee0 con 0x7f0a94123850 2019-12-05T03:50:16.767 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.753+0000 7f0a9ad0a700 1 --2- 172.21.15.158:0/3210567440 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f0a7c03ad70 0x7f0a7c03d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:16.767 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.753+0000 7f0a9ad0a700 1 --2- 172.21.15.158:0/3210567440 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f0a7c03ad70 0x7f0a7c03d280 crc :-1 s=READY pgs=96 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:16.768 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.761+0000 7f0a9c76d700 1 -- 172.21.15.158:0/3210567440 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a940554e0 con 0x7f0a94123850 2019-12-05T03:50:16.773 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.769+0000 7f0a9b50b700 1 --2- 172.21.15.158:0/3210567440 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0a94123850 0x7f0a9413e240 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f0a9413dec0 tx=0x7f0a8c010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.773 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.769+0000 7f0a8b7fe700 1 -- 172.21.15.158:0/3210567440 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f0a8c067400 con 0x7f0a94123850 2019-12-05T03:50:16.934 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.929+0000 7f0a9c76d700 1 -- 172.21.15.158:0/3210567440 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f0a94066940 con 0x7f0a94123850 2019-12-05T03:50:16.935 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.929+0000 7f0a9b50b700 1 --2- 172.21.15.158:0/3210567440 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0a94123850 0x7f0a9413e240 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f0a9413dec0 tx=0x7f0a8c010e90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:16.935 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.929+0000 7f0a8b7fe700 1 -- 172.21.15.158:0/3210567440 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7f0a8c031f60 con 0x7f0a94123850 2019-12-05T03:50:16.935 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:50:16.938 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.933+0000 7f0a9c76d700 1 -- 172.21.15.158:0/3210567440 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f0a7c03ad70 msgr2=0x7f0a7c03d280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:16.938 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.933+0000 7f0a9c76d700 1 --2- 172.21.15.158:0/3210567440 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f0a7c03ad70 0x7f0a7c03d280 crc :-1 s=READY pgs=96 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:16.938 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.933+0000 7f0a9c76d700 1 -- 172.21.15.158:0/3210567440 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0a94123850 msgr2=0x7f0a9413e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:16.938 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.933+0000 7f0a9c76d700 1 --2- 172.21.15.158:0/3210567440 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0a94123850 0x7f0a9413e240 secure :-1 s=READY pgs=188 cs=0 l=1 rx=0x7f0a9413dec0 tx=0x7f0a8c010e90).stop 2019-12-05T03:50:16.938 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.933+0000 7f0a9c76d700 1 -- 172.21.15.158:0/3210567440 shutdown_connections 2019-12-05T03:50:16.938 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.933+0000 7f0a9c76d700 1 --2- 172.21.15.158:0/3210567440 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f0a7c03ad70 0x7f0a7c03d280 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:16.939 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.933+0000 7f0a9c76d700 1 --2- 172.21.15.158:0/3210567440 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0a94123850 0x7f0a9413e240 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:16.939 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.933+0000 7f0a9c76d700 1 --2- 172.21.15.158:0/3210567440 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0a940b1540 0x7f0a9407cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:16.939 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.933+0000 7f0a9c76d700 1 -- 172.21.15.158:0/3210567440 shutdown_connections 2019-12-05T03:50:16.939 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.933+0000 7f0a9c76d700 1 -- 172.21.15.158:0/3210567440 wait complete. 2019-12-05T03:50:16.939 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:16.933+0000 7f0a9c76d700 1 -- 172.21.15.158:0/3210567440 >> 172.21.15.158:0/3210567440 conn(0x7f0a940b7ef0 msgr2=0x7f0a9407d800 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:16.948 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-12-05T03:50:17.041 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.029+0000 7ff1b9426700 1 Processor -- start 2019-12-05T03:50:17.042 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b9426700 1 -- start start 2019-12-05T03:50:17.042 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b9426700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff1b40b6970 0x7ff1b409add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:17.042 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b9426700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1b4099e30 con 0x7ff1b40b5370 2019-12-05T03:50:17.042 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b9426700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1b407e960 con 0x7ff1b409ba40 2019-12-05T03:50:17.042 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b9426700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1b409d210 con 0x7ff1b40b6970 2019-12-05T03:50:17.042 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b2ffd700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7ff1b409ba40 0x7ff1b405a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48856/0 (socket says 172.21.15.158:48856) 2019-12-05T03:50:17.042 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b2ffd700 1 -- 172.21.15.158:0/1186086938 learned_addr learned my addr 172.21.15.158:0/1186086938 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:17.043 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b37fe700 1 --2- 172.21.15.158:0/1186086938 >> v2:172.21.15.96:3300/0 conn(0x7ff1b40b6970 0x7ff1b409add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:17.043 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b27fc700 1 -- 172.21.15.158:0/1186086938 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 446918712 0 0) 0x7ff1b407e960 con 0x7ff1b409ba40 2019-12-05T03:50:17.043 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b27fc700 1 -- 172.21.15.158:0/1186086938 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1940030b0 con 0x7ff1b409ba40 2019-12-05T03:50:17.043 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b27fc700 1 -- 172.21.15.158:0/1186086938 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3008828156 0 0) 0x7ff1940030b0 con 0x7ff1b409ba40 2019-12-05T03:50:17.043 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b27fc700 1 -- 172.21.15.158:0/1186086938 >> v2:172.21.15.96:3300/0 conn(0x7ff1b40b6970 msgr2=0x7ff1b409add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:17.043 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b27fc700 1 --2- 172.21.15.158:0/1186086938 >> v2:172.21.15.96:3300/0 conn(0x7ff1b40b6970 0x7ff1b409add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:17.043 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b27fc700 1 -- 172.21.15.158:0/1186086938 >> v1:172.21.15.96:6789/0 conn(0x7ff1b40b5370 legacy=0x7ff1b40b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:17.044 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b27fc700 1 -- 172.21.15.158:0/1186086938 --> v1:172.21.15.158:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b40b5fa0 con 0x7ff1b409ba40 2019-12-05T03:50:17.044 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b27fc700 1 -- 172.21.15.158:0/1186086938 <== mon.1 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 828730332 0 0) 0x7ff1a4001750 con 0x7ff1b409ba40 2019-12-05T03:50:17.044 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b27fc700 1 -- 172.21.15.158:0/1186086938 >> v1:172.21.15.158:6789/0 conn(0x7ff1b409ba40 legacy=0x7ff1b405a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:17.044 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b27fc700 1 --2- 172.21.15.158:0/1186086938 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff194003730 0x7ff194003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:17.044 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b27fc700 1 --2- 172.21.15.158:0/1186086938 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff194004420 0x7ff194004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:17.044 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b27fc700 1 --2- 172.21.15.158:0/1186086938 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff194004da0 0x7ff19400b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:17.045 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b27fc700 1 -- 172.21.15.158:0/1186086938 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b409d210 con 0x7ff194004da0 2019-12-05T03:50:17.045 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b2ffd700 1 --2- 172.21.15.158:0/1186086938 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff194004420 0x7ff194004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:17.045 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b27fc700 1 -- 172.21.15.158:0/1186086938 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19404fcc0 con 0x7ff194004420 2019-12-05T03:50:17.045 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b27fc700 1 -- 172.21.15.158:0/1186086938 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff19404ff00 con 0x7ff194003730 2019-12-05T03:50:17.045 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b37fe700 1 --2- 172.21.15.158:0/1186086938 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff194003730 0x7ff194003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:17.045 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b3fff700 1 --2- 172.21.15.158:0/1186086938 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff194004da0 0x7ff19400b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:17.045 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b2ffd700 1 -- 172.21.15.158:0/1186086938 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff194003730 msgr2=0x7ff194003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:17.046 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b2ffd700 1 --2- 172.21.15.158:0/1186086938 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff194003730 0x7ff194003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:17.046 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b2ffd700 1 -- 172.21.15.158:0/1186086938 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff194004da0 msgr2=0x7ff19400b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:17.046 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b2ffd700 1 --2- 172.21.15.158:0/1186086938 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff194004da0 0x7ff19400b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:17.046 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b2ffd700 1 -- 172.21.15.158:0/1186086938 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff194050200 con 0x7ff194004420 2019-12-05T03:50:17.046 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b3fff700 1 -- 172.21.15.158:0/1186086938 reap_dead start 2019-12-05T03:50:17.046 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b2ffd700 1 --2- 172.21.15.158:0/1186086938 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff194004420 0x7ff194004850 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff1a4000fe0 tx=0x7ff1a400c0f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:17.046 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b2ffd700 1 --2- 172.21.15.158:0/1186086938 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff194004420 0x7ff194004850 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff1a4000fe0 tx=0x7ff1a400c0f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:17.047 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b2ffd700 1 --2- 172.21.15.158:0/1186086938 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff194004420 0x7ff194004850 secure :-1 s=READY pgs=190 cs=0 l=1 rx=0x7ff1a4000fe0 tx=0x7ff1a400c0f0).ready entity=mon.1 client_cookie=6de56b73aa4ee2db server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:17.047 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b2ffd700 1 --2- 172.21.15.158:0/1186086938 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff194004420 0x7ff194004850 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7ff1a4000fe0 tx=0x7ff1a400c0f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:17.047 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b27fc700 1 -- 172.21.15.158:0/1186086938 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1a4010b00 con 0x7ff194004420 2019-12-05T03:50:17.047 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b2ffd700 1 --2- 172.21.15.158:0/1186086938 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff194004420 0x7ff194004850 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7ff1a4000fe0 tx=0x7ff1a400c0f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:17.047 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b27fc700 1 -- 172.21.15.158:0/1186086938 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a400ebd0 con 0x7ff194004420 2019-12-05T03:50:17.048 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b2ffd700 1 --2- 172.21.15.158:0/1186086938 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff194004420 0x7ff194004850 secure :-1 s=THROTTLE_DONE pgs=190 cs=0 l=1 rx=0x7ff1a4000fe0 tx=0x7ff1a400c0f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:17.048 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b9426700 1 -- 172.21.15.158:0/1186086938 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff194004420 msgr2=0x7ff194004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:17.048 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b9426700 1 --2- 172.21.15.158:0/1186086938 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff194004420 0x7ff194004850 secure :-1 s=READY pgs=190 cs=0 l=1 rx=0x7ff1a4000fe0 tx=0x7ff1a400c0f0).stop 2019-12-05T03:50:17.048 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.033+0000 7ff1b27fc700 1 -- 172.21.15.158:0/1186086938 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1a4005650 con 0x7ff194004420 2019-12-05T03:50:17.048 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.037+0000 7ff1b9426700 1 -- 172.21.15.158:0/1186086938 shutdown_connections 2019-12-05T03:50:17.048 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.037+0000 7ff1b9426700 1 --2- 172.21.15.158:0/1186086938 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff194004420 0x7ff194004850 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:17.048 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.037+0000 7ff1b9426700 1 -- 172.21.15.158:0/1186086938 shutdown_connections 2019-12-05T03:50:17.049 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.037+0000 7ff1b9426700 1 -- 172.21.15.158:0/1186086938 wait complete. 2019-12-05T03:50:17.049 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.037+0000 7ff1b9426700 1 -- 172.21.15.158:0/1186086938 >> 172.21.15.158:0/1186086938 conn(0x7ff1b40b7ef0 msgr2=0x7ff1b40b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:17.052 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.037+0000 7ff1b9426700 1 Processor -- start 2019-12-05T03:50:17.052 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.037+0000 7ff1b9426700 1 -- start start 2019-12-05T03:50:17.052 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.037+0000 7ff1b9426700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff1b405f910 0x7ff1b4060670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:17.052 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.037+0000 7ff1b9426700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1b4060bc0 con 0x7ff1b4141560 2019-12-05T03:50:17.052 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.037+0000 7ff1b9426700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1b40ade90 con 0x7ff1b412ed50 2019-12-05T03:50:17.052 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.037+0000 7ff1b9426700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1b405fe90 con 0x7ff1b405f910 2019-12-05T03:50:17.053 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.037+0000 7ff1b37fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff1b405f910 0x7ff1b4060670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:17.053 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.037+0000 7ff1b37fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff1b405f910 0x7ff1b4060670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54090/0 (socket says 172.21.15.158:54090) 2019-12-05T03:50:17.053 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.037+0000 7ff1b3fff700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7ff1b412ed50 0x7ff1b40ad690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48872/0 (socket says 172.21.15.158:48872) 2019-12-05T03:50:17.053 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.037+0000 7ff1b37fe700 1 -- 172.21.15.158:0/2540913561 learned_addr learned my addr 172.21.15.158:0/2540913561 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:17.053 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.037+0000 7ff1b37fe700 1 -- 172.21.15.158:0/2540913561 >> v1:172.21.15.158:6789/0 conn(0x7ff1b412ed50 legacy=0x7ff1b40ad690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:17.053 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.037+0000 7ff1b37fe700 1 -- 172.21.15.158:0/2540913561 >> v1:172.21.15.96:6789/0 conn(0x7ff1b4141560 legacy=0x7ff1b412e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:17.053 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.037+0000 7ff1b37fe700 1 -- 172.21.15.158:0/2540913561 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b40ae0c0 con 0x7ff1b405f910 2019-12-05T03:50:17.053 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.037+0000 7ff1abfff700 1 -- 172.21.15.158:0/2540913561 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1190657245 0 0) 0x7ff1b40ade90 con 0x7ff1b412ed50 2019-12-05T03:50:17.054 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.037+0000 7ff1b37fe700 1 --2- 172.21.15.158:0/2540913561 >> v2:172.21.15.158:3300/0 conn(0x7ff1b405f910 0x7ff1b4060670 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff19c003070 tx=0x7ff19c010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:17.054 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.037+0000 7ff1b37fe700 1 --2- 172.21.15.158:0/2540913561 >> v2:172.21.15.158:3300/0 conn(0x7ff1b405f910 0x7ff1b4060670 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff19c003070 tx=0x7ff19c010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:17.054 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.037+0000 7ff1b37fe700 1 --2- 172.21.15.158:0/2540913561 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff1b405f910 0x7ff1b4060670 secure :-1 s=READY pgs=192 cs=0 l=1 rx=0x7ff19c003070 tx=0x7ff19c010cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:17.054 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.037+0000 7ff1b37fe700 1 --2- 172.21.15.158:0/2540913561 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff1b405f910 0x7ff1b4060670 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7ff19c003070 tx=0x7ff19c010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:17.054 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.037+0000 7ff1b37fe700 1 --2- 172.21.15.158:0/2540913561 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff1b405f910 0x7ff1b4060670 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7ff19c003070 tx=0x7ff19c010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:17.054 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.037+0000 7ff1abfff700 1 -- 172.21.15.158:0/2540913561 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff19c005980 con 0x7ff1b405f910 2019-12-05T03:50:17.055 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.037+0000 7ff1b37fe700 1 --2- 172.21.15.158:0/2540913561 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff1b405f910 0x7ff1b4060670 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7ff19c003070 tx=0x7ff19c010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:17.055 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.037+0000 7ff1abfff700 1 -- 172.21.15.158:0/2540913561 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff19c007160 con 0x7ff1b405f910 2019-12-05T03:50:17.055 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.037+0000 7ff1b9426700 1 -- 172.21.15.158:0/2540913561 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b4141990 con 0x7ff1b405f910 2019-12-05T03:50:17.055 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.037+0000 7ff1abfff700 1 -- 172.21.15.158:0/2540913561 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff19c012330 con 0x7ff1b405f910 2019-12-05T03:50:17.055 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.037+0000 7ff1b9426700 1 -- 172.21.15.158:0/2540913561 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1b4141d20 con 0x7ff1b405f910 2019-12-05T03:50:17.055 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.041+0000 7ff1b37fe700 1 --2- 172.21.15.158:0/2540913561 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff1b405f910 0x7ff1b4060670 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7ff19c003070 tx=0x7ff19c010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:17.055 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.041+0000 7ff1abfff700 1 -- 172.21.15.158:0/2540913561 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7ff19c012600 con 0x7ff1b405f910 2019-12-05T03:50:17.055 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.041+0000 7ff1b37fe700 1 --2- 172.21.15.158:0/2540913561 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff1b405f910 0x7ff1b4060670 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7ff19c003070 tx=0x7ff19c010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:17.056 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.041+0000 7ff1abfff700 1 --2- 172.21.15.158:0/2540913561 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7ff18c03ac40 0x7ff18c03d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:17.056 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.041+0000 7ff1abfff700 1 -- 172.21.15.158:0/2540913561 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7ff19c04ba40 con 0x7ff1b405f910 2019-12-05T03:50:17.056 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.041+0000 7ff1b2ffd700 1 --2- 172.21.15.158:0/2540913561 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7ff18c03ac40 0x7ff18c03d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:17.056 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.041+0000 7ff1b2ffd700 1 --2- 172.21.15.158:0/2540913561 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7ff18c03ac40 0x7ff18c03d150 crc :-1 s=READY pgs=97 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:17.056 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.045+0000 7ff1b9426700 1 -- 172.21.15.158:0/2540913561 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1b40554e0 con 0x7ff1b405f910 2019-12-05T03:50:17.064 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.053+0000 7ff1b37fe700 1 --2- 172.21.15.158:0/2540913561 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff1b405f910 0x7ff1b4060670 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7ff19c003070 tx=0x7ff19c010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:17.064 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.053+0000 7ff1abfff700 1 -- 172.21.15.158:0/2540913561 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7ff19c032ac0 con 0x7ff1b405f910 2019-12-05T03:50:17.213 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.209+0000 7ff1b9426700 1 -- 172.21.15.158:0/2540913561 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7ff1b4066940 con 0x7ff1b405f910 2019-12-05T03:50:17.214 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.209+0000 7ff1b37fe700 1 --2- 172.21.15.158:0/2540913561 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff1b405f910 0x7ff1b4060670 secure :-1 s=THROTTLE_DONE pgs=192 cs=0 l=1 rx=0x7ff19c003070 tx=0x7ff19c010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:17.214 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.209+0000 7ff1abfff700 1 -- 172.21.15.158:0/2540913561 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7ff19c032d20 con 0x7ff1b405f910 2019-12-05T03:50:17.214 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:50:17.216 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.209+0000 7ff1b9426700 1 -- 172.21.15.158:0/2540913561 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7ff18c03ac40 msgr2=0x7ff18c03d150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:17.217 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.209+0000 7ff1b9426700 1 --2- 172.21.15.158:0/2540913561 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7ff18c03ac40 0x7ff18c03d150 crc :-1 s=READY pgs=97 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:17.217 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.209+0000 7ff1b9426700 1 -- 172.21.15.158:0/2540913561 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff1b405f910 msgr2=0x7ff1b4060670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:17.217 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.209+0000 7ff1b9426700 1 --2- 172.21.15.158:0/2540913561 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff1b405f910 0x7ff1b4060670 secure :-1 s=READY pgs=192 cs=0 l=1 rx=0x7ff19c003070 tx=0x7ff19c010cb0).stop 2019-12-05T03:50:17.217 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.209+0000 7ff1b9426700 1 -- 172.21.15.158:0/2540913561 shutdown_connections 2019-12-05T03:50:17.217 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.209+0000 7ff1b9426700 1 --2- 172.21.15.158:0/2540913561 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff1b405f910 0x7ff1b4060670 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:17.217 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.209+0000 7ff1b9426700 1 --2- 172.21.15.158:0/2540913561 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7ff18c03ac40 0x7ff18c03d150 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:17.217 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.209+0000 7ff1b9426700 1 -- 172.21.15.158:0/2540913561 shutdown_connections 2019-12-05T03:50:17.218 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.209+0000 7ff1b9426700 1 -- 172.21.15.158:0/2540913561 wait complete. 2019-12-05T03:50:17.218 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.209+0000 7ff1b9426700 1 -- 172.21.15.158:0/2540913561 >> 172.21.15.158:0/2540913561 conn(0x7ff1b409b400 msgr2=0x7ff1b405a040 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:17.227 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-12-05T03:50:17.227 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-12-05T03:50:17.329 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.317+0000 7f2a4cd57700 1 Processor -- start 2019-12-05T03:50:17.330 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.317+0000 7f2a4cd57700 1 -- start start 2019-12-05T03:50:17.330 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.321+0000 7f2a4cd57700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2a4809a320 0x7f2a4805a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:17.330 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.321+0000 7f2a4cd57700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2a481553b0 0x7f2a481557e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:17.330 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.321+0000 7f2a4cd57700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a480accb0 con 0x7f2a4809cf60 2019-12-05T03:50:17.330 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.321+0000 7f2a4cd57700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a4809a750 con 0x7f2a4809a320 2019-12-05T03:50:17.330 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.321+0000 7f2a4cd57700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a480b1730 con 0x7f2a481553b0 2019-12-05T03:50:17.331 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.321+0000 7f2a4659c700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2a4809a320 0x7f2a4805a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:17.331 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.321+0000 7f2a4659c700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2a4809a320 0x7f2a4805a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.158:40684/0 (socket says 172.21.15.158:40684) 2019-12-05T03:50:17.331 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.321+0000 7f2a4659c700 1 -- 172.21.15.158:0/2204218617 learned_addr learned my addr 172.21.15.158:0/2204218617 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:17.331 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.321+0000 7f2a4759e700 1 --2- 172.21.15.158:0/2204218617 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2a481553b0 0x7f2a481557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:17.331 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.321+0000 7f2a4659c700 1 -- 172.21.15.158:0/2204218617 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2a481553b0 msgr2=0x7f2a481557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:17.331 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.321+0000 7f2a4659c700 1 --2- 172.21.15.158:0/2204218617 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2a481553b0 0x7f2a481557e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:17.331 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.321+0000 7f2a4659c700 1 -- 172.21.15.158:0/2204218617 >> v1:172.21.15.96:6789/0 conn(0x7f2a4809cf60 legacy=0x7f2a48151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:17.332 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.321+0000 7f2a4659c700 1 -- 172.21.15.158:0/2204218617 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a480b6980 con 0x7f2a4809a320 2019-12-05T03:50:17.332 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.321+0000 7f2a4659c700 1 --2- 172.21.15.158:0/2204218617 >> v2:172.21.15.96:3300/0 conn(0x7f2a4809a320 0x7f2a4805a740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2a3c008790 tx=0x7f2a3c00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:17.332 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.321+0000 7f2a4659c700 1 --2- 172.21.15.158:0/2204218617 >> v2:172.21.15.96:3300/0 conn(0x7f2a4809a320 0x7f2a4805a740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2a3c008790 tx=0x7f2a3c00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:17.332 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.321+0000 7f2a4659c700 1 --2- 172.21.15.158:0/2204218617 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a4809a320 0x7f2a4805a740 secure :-1 s=READY pgs=139 cs=0 l=1 rx=0x7f2a3c008790 tx=0x7f2a3c00fd30).ready entity=mon.0 client_cookie=55b87473aaea640f server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:17.332 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.321+0000 7f2a4659c700 1 --2- 172.21.15.158:0/2204218617 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a4809a320 0x7f2a4805a740 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f2a3c008790 tx=0x7f2a3c00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:17.332 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.321+0000 7f2a45d9b700 1 -- 172.21.15.158:0/2204218617 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a3c0113b0 con 0x7f2a4809a320 2019-12-05T03:50:17.332 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.321+0000 7f2a4659c700 1 --2- 172.21.15.158:0/2204218617 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a4809a320 0x7f2a4805a740 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f2a3c008790 tx=0x7f2a3c00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:17.333 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.321+0000 7f2a4659c700 1 --2- 172.21.15.158:0/2204218617 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a4809a320 0x7f2a4805a740 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f2a3c008790 tx=0x7f2a3c00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:17.333 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.321+0000 7f2a45d9b700 1 -- 172.21.15.158:0/2204218617 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3c008bb0 con 0x7f2a4809a320 2019-12-05T03:50:17.333 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.321+0000 7f2a45d9b700 1 -- 172.21.15.158:0/2204218617 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a3c011990 con 0x7f2a4809a320 2019-12-05T03:50:17.333 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.321+0000 7f2a4cd57700 1 -- 172.21.15.158:0/2204218617 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a4809a320 msgr2=0x7f2a4805a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:17.333 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.321+0000 7f2a4cd57700 1 --2- 172.21.15.158:0/2204218617 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a4809a320 0x7f2a4805a740 secure :-1 s=READY pgs=139 cs=0 l=1 rx=0x7f2a3c008790 tx=0x7f2a3c00fd30).stop 2019-12-05T03:50:17.333 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.321+0000 7f2a4cd57700 1 -- 172.21.15.158:0/2204218617 shutdown_connections 2019-12-05T03:50:17.333 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.321+0000 7f2a4cd57700 1 --2- 172.21.15.158:0/2204218617 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2a481553b0 0x7f2a481557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:17.334 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.321+0000 7f2a4cd57700 1 --2- 172.21.15.158:0/2204218617 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a4809a320 0x7f2a4805a740 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:17.334 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.321+0000 7f2a4cd57700 1 -- 172.21.15.158:0/2204218617 shutdown_connections 2019-12-05T03:50:17.334 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.321+0000 7f2a4cd57700 1 -- 172.21.15.158:0/2204218617 wait complete. 2019-12-05T03:50:17.334 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.321+0000 7f2a4cd57700 1 -- 172.21.15.158:0/2204218617 >> 172.21.15.158:0/2204218617 conn(0x7f2a480b7e60 msgr2=0x7f2a480b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:17.337 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.325+0000 7f2a4cd57700 1 Processor -- start 2019-12-05T03:50:17.337 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.325+0000 7f2a4cd57700 1 -- start start 2019-12-05T03:50:17.337 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.325+0000 7f2a4cd57700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2a480b0f30 0x7f2a481543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:17.338 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.325+0000 7f2a4cd57700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f2a48154920 0x7f2a4813c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:17.338 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.325+0000 7f2a4cd57700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a48130dd0 con 0x7f2a480ad240 2019-12-05T03:50:17.338 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.325+0000 7f2a4cd57700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a4813fa80 con 0x7f2a48154920 2019-12-05T03:50:17.338 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.325+0000 7f2a4cd57700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a48140520 con 0x7f2a480b0f30 2019-12-05T03:50:17.338 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.325+0000 7f2a4659c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f2a48154920 0x7f2a4813c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:17.338 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.325+0000 7f2a4759e700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f2a480ad240 0x7f2a4813fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48886/0 (socket says 172.21.15.158:48886) 2019-12-05T03:50:17.339 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.325+0000 7f2a4759e700 1 -- 172.21.15.158:0/3754781825 learned_addr learned my addr 172.21.15.158:0/3754781825 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:17.339 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.325+0000 7f2a46d9d700 1 --2- 172.21.15.158:0/3754781825 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2a480b0f30 0x7f2a481543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:17.339 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.325+0000 7f2a4659c700 1 -- 172.21.15.158:0/3754781825 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2a480b0f30 msgr2=0x7f2a481543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:17.339 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.325+0000 7f2a377fe700 1 -- 172.21.15.158:0/3754781825 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1782778939 0 0) 0x7f2a48130dd0 con 0x7f2a480ad240 2019-12-05T03:50:17.339 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.325+0000 7f2a4659c700 1 --2- 172.21.15.158:0/3754781825 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2a480b0f30 0x7f2a481543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:17.339 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.325+0000 7f2a4659c700 1 -- 172.21.15.158:0/3754781825 >> v1:172.21.15.158:6789/0 conn(0x7f2a480ad240 legacy=0x7f2a4813fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:17.339 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.325+0000 7f2a4659c700 1 -- 172.21.15.158:0/3754781825 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a48140710 con 0x7f2a48154920 2019-12-05T03:50:17.339 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.325+0000 7f2a4659c700 1 --2- 172.21.15.158:0/3754781825 >> v2:172.21.15.158:3300/0 conn(0x7f2a48154920 0x7f2a4813c340 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2a3c008790 tx=0x7f2a3c008bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:17.340 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.325+0000 7f2a4659c700 1 --2- 172.21.15.158:0/3754781825 >> v2:172.21.15.158:3300/0 conn(0x7f2a48154920 0x7f2a4813c340 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2a3c008790 tx=0x7f2a3c008bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:17.340 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.325+0000 7f2a4659c700 1 --2- 172.21.15.158:0/3754781825 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2a48154920 0x7f2a4813c340 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7f2a3c008790 tx=0x7f2a3c008bb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:17.340 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.329+0000 7f2a4659c700 1 --2- 172.21.15.158:0/3754781825 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2a48154920 0x7f2a4813c340 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f2a3c008790 tx=0x7f2a3c008bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:17.340 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.329+0000 7f2a377fe700 1 -- 172.21.15.158:0/3754781825 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a3c007340 con 0x7f2a48154920 2019-12-05T03:50:17.340 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.329+0000 7f2a4659c700 1 --2- 172.21.15.158:0/3754781825 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2a48154920 0x7f2a4813c340 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f2a3c008790 tx=0x7f2a3c008bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:17.340 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.329+0000 7f2a4659c700 1 --2- 172.21.15.158:0/3754781825 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2a48154920 0x7f2a4813c340 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f2a3c008790 tx=0x7f2a3c008bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:17.340 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.329+0000 7f2a377fe700 1 -- 172.21.15.158:0/3754781825 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3c0115b0 con 0x7f2a48154920 2019-12-05T03:50:17.341 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.329+0000 7f2a377fe700 1 -- 172.21.15.158:0/3754781825 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a3c005540 con 0x7f2a48154920 2019-12-05T03:50:17.341 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.329+0000 7f2a4cd57700 1 -- 172.21.15.158:0/3754781825 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a4813c890 con 0x7f2a48154920 2019-12-05T03:50:17.341 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.329+0000 7f2a4cd57700 1 -- 172.21.15.158:0/3754781825 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a4812ce80 con 0x7f2a48154920 2019-12-05T03:50:17.341 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.329+0000 7f2a4659c700 1 --2- 172.21.15.158:0/3754781825 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2a48154920 0x7f2a4813c340 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f2a3c008790 tx=0x7f2a3c008bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:17.341 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.329+0000 7f2a377fe700 1 -- 172.21.15.158:0/3754781825 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f2a3c005850 con 0x7f2a48154920 2019-12-05T03:50:17.341 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.329+0000 7f2a4659c700 1 --2- 172.21.15.158:0/3754781825 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2a48154920 0x7f2a4813c340 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f2a3c008790 tx=0x7f2a3c008bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:17.341 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.329+0000 7f2a377fe700 1 --2- 172.21.15.158:0/3754781825 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f2a2c03ac80 0x7f2a2c03d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:17.342 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.329+0000 7f2a377fe700 1 -- 172.21.15.158:0/3754781825 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f2a3c04b3c0 con 0x7f2a48154920 2019-12-05T03:50:17.342 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.329+0000 7f2a46d9d700 1 --2- 172.21.15.158:0/3754781825 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f2a2c03ac80 0x7f2a2c03d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:17.342 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.329+0000 7f2a46d9d700 1 --2- 172.21.15.158:0/3754781825 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f2a2c03ac80 0x7f2a2c03d190 crc :-1 s=READY pgs=98 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:17.342 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.333+0000 7f2a4cd57700 1 -- 172.21.15.158:0/3754781825 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a480554e0 con 0x7f2a48154920 2019-12-05T03:50:17.344 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.337+0000 7f2a4659c700 1 --2- 172.21.15.158:0/3754781825 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2a48154920 0x7f2a4813c340 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f2a3c008790 tx=0x7f2a3c008bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:17.345 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.337+0000 7f2a377fe700 1 -- 172.21.15.158:0/3754781825 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f2a3c032440 con 0x7f2a48154920 2019-12-05T03:50:17.504 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.497+0000 7f2a4cd57700 1 -- 172.21.15.158:0/3754781825 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2a48066940 con 0x7f2a48154920 2019-12-05T03:50:17.505 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.497+0000 7f2a4659c700 1 --2- 172.21.15.158:0/3754781825 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2a48154920 0x7f2a4813c340 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7f2a3c008790 tx=0x7f2a3c008bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:17.505 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.497+0000 7f2a377fe700 1 -- 172.21.15.158:0/3754781825 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2105 (secure 0 0 0) 0x7f2a3c0326a0 con 0x7f2a48154920 2019-12-05T03:50:17.505 INFO:teuthology.orchestra.run.smithi158.stderr:dumped fsmap epoch 6 2019-12-05T03:50:17.505 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:17.505 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4339,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.158:6833/1485705503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":1485705503},{"type":"v1","addr":"172.21.15.158:6833","nonce":1485705503}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-12-05T03:50:01.249656+0000","modified":"2019-12-05T03:50:09.365441+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"b","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6835/3636871068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":3636871068},{"type":"v1","addr":"172.21.15.96:6835","nonce":3636871068}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2019-12-05T03:50:17.507 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.501+0000 7f2a4cd57700 1 -- 172.21.15.158:0/3754781825 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f2a2c03ac80 msgr2=0x7f2a2c03d190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:17.507 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.501+0000 7f2a4cd57700 1 --2- 172.21.15.158:0/3754781825 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f2a2c03ac80 0x7f2a2c03d190 crc :-1 s=READY pgs=98 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:17.507 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.501+0000 7f2a4cd57700 1 -- 172.21.15.158:0/3754781825 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2a48154920 msgr2=0x7f2a4813c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:17.507 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.501+0000 7f2a4cd57700 1 --2- 172.21.15.158:0/3754781825 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2a48154920 0x7f2a4813c340 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7f2a3c008790 tx=0x7f2a3c008bb0).stop 2019-12-05T03:50:17.508 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.501+0000 7f2a4cd57700 1 -- 172.21.15.158:0/3754781825 shutdown_connections 2019-12-05T03:50:17.508 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.501+0000 7f2a4cd57700 1 --2- 172.21.15.158:0/3754781825 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f2a2c03ac80 0x7f2a2c03d190 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:17.508 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.501+0000 7f2a4cd57700 1 --2- 172.21.15.158:0/3754781825 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f2a480b0f30 0x7f2a481543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:17.508 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.501+0000 7f2a4cd57700 1 --2- 172.21.15.158:0/3754781825 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f2a48154920 0x7f2a4813c340 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:17.508 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.501+0000 7f2a4cd57700 1 -- 172.21.15.158:0/3754781825 shutdown_connections 2019-12-05T03:50:17.508 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.501+0000 7f2a4cd57700 1 -- 172.21.15.158:0/3754781825 wait complete. 2019-12-05T03:50:17.509 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:17.501+0000 7f2a4cd57700 1 -- 172.21.15.158:0/3754781825 >> 172.21.15.158:0/3754781825 conn(0x7f2a480b52e0 msgr2=0x7f2a480593f0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:17.719 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4241}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 6, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [3], u'info': {u'gid_4241': {u'export_targets': [], u'name': u'b', u'incarnation': 5, u'state_seq': 3, u'state': u'up:active', u'gid': 4241, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 3636871068, u'type': u'v2', u'addr': u'172.21.15.96:6834'}, {u'nonce': 3636871068, u'type': u'v1', u'addr': u'172.21.15.96:6835'}]}, u'addr': u'172.21.15.96:6835/3636871068'}}, u'fs_name': u'cephfs', u'created': u'2019-12-05T03:50:01.249656+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-12-05T03:50:09.365441+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-12-05T03:50:17.719 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-12-05T03:50:17.719 INFO:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2019-12-05T03:50:17.813 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2019-12-05T03:50:17.813 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_fsid": "a91186ae-f496-4de1-918d-820c55ff1feb", 2019-12-05T03:50:17.814 INFO:teuthology.orchestra.run.smithi096.stdout: "whoami": 0, 2019-12-05T03:50:17.814 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 4241, 2019-12-05T03:50:17.814 INFO:teuthology.orchestra.run.smithi096.stdout: "want_state": "up:active", 2019-12-05T03:50:17.814 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "up:active", 2019-12-05T03:50:17.814 INFO:teuthology.orchestra.run.smithi096.stdout: "rank_uptime": 9.4485817890000003, 2019-12-05T03:50:17.814 INFO:teuthology.orchestra.run.smithi096.stdout: "mdsmap_epoch": 6, 2019-12-05T03:50:17.814 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch": 23, 2019-12-05T03:50:17.815 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch_barrier": 23, 2019-12-05T03:50:17.815 INFO:teuthology.orchestra.run.smithi096.stdout: "uptime": 14.164716436999999 2019-12-05T03:50:17.815 INFO:teuthology.orchestra.run.smithi096.stdout:} 2019-12-05T03:50:17.820 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "a91186ae-f496-4de1-918d-820c55ff1feb", "whoami": 0, "id": 4241, "want_state": "up:active", "state": "up:active", "rank_uptime": 9.4485817890000003, "mdsmap_epoch": 6, "osdmap_epoch": 23, "osdmap_epoch_barrier": 23, "uptime": 14.164716436999999 } 2019-12-05T03:50:17.820 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2019-12-05T03:50:17.821 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2019-12-05T03:50:17.821 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi158.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2019-12-05T03:50:17.821 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:17.821 INFO:teuthology.orchestra.run.smithi158:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-12-05T03:50:17.833 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:17.833 INFO:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2019-12-05T03:50:17.916 DEBUG:teuthology.orchestra.run:got remote process result: 32 2019-12-05T03:50:17.921 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2019-12-05T03:50:17.921 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:17.922 INFO:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2019-12-05T03:50:17.998 INFO:teuthology.orchestra.run.smithi158.stdout:49 2019-12-05T03:50:18.001 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [49] 2019-12-05T03:50:18.001 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0 2019-12-05T03:50:18.068 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:18.069 INFO:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2019-12-05T03:50:18.085 DEBUG:teuthology.orchestra.run:got remote process result: 32 2019-12-05T03:50:18.090 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2019-12-05T03:50:18.090 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:18.091 INFO:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2019-12-05T03:50:18.131 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi158.stderr:2019-12-05T03:50:18.125+0000 7f0b5e976f40 -1 init, newargv = 0x55f28e04cfa0 newargc=7ceph-fuse[14508]: starting ceph client 2019-12-05T03:50:18.131 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi158.stderr: 2019-12-05T03:50:18.139 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi158.stderr:ceph-fuse[14508]: starting fuse 2019-12-05T03:50:18.163 INFO:teuthology.orchestra.run.smithi158.stdout:49 2019-12-05T03:50:18.163 INFO:teuthology.orchestra.run.smithi158.stdout:50 2019-12-05T03:50:18.163 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49, 50] 2019-12-05T03:50:18.164 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:18.164 INFO:teuthology.orchestra.run.smithi158:> sudo python2 -c ' 2019-12-05T03:50:18.164 INFO:teuthology.orchestra.run.smithi158:> import glob 2019-12-05T03:50:18.164 INFO:teuthology.orchestra.run.smithi158:> import re 2019-12-05T03:50:18.164 INFO:teuthology.orchestra.run.smithi158:> import os 2019-12-05T03:50:18.164 INFO:teuthology.orchestra.run.smithi158:> import subprocess 2019-12-05T03:50:18.165 INFO:teuthology.orchestra.run.smithi158:> 2019-12-05T03:50:18.165 INFO:teuthology.orchestra.run.smithi158:> def find_socket(client_name): 2019-12-05T03:50:18.165 INFO:teuthology.orchestra.run.smithi158:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2019-12-05T03:50:18.165 INFO:teuthology.orchestra.run.smithi158:> files = glob.glob(asok_path) 2019-12-05T03:50:18.165 INFO:teuthology.orchestra.run.smithi158:> 2019-12-05T03:50:18.167 INFO:teuthology.orchestra.run.smithi158:> # Given a non-glob path, it better be there 2019-12-05T03:50:18.167 INFO:teuthology.orchestra.run.smithi158:> if "*" not in asok_path: 2019-12-05T03:50:18.167 INFO:teuthology.orchestra.run.smithi158:> assert(len(files) == 1) 2019-12-05T03:50:18.167 INFO:teuthology.orchestra.run.smithi158:> return files[0] 2019-12-05T03:50:18.167 INFO:teuthology.orchestra.run.smithi158:> 2019-12-05T03:50:18.167 INFO:teuthology.orchestra.run.smithi158:> for f in files: 2019-12-05T03:50:18.167 INFO:teuthology.orchestra.run.smithi158:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2019-12-05T03:50:18.168 INFO:teuthology.orchestra.run.smithi158:> if os.path.exists("/proc/{0}".format(pid)): 2019-12-05T03:50:18.168 INFO:teuthology.orchestra.run.smithi158:> return f 2019-12-05T03:50:18.168 INFO:teuthology.orchestra.run.smithi158:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2019-12-05T03:50:18.168 INFO:teuthology.orchestra.run.smithi158:> 2019-12-05T03:50:18.168 INFO:teuthology.orchestra.run.smithi158:> print(find_socket("client.0")) 2019-12-05T03:50:18.168 INFO:teuthology.orchestra.run.smithi158:> ' 2019-12-05T03:50:18.269 INFO:teuthology.orchestra.run.smithi158.stdout:/var/run/ceph/ceph-client.0.14508.asok 2019-12-05T03:50:18.269 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14508.asok 2019-12-05T03:50:18.269 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:18.270 INFO:teuthology.orchestra.run.smithi158:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14508.asok status 2019-12-05T03:50:18.403 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2019-12-05T03:50:18.404 INFO:teuthology.orchestra.run.smithi158.stdout: "metadata": { 2019-12-05T03:50:18.404 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_sha1": "c5290805033483ba0cec165c06bde07dae5f19ec", 2019-12-05T03:50:18.404 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_version": "ceph version 15.0.0-8014-gc529080 (c5290805033483ba0cec165c06bde07dae5f19ec) octopus (dev)", 2019-12-05T03:50:18.404 INFO:teuthology.orchestra.run.smithi158.stdout: "entity_id": "0", 2019-12-05T03:50:18.404 INFO:teuthology.orchestra.run.smithi158.stdout: "hostname": "smithi158", 2019-12-05T03:50:18.405 INFO:teuthology.orchestra.run.smithi158.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2019-12-05T03:50:18.405 INFO:teuthology.orchestra.run.smithi158.stdout: "pid": "14508", 2019-12-05T03:50:18.405 INFO:teuthology.orchestra.run.smithi158.stdout: "root": "/" 2019-12-05T03:50:18.405 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:18.405 INFO:teuthology.orchestra.run.smithi158.stdout: "dentry_count": 0, 2019-12-05T03:50:18.405 INFO:teuthology.orchestra.run.smithi158.stdout: "dentry_pinned_count": 0, 2019-12-05T03:50:18.405 INFO:teuthology.orchestra.run.smithi158.stdout: "id": 4675, 2019-12-05T03:50:18.406 INFO:teuthology.orchestra.run.smithi158.stdout: "inst": { 2019-12-05T03:50:18.406 INFO:teuthology.orchestra.run.smithi158.stdout: "name": { 2019-12-05T03:50:18.406 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "client", 2019-12-05T03:50:18.406 INFO:teuthology.orchestra.run.smithi158.stdout: "num": 4675 2019-12-05T03:50:18.406 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:18.406 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": { 2019-12-05T03:50:18.407 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:50:18.407 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:0", 2019-12-05T03:50:18.408 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 1098873792 2019-12-05T03:50:18.408 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:18.408 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:18.408 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": { 2019-12-05T03:50:18.408 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:50:18.409 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:0", 2019-12-05T03:50:18.409 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 1098873792 2019-12-05T03:50:18.409 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:18.409 INFO:teuthology.orchestra.run.smithi158.stdout: "inst_str": "client.4675 172.21.15.158:0/1098873792", 2019-12-05T03:50:18.409 INFO:teuthology.orchestra.run.smithi158.stdout: "addr_str": "172.21.15.158:0/1098873792", 2019-12-05T03:50:18.410 INFO:teuthology.orchestra.run.smithi158.stdout: "inode_count": 1, 2019-12-05T03:50:18.410 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_epoch": 6, 2019-12-05T03:50:18.410 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_epoch": 23, 2019-12-05T03:50:18.410 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_epoch_barrier": 0, 2019-12-05T03:50:18.410 INFO:teuthology.orchestra.run.smithi158.stdout: "blacklisted": false 2019-12-05T03:50:18.410 INFO:teuthology.orchestra.run.smithi158.stdout:} 2019-12-05T03:50:18.455 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-05T03:50:18.552 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.541+0000 7fb0fadbe700 1 Processor -- start 2019-12-05T03:50:18.552 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.541+0000 7fb0fadbe700 1 -- start start 2019-12-05T03:50:18.552 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.541+0000 7fb0fadbe700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb0f405a730 0x7fb0f4155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:18.553 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.541+0000 7fb0fadbe700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0f40acca0 con 0x7fb0f409a310 2019-12-05T03:50:18.553 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.541+0000 7fb0fadbe700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0f41560f0 con 0x7fb0f409cf50 2019-12-05T03:50:18.553 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.541+0000 7fb0fadbe700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0f409a740 con 0x7fb0f405a730 2019-12-05T03:50:18.553 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.541+0000 7fb0f935b700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fb0f409cf50 0x7fb0f4151450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48904/0 (socket says 172.21.15.158:48904) 2019-12-05T03:50:18.553 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.541+0000 7fb0f935b700 1 -- 172.21.15.158:0/1424269924 learned_addr learned my addr 172.21.15.158:0/1424269924 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:18.553 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.541+0000 7fb0f9b5c700 1 --2- 172.21.15.158:0/1424269924 >> v2:172.21.15.96:3300/0 conn(0x7fb0f405a730 0x7fb0f4155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:18.554 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.541+0000 7fb0ebfff700 1 -- 172.21.15.158:0/1424269924 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1782775824 0 0) 0x7fb0f41560f0 con 0x7fb0f409cf50 2019-12-05T03:50:18.554 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.541+0000 7fb0ebfff700 1 -- 172.21.15.158:0/1424269924 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0e00030b0 con 0x7fb0f409cf50 2019-12-05T03:50:18.554 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.541+0000 7fb0ebfff700 1 -- 172.21.15.158:0/1424269924 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3705242817 0 0) 0x7fb0e00030b0 con 0x7fb0f409cf50 2019-12-05T03:50:18.554 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.541+0000 7fb0ebfff700 1 -- 172.21.15.158:0/1424269924 >> v2:172.21.15.96:3300/0 conn(0x7fb0f405a730 msgr2=0x7fb0f4155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:18.554 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.541+0000 7fb0ebfff700 1 --2- 172.21.15.158:0/1424269924 >> v2:172.21.15.96:3300/0 conn(0x7fb0f405a730 0x7fb0f4155ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:18.554 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.541+0000 7fb0ebfff700 1 -- 172.21.15.158:0/1424269924 >> v1:172.21.15.96:6789/0 conn(0x7fb0f409a310 legacy=0x7fb0f41553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:18.555 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.541+0000 7fb0ebfff700 1 -- 172.21.15.158:0/1424269924 --> v1:172.21.15.158:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f405ab60 con 0x7fb0f409cf50 2019-12-05T03:50:18.555 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.541+0000 7fb0ebfff700 1 -- 172.21.15.158:0/1424269924 <== mon.1 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 828730332 0 0) 0x7fb0f0001750 con 0x7fb0f409cf50 2019-12-05T03:50:18.555 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.541+0000 7fb0ebfff700 1 -- 172.21.15.158:0/1424269924 >> v1:172.21.15.158:6789/0 conn(0x7fb0f409cf50 legacy=0x7fb0f4151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:18.555 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.541+0000 7fb0ebfff700 1 --2- 172.21.15.158:0/1424269924 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0e0003710 0x7fb0e0003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:18.555 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.541+0000 7fb0ebfff700 1 --2- 172.21.15.158:0/1424269924 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb0e0004420 0x7fb0e0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:18.556 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.541+0000 7fb0ebfff700 1 --2- 172.21.15.158:0/1424269924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0e0004da0 0x7fb0e000b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:18.556 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.541+0000 7fb0ebfff700 1 -- 172.21.15.158:0/1424269924 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f409a740 con 0x7fb0e0004da0 2019-12-05T03:50:18.556 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.541+0000 7fb0ebfff700 1 -- 172.21.15.158:0/1424269924 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e004fc90 con 0x7fb0e0003710 2019-12-05T03:50:18.556 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.541+0000 7fb0ebfff700 1 -- 172.21.15.158:0/1424269924 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e004fed0 con 0x7fb0e0004420 2019-12-05T03:50:18.556 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.541+0000 7fb0f935b700 1 --2- 172.21.15.158:0/1424269924 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0e0003710 0x7fb0e0003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:18.556 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.541+0000 7fb0f9b5c700 1 --2- 172.21.15.158:0/1424269924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0e0004da0 0x7fb0e000b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:18.557 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.541+0000 7fb0f8b5a700 1 --2- 172.21.15.158:0/1424269924 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb0e0004420 0x7fb0e0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:18.557 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.545+0000 7fb0f935b700 1 -- 172.21.15.158:0/1424269924 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb0e0004420 msgr2=0x7fb0e0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:18.558 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.545+0000 7fb0f935b700 1 --2- 172.21.15.158:0/1424269924 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb0e0004420 0x7fb0e0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:18.558 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.545+0000 7fb0f935b700 1 -- 172.21.15.158:0/1424269924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0e0004da0 msgr2=0x7fb0e000b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:18.559 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.545+0000 7fb0f935b700 1 --2- 172.21.15.158:0/1424269924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0e0004da0 0x7fb0e000b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:18.559 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.545+0000 7fb0f9b5c700 1 -- 172.21.15.158:0/1424269924 reap_dead start 2019-12-05T03:50:18.559 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.545+0000 7fb0f935b700 1 -- 172.21.15.158:0/1424269924 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e00501d0 con 0x7fb0e0003710 2019-12-05T03:50:18.559 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.545+0000 7fb0f935b700 1 --2- 172.21.15.158:0/1424269924 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0e0003710 0x7fb0e0003b80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb0f0001950 tx=0x7fb0f000c1e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:18.566 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.545+0000 7fb0f935b700 1 --2- 172.21.15.158:0/1424269924 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0e0003710 0x7fb0e0003b80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb0f0001950 tx=0x7fb0f000c1e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:18.566 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.545+0000 7fb0f935b700 1 --2- 172.21.15.158:0/1424269924 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0e0003710 0x7fb0e0003b80 secure :-1 s=READY pgs=198 cs=0 l=1 rx=0x7fb0f0001950 tx=0x7fb0f000c1e0).ready entity=mon.1 client_cookie=65d88dc04123ea36 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:18.566 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.545+0000 7fb0f935b700 1 --2- 172.21.15.158:0/1424269924 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0e0003710 0x7fb0e0003b80 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7fb0f0001950 tx=0x7fb0f000c1e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:18.566 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.545+0000 7fb0ebfff700 1 -- 172.21.15.158:0/1424269924 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0f000e940 con 0x7fb0e0003710 2019-12-05T03:50:18.567 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.545+0000 7fb0f935b700 1 --2- 172.21.15.158:0/1424269924 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0e0003710 0x7fb0e0003b80 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7fb0f0001950 tx=0x7fb0f000c1e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:18.567 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.545+0000 7fb0f935b700 1 --2- 172.21.15.158:0/1424269924 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0e0003710 0x7fb0e0003b80 secure :-1 s=THROTTLE_DONE pgs=198 cs=0 l=1 rx=0x7fb0f0001950 tx=0x7fb0f000c1e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:18.567 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.545+0000 7fb0ebfff700 1 -- 172.21.15.158:0/1424269924 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f0010b90 con 0x7fb0e0003710 2019-12-05T03:50:18.567 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.545+0000 7fb0ebfff700 1 -- 172.21.15.158:0/1424269924 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0f000a4f0 con 0x7fb0e0003710 2019-12-05T03:50:18.569 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.545+0000 7fb0fadbe700 1 -- 172.21.15.158:0/1424269924 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0e0003710 msgr2=0x7fb0e0003b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:18.570 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.545+0000 7fb0fadbe700 1 --2- 172.21.15.158:0/1424269924 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0e0003710 0x7fb0e0003b80 secure :-1 s=READY pgs=198 cs=0 l=1 rx=0x7fb0f0001950 tx=0x7fb0f000c1e0).stop 2019-12-05T03:50:18.570 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.545+0000 7fb0fadbe700 1 -- 172.21.15.158:0/1424269924 shutdown_connections 2019-12-05T03:50:18.570 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.545+0000 7fb0fadbe700 1 --2- 172.21.15.158:0/1424269924 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0e0003710 0x7fb0e0003b80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:18.570 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.545+0000 7fb0fadbe700 1 -- 172.21.15.158:0/1424269924 shutdown_connections 2019-12-05T03:50:18.570 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.545+0000 7fb0fadbe700 1 -- 172.21.15.158:0/1424269924 wait complete. 2019-12-05T03:50:18.571 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.545+0000 7fb0fadbe700 1 -- 172.21.15.158:0/1424269924 >> 172.21.15.158:0/1424269924 conn(0x7fb0f40b7e50 msgr2=0x7fb0f40b3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:18.577 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.545+0000 7fb0fadbe700 1 Processor -- start 2019-12-05T03:50:18.577 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.545+0000 7fb0fadbe700 1 -- start start 2019-12-05T03:50:18.577 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.549+0000 7fb0fadbe700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb0f4063a80 0x7fb0f40b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:18.577 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.549+0000 7fb0fadbe700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb0f4136440 0x7fb0f41212b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:18.578 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.549+0000 7fb0fadbe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fb0f4121800 0x7fb0f4121c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:18.578 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.549+0000 7fb0fadbe700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0f4133d90 con 0x7fb0f4136440 2019-12-05T03:50:18.578 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.549+0000 7fb0fadbe700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0f4064000 con 0x7fb0f4121800 2019-12-05T03:50:18.579 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.549+0000 7fb0fadbe700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f40642a0 con 0x7fb0f4063a80 2019-12-05T03:50:18.579 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.549+0000 7fb0f9b5c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fb0f4121800 0x7fb0f4121c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:18.579 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.549+0000 7fb0f9b5c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fb0f4121800 0x7fb0f4121c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54140/0 (socket says 172.21.15.158:54140) 2019-12-05T03:50:18.580 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.549+0000 7fb0f9b5c700 1 -- 172.21.15.158:0/83083743 learned_addr learned my addr 172.21.15.158:0/83083743 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:18.580 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.549+0000 7fb0f935b700 1 --2- 172.21.15.158:0/83083743 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb0f4063a80 0x7fb0f40b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:18.581 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.549+0000 7fb0f8b5a700 1 --2- 172.21.15.158:0/83083743 >> v2:172.21.15.96:3300/0 conn(0x7fb0f4136440 0x7fb0f41212b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:18.581 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.549+0000 7fb0f9b5c700 1 -- 172.21.15.158:0/83083743 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb0f4063a80 msgr2=0x7fb0f40b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:18.581 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.549+0000 7fb0f9b5c700 1 --2- 172.21.15.158:0/83083743 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb0f4063a80 0x7fb0f40b2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:18.581 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.549+0000 7fb0f9b5c700 1 -- 172.21.15.158:0/83083743 >> v2:172.21.15.96:3300/0 conn(0x7fb0f4136440 msgr2=0x7fb0f41212b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:18.582 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.549+0000 7fb0f9b5c700 1 --2- 172.21.15.158:0/83083743 >> v2:172.21.15.96:3300/0 conn(0x7fb0f4136440 0x7fb0f41212b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:18.582 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.549+0000 7fb0f9b5c700 1 -- 172.21.15.158:0/83083743 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f40647e0 con 0x7fb0f4121800 2019-12-05T03:50:18.582 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.549+0000 7fb0f9b5c700 1 --2- 172.21.15.158:0/83083743 >> v2:172.21.15.158:3300/0 conn(0x7fb0f4121800 0x7fb0f4121c30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb0f40641c0 tx=0x7fb0ec010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:18.582 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.549+0000 7fb0f9b5c700 1 --2- 172.21.15.158:0/83083743 >> v2:172.21.15.158:3300/0 conn(0x7fb0f4121800 0x7fb0f4121c30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb0f40641c0 tx=0x7fb0ec010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:18.583 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.549+0000 7fb0f9b5c700 1 --2- 172.21.15.158:0/83083743 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0f4121800 0x7fb0f4121c30 secure :-1 s=READY pgs=199 cs=0 l=1 rx=0x7fb0f40641c0 tx=0x7fb0ec010c00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:18.583 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.549+0000 7fb0f9b5c700 1 --2- 172.21.15.158:0/83083743 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0f4121800 0x7fb0f4121c30 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7fb0f40641c0 tx=0x7fb0ec010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:18.583 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.549+0000 7fb0f9b5c700 1 --2- 172.21.15.158:0/83083743 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0f4121800 0x7fb0f4121c30 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7fb0f40641c0 tx=0x7fb0ec010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:18.583 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.549+0000 7fb0e9ffb700 1 -- 172.21.15.158:0/83083743 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0ec005ca0 con 0x7fb0f4121800 2019-12-05T03:50:18.583 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.549+0000 7fb0f9b5c700 1 --2- 172.21.15.158:0/83083743 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0f4121800 0x7fb0f4121c30 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7fb0f40641c0 tx=0x7fb0ec010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:18.583 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.549+0000 7fb0e9ffb700 1 -- 172.21.15.158:0/83083743 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0ec0058c0 con 0x7fb0f4121800 2019-12-05T03:50:18.584 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.549+0000 7fb0e9ffb700 1 -- 172.21.15.158:0/83083743 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0ec008a30 con 0x7fb0f4121800 2019-12-05T03:50:18.584 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.549+0000 7fb0fadbe700 1 -- 172.21.15.158:0/83083743 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0f4144700 con 0x7fb0f4121800 2019-12-05T03:50:18.584 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.549+0000 7fb0fadbe700 1 -- 172.21.15.158:0/83083743 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f4144cb0 con 0x7fb0f4121800 2019-12-05T03:50:18.584 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.549+0000 7fb0f9b5c700 1 --2- 172.21.15.158:0/83083743 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0f4121800 0x7fb0f4121c30 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7fb0f40641c0 tx=0x7fb0ec010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:18.584 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.553+0000 7fb0e9ffb700 1 -- 172.21.15.158:0/83083743 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fb0ec008c30 con 0x7fb0f4121800 2019-12-05T03:50:18.585 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.553+0000 7fb0f9b5c700 1 --2- 172.21.15.158:0/83083743 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0f4121800 0x7fb0f4121c30 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7fb0f40641c0 tx=0x7fb0ec010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:18.585 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.553+0000 7fb0e9ffb700 1 --2- 172.21.15.158:0/83083743 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fb0d403ad70 0x7fb0d403d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:18.585 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.553+0000 7fb0e9ffb700 1 -- 172.21.15.158:0/83083743 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fb0ec04ab70 con 0x7fb0f4121800 2019-12-05T03:50:18.585 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.553+0000 7fb0f935b700 1 --2- 172.21.15.158:0/83083743 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fb0d403ad70 0x7fb0d403d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:18.585 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.553+0000 7fb0f935b700 1 --2- 172.21.15.158:0/83083743 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fb0d403ad70 0x7fb0d403d280 crc :-1 s=READY pgs=99 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:18.586 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.557+0000 7fb0fadbe700 1 -- 172.21.15.158:0/83083743 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f40554d0 con 0x7fb0f4121800 2019-12-05T03:50:18.586 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.561+0000 7fb0f9b5c700 1 --2- 172.21.15.158:0/83083743 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0f4121800 0x7fb0f4121c30 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7fb0f40641c0 tx=0x7fb0ec010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:18.586 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.561+0000 7fb0e9ffb700 1 -- 172.21.15.158:0/83083743 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fb0ec031bf0 con 0x7fb0f4121800 2019-12-05T03:50:18.729 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.724+0000 7fb0fadbe700 1 -- 172.21.15.158:0/83083743 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0f4066930 con 0x7fb0f4121800 2019-12-05T03:50:18.730 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.724+0000 7fb0f9b5c700 1 --2- 172.21.15.158:0/83083743 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0f4121800 0x7fb0f4121c30 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7fb0f40641c0 tx=0x7fb0ec010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:18.731 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.724+0000 7fb0e9ffb700 1 -- 172.21.15.158:0/83083743 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+14933 (secure 0 0 0) 0x7fb0ec02dde0 con 0x7fb0f4121800 2019-12-05T03:50:18.733 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:18.733 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":23,"fsid":"a91186ae-f496-4de1-918d-820c55ff1feb","created":"2019-12-05T03:49:39.187523+0000","modified":"2019-12-05T03:50:01.249305+0000","last_up_change":"2019-12-05T03:49:48.551934+0000","last_in_change":"2019-12-05T03:49:48.551934+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-05T03:49:52.900870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-12-05T03:49:55.801462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-12-05T03:49:58.659250+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"782c4258-e28c-4a11-9d54-3c9c7a36fba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":12192},{"type":"v1","addr":"172.21.15.158:6801","nonce":12192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":12192},{"type":"v1","addr":"172.21.15.158:6803","nonce":12192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":12192},{"type":"v1","addr":"172.21.15.158:6807","nonce":12192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":12192},{"type":"v1","addr":"172.21.15.158:6805","nonce":12192}]},"public_addr":"172.21.15.158:6801/12192","cluster_addr":"172.21.15.158:6803/12192","heartbeat_back_addr":"172.21.15.158:6807/12192","heartbeat_front_addr":"172.21.15.158:6805/12192","state":["exists","up"]},{"osd":1,"uuid":"d4426b21-b666-4158-bf34-a24b14572731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":12193},{"type":"v1","addr":"172.21.15.158:6809","nonce":12193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":12193},{"type":"v1","addr":"172.21.15.158:6811","nonce":12193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":12193},{"type":"v1","addr":"172.21.15.158:6815","nonce":12193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":12193},{"type":"v1","addr":"172.21.15.158:6813","nonce":12193}]},"public_addr":"172.21.15.158:6809/12193","cluster_addr":"172.21.15.158:6811/12193","heartbeat_back_addr":"172.21.15.158:6815/12193","heartbeat_front_addr":"172.21.15.158:6813/12193","state":["exists","up"]},{"osd":2,"uuid":"22680edd-6490-4ab0-bb15-0605830e4cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":12195},{"type":"v1","addr":"172.21.15.158:6825","nonce":12195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":12195},{"type":"v1","addr":"172.21.15.158:6827","nonce":12195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":12195},{"type":"v1","addr":"172.21.15.158:6831","nonce":12195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":12195},{"type":"v1","addr":"172.21.15.158:6829","nonce":12195}]},"public_addr":"172.21.15.158:6825/12195","cluster_addr":"172.21.15.158:6827/12195","heartbeat_back_addr":"172.21.15.158:6831/12195","heartbeat_front_addr":"172.21.15.158:6829/12195","state":["exists","up"]},{"osd":3,"uuid":"7ec999ee-ace8-4ccb-a4f9-6f5d313bbbd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":12194},{"type":"v1","addr":"172.21.15.158:6817","nonce":12194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":12194},{"type":"v1","addr":"172.21.15.158:6819","nonce":12194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":12194},{"type":"v1","addr":"172.21.15.158:6823","nonce":12194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":12194},{"type":"v1","addr":"172.21.15.158:6821","nonce":12194}]},"public_addr":"172.21.15.158:6817/12194","cluster_addr":"172.21.15.158:6819/12194","heartbeat_back_addr":"172.21.15.158:6823/12194","heartbeat_front_addr":"172.21.15.158:6821/12194","state":["exists","up"]},{"osd":4,"uuid":"186e69c4-b69f-4dd1-bb8f-faf759c60484","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":12460},{"type":"v1","addr":"172.21.15.96:6803","nonce":12460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":12460},{"type":"v1","addr":"172.21.15.96:6805","nonce":12460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":12460},{"type":"v1","addr":"172.21.15.96:6809","nonce":12460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":12460},{"type":"v1","addr":"172.21.15.96:6807","nonce":12460}]},"public_addr":"172.21.15.96:6803/12460","cluster_addr":"172.21.15.96:6805/12460","heartbeat_back_addr":"172.21.15.96:6809/12460","heartbeat_front_addr":"172.21.15.96:6807/12460","state":["exists","up"]},{"osd":5,"uuid":"86b658b2-8b40-4cea-8163-305a3982758b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":12461},{"type":"v1","addr":"172.21.15.96:6811","nonce":12461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":12461},{"type":"v1","addr":"172.21.15.96:6813","nonce":12461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":12461},{"type":"v1","addr":"172.21.15.96:6817","nonce":12461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":12461},{"type":"v1","addr":"172.21.15.96:6815","nonce":12461}]},"public_addr":"172.21.15.96:6811/12461","cluster_addr":"172.21.15.96:6813/12461","heartbeat_back_addr":"172.21.15.96:6817/12461","heartbeat_front_addr":"172.21.15.96:6815/12461","state":["exists","up"]},{"osd":6,"uuid":"bdadaea8-9296-4788-bc59-d9c9eb8defdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":12463},{"type":"v1","addr":"172.21.15.96:6827","nonce":12463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":12463},{"type":"v1","addr":"172.21.15.96:6829","nonce":12463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":12463},{"type":"v1","addr":"172.21.15.96:6833","nonce":12463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":12463},{"type":"v1","addr":"172.21.15.96:6831","nonce":12463}]},"public_addr":"172.21.15.96:6827/12463","cluster_addr":"172.21.15.96:6829/12463","heartbeat_back_addr":"172.21.15.96:6833/12463","heartbeat_front_addr":"172.21.15.96:6831/12463","state":["exists","up"]},{"osd":7,"uuid":"c6d71846-d68e-430f-ab72-0fb8ea4bf640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":12462},{"type":"v1","addr":"172.21.15.96:6819","nonce":12462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":12462},{"type":"v1","addr":"172.21.15.96:6821","nonce":12462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":12462},{"type":"v1","addr":"172.21.15.96:6825","nonce":12462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":12462},{"type":"v1","addr":"172.21.15.96:6823","nonce":12462}]},"public_addr":"172.21.15.96:6819/12462","cluster_addr":"172.21.15.96:6821/12462","heartbeat_back_addr":"172.21.15.96:6825/12462","heartbeat_front_addr":"172.21.15.96:6823/12462","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.875762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.900817+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.210347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.133973+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.864697+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.131015+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.237225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.154377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-05T03:50:18.738 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.728+0000 7fb0fadbe700 1 -- 172.21.15.158:0/83083743 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fb0d403ad70 msgr2=0x7fb0d403d280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:18.738 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.728+0000 7fb0fadbe700 1 --2- 172.21.15.158:0/83083743 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fb0d403ad70 0x7fb0d403d280 crc :-1 s=READY pgs=99 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:18.738 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.728+0000 7fb0fadbe700 1 -- 172.21.15.158:0/83083743 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0f4121800 msgr2=0x7fb0f4121c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:18.738 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.728+0000 7fb0fadbe700 1 --2- 172.21.15.158:0/83083743 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0f4121800 0x7fb0f4121c30 secure :-1 s=READY pgs=199 cs=0 l=1 rx=0x7fb0f40641c0 tx=0x7fb0ec010c00).stop 2019-12-05T03:50:18.738 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.728+0000 7fb0fadbe700 1 -- 172.21.15.158:0/83083743 shutdown_connections 2019-12-05T03:50:18.738 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.728+0000 7fb0fadbe700 1 --2- 172.21.15.158:0/83083743 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fb0d403ad70 0x7fb0d403d280 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:18.738 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.728+0000 7fb0fadbe700 1 --2- 172.21.15.158:0/83083743 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb0f4121800 0x7fb0f4121c30 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:18.739 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.728+0000 7fb0fadbe700 1 --2- 172.21.15.158:0/83083743 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb0f4063a80 0x7fb0f40b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:18.739 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.728+0000 7fb0fadbe700 1 --2- 172.21.15.158:0/83083743 >> v2:172.21.15.96:3300/0 conn(0x7fb0f4136440 0x7fb0f41212b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:18.739 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.728+0000 7fb0fadbe700 1 -- 172.21.15.158:0/83083743 shutdown_connections 2019-12-05T03:50:18.739 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.728+0000 7fb0fadbe700 1 -- 172.21.15.158:0/83083743 wait complete. 2019-12-05T03:50:18.739 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.728+0000 7fb0fadbe700 1 -- 172.21.15.158:0/83083743 >> 172.21.15.158:0/83083743 conn(0x7fb0f40ac2c0 msgr2=0x7fb0f409a900 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:18.750 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:49:52.900870+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:49:55.801462+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:49:58.659250+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-12-05T03:50:18.751 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-12-05T03:50:18.843 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.828+0000 7fdc2aaa2700 1 Processor -- start 2019-12-05T03:50:18.843 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.828+0000 7fdc2aaa2700 1 -- start start 2019-12-05T03:50:18.843 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc2aaa2700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fdc240b6970 0x7fdc2409add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:18.843 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc2aaa2700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdc240b5370 0x7fdc240b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:18.843 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc2aaa2700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc24099e30 con 0x7fdc2409ba40 2019-12-05T03:50:18.843 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc2aaa2700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc2409d210 con 0x7fdc240b6970 2019-12-05T03:50:18.844 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc2aaa2700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc24099b90 con 0x7fdc240b5370 2019-12-05T03:50:18.844 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc2883e700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fdc2409ba40 0x7fdc2405a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48926/0 (socket says 172.21.15.158:48926) 2019-12-05T03:50:18.844 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc2883e700 1 -- 172.21.15.158:0/2724986271 learned_addr learned my addr 172.21.15.158:0/2724986271 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:18.844 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc2903f700 1 --2- 172.21.15.158:0/2724986271 >> v2:172.21.15.96:3300/0 conn(0x7fdc240b6970 0x7fdc2409add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:18.844 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc29840700 1 --2- 172.21.15.158:0/2724986271 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdc240b5370 0x7fdc240b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:18.844 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc1bfff700 1 -- 172.21.15.158:0/2724986271 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1070824388 0 0) 0x7fdc24099e30 con 0x7fdc2409ba40 2019-12-05T03:50:18.845 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc1bfff700 1 -- 172.21.15.158:0/2724986271 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc100030b0 con 0x7fdc2409ba40 2019-12-05T03:50:18.845 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc1bfff700 1 -- 172.21.15.158:0/2724986271 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3828698014 0 0) 0x7fdc100030b0 con 0x7fdc2409ba40 2019-12-05T03:50:18.845 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc1bfff700 1 -- 172.21.15.158:0/2724986271 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdc240b5370 msgr2=0x7fdc240b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:18.845 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc1bfff700 1 --2- 172.21.15.158:0/2724986271 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdc240b5370 0x7fdc240b57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:18.845 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc1bfff700 1 -- 172.21.15.158:0/2724986271 >> v2:172.21.15.96:3300/0 conn(0x7fdc240b6970 msgr2=0x7fdc2409add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:18.845 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc1bfff700 1 --2- 172.21.15.158:0/2724986271 >> v2:172.21.15.96:3300/0 conn(0x7fdc240b6970 0x7fdc2409add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:18.845 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc1bfff700 1 -- 172.21.15.158:0/2724986271 --> v1:172.21.15.158:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2407e960 con 0x7fdc2409ba40 2019-12-05T03:50:18.846 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc1bfff700 1 -- 172.21.15.158:0/2724986271 <== mon.1 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 828730332 0 0) 0x7fdc20001750 con 0x7fdc2409ba40 2019-12-05T03:50:18.846 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc1bfff700 1 -- 172.21.15.158:0/2724986271 >> v1:172.21.15.158:6789/0 conn(0x7fdc2409ba40 legacy=0x7fdc2405a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:18.846 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc1bfff700 1 --2- 172.21.15.158:0/2724986271 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdc100036e0 0x7fdc10003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:18.846 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc1bfff700 1 --2- 172.21.15.158:0/2724986271 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdc10004420 0x7fdc10004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:18.846 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc1bfff700 1 --2- 172.21.15.158:0/2724986271 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc10004da0 0x7fdc1004f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:18.846 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc1bfff700 1 -- 172.21.15.158:0/2724986271 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2409d210 con 0x7fdc10004da0 2019-12-05T03:50:18.846 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc1bfff700 1 -- 172.21.15.158:0/2724986271 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc24099b90 con 0x7fdc100036e0 2019-12-05T03:50:18.847 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc1bfff700 1 -- 172.21.15.158:0/2724986271 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc10005220 con 0x7fdc10004420 2019-12-05T03:50:18.847 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc2883e700 1 --2- 172.21.15.158:0/2724986271 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdc10004420 0x7fdc10004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:18.847 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc2903f700 1 --2- 172.21.15.158:0/2724986271 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdc100036e0 0x7fdc10003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:18.847 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc29840700 1 --2- 172.21.15.158:0/2724986271 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc10004da0 0x7fdc1004f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:18.847 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc2903f700 1 -- 172.21.15.158:0/2724986271 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdc10004420 msgr2=0x7fdc10004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:18.847 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc2903f700 1 --2- 172.21.15.158:0/2724986271 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdc10004420 0x7fdc10004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:18.847 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc2903f700 1 -- 172.21.15.158:0/2724986271 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc10004da0 msgr2=0x7fdc1004f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:18.848 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc2903f700 1 --2- 172.21.15.158:0/2724986271 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc10004da0 0x7fdc1004f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:18.848 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc2903f700 1 -- 172.21.15.158:0/2724986271 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc1004fcc0 con 0x7fdc100036e0 2019-12-05T03:50:18.849 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc2903f700 1 --2- 172.21.15.158:0/2724986271 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdc100036e0 0x7fdc10003b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdc14002f30 tx=0x7fdc1400ffe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:18.849 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc2903f700 1 --2- 172.21.15.158:0/2724986271 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdc100036e0 0x7fdc10003b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdc14002f30 tx=0x7fdc1400ffe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:18.849 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc2903f700 1 --2- 172.21.15.158:0/2724986271 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdc100036e0 0x7fdc10003b70 secure :-1 s=READY pgs=201 cs=0 l=1 rx=0x7fdc14002f30 tx=0x7fdc1400ffe0).ready entity=mon.1 client_cookie=7b58969b7caee237 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:18.849 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc2903f700 1 --2- 172.21.15.158:0/2724986271 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdc100036e0 0x7fdc10003b70 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7fdc14002f30 tx=0x7fdc1400ffe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:18.849 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc2903f700 1 --2- 172.21.15.158:0/2724986271 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdc100036e0 0x7fdc10003b70 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7fdc14002f30 tx=0x7fdc1400ffe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:18.849 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc1bfff700 1 -- 172.21.15.158:0/2724986271 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc14010d10 con 0x7fdc100036e0 2019-12-05T03:50:18.850 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc2903f700 1 --2- 172.21.15.158:0/2724986271 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdc100036e0 0x7fdc10003b70 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7fdc14002f30 tx=0x7fdc1400ffe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:18.850 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc1bfff700 1 -- 172.21.15.158:0/2724986271 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc14010930 con 0x7fdc100036e0 2019-12-05T03:50:18.850 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc1bfff700 1 -- 172.21.15.158:0/2724986271 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc14008bd0 con 0x7fdc100036e0 2019-12-05T03:50:18.850 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc2aaa2700 1 -- 172.21.15.158:0/2724986271 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdc100036e0 msgr2=0x7fdc10003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:18.850 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc2aaa2700 1 --2- 172.21.15.158:0/2724986271 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fdc100036e0 0x7fdc10003b70 secure :-1 s=READY pgs=201 cs=0 l=1 rx=0x7fdc14002f30 tx=0x7fdc1400ffe0).stop 2019-12-05T03:50:18.851 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc29840700 1 -- 172.21.15.158:0/2724986271 reap_dead start 2019-12-05T03:50:18.851 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc2aaa2700 1 -- 172.21.15.158:0/2724986271 shutdown_connections 2019-12-05T03:50:18.851 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc2aaa2700 1 -- 172.21.15.158:0/2724986271 shutdown_connections 2019-12-05T03:50:18.851 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc2aaa2700 1 -- 172.21.15.158:0/2724986271 wait complete. 2019-12-05T03:50:18.851 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.832+0000 7fdc2aaa2700 1 -- 172.21.15.158:0/2724986271 >> 172.21.15.158:0/2724986271 conn(0x7fdc240b7ef0 msgr2=0x7fdc240b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:18.855 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.836+0000 7fdc2aaa2700 1 Processor -- start 2019-12-05T03:50:18.856 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.836+0000 7fdc2aaa2700 1 -- start start 2019-12-05T03:50:18.856 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.840+0000 7fdc2aaa2700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdc240adc20 0x7fdc24059730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:18.856 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.840+0000 7fdc2aaa2700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc24064960 con 0x7fdc24065260 2019-12-05T03:50:18.856 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.840+0000 7fdc2aaa2700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc241418d0 con 0x7fdc2407d610 2019-12-05T03:50:18.857 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.840+0000 7fdc2aaa2700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc24063c20 con 0x7fdc240adc20 2019-12-05T03:50:18.857 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.840+0000 7fdc29840700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fdc2407d610 0x7fdc241410d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48940/0 (socket says 172.21.15.158:48940) 2019-12-05T03:50:18.857 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.840+0000 7fdc29840700 1 -- 172.21.15.158:0/2167200057 learned_addr learned my addr 172.21.15.158:0/2167200057 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:18.857 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.840+0000 7fdc2883e700 1 --2- 172.21.15.158:0/2167200057 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdc240adc20 0x7fdc24059730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:18.858 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.840+0000 7fdc19ffb700 1 -- 172.21.15.158:0/2167200057 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1434776060 0 0) 0x7fdc241418d0 con 0x7fdc2407d610 2019-12-05T03:50:18.858 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.840+0000 7fdc19ffb700 1 -- 172.21.15.158:0/2167200057 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc040030b0 con 0x7fdc2407d610 2019-12-05T03:50:18.866 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.840+0000 7fdc19ffb700 1 -- 172.21.15.158:0/2167200057 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2157647757 0 0) 0x7fdc24064960 con 0x7fdc24065260 2019-12-05T03:50:18.866 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.840+0000 7fdc19ffb700 1 -- 172.21.15.158:0/2167200057 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc241418d0 con 0x7fdc24065260 2019-12-05T03:50:18.866 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.840+0000 7fdc19ffb700 1 -- 172.21.15.158:0/2167200057 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3601211294 0 0) 0x7fdc040030b0 con 0x7fdc2407d610 2019-12-05T03:50:18.867 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.840+0000 7fdc2883e700 1 -- 172.21.15.158:0/2167200057 >> v1:172.21.15.158:6789/0 conn(0x7fdc2407d610 legacy=0x7fdc241410d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:18.867 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.840+0000 7fdc2883e700 1 -- 172.21.15.158:0/2167200057 >> v1:172.21.15.96:6789/0 conn(0x7fdc24065260 legacy=0x7fdc24064160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:18.867 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.840+0000 7fdc2883e700 1 -- 172.21.15.158:0/2167200057 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc24141b00 con 0x7fdc240adc20 2019-12-05T03:50:18.867 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.840+0000 7fdc2883e700 1 --2- 172.21.15.158:0/2167200057 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdc240adc20 0x7fdc24059730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdc2405a450 tx=0x7fdc1400fb70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:18.868 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.840+0000 7fdc2883e700 1 --2- 172.21.15.158:0/2167200057 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdc240adc20 0x7fdc24059730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdc2405a450 tx=0x7fdc1400fb70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:18.868 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.840+0000 7fdc2883e700 1 --2- 172.21.15.158:0/2167200057 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdc240adc20 0x7fdc24059730 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7fdc2405a450 tx=0x7fdc1400fb70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:18.868 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.840+0000 7fdc2883e700 1 --2- 172.21.15.158:0/2167200057 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdc240adc20 0x7fdc24059730 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7fdc2405a450 tx=0x7fdc1400fb70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:18.868 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.840+0000 7fdc19ffb700 1 -- 172.21.15.158:0/2167200057 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc1c001810 con 0x7fdc240adc20 2019-12-05T03:50:18.870 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.840+0000 7fdc2883e700 1 --2- 172.21.15.158:0/2167200057 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdc240adc20 0x7fdc24059730 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7fdc2405a450 tx=0x7fdc1400fb70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:18.870 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.840+0000 7fdc19ffb700 1 -- 172.21.15.158:0/2167200057 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc1c001620 con 0x7fdc240adc20 2019-12-05T03:50:18.870 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.840+0000 7fdc2883e700 1 --2- 172.21.15.158:0/2167200057 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdc240adc20 0x7fdc24059730 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7fdc2405a450 tx=0x7fdc1400fb70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:18.870 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.840+0000 7fdc2aaa2700 1 -- 172.21.15.158:0/2167200057 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc2407da40 con 0x7fdc240adc20 2019-12-05T03:50:18.871 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.840+0000 7fdc19ffb700 1 -- 172.21.15.158:0/2167200057 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc200047f0 con 0x7fdc240adc20 2019-12-05T03:50:18.872 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.840+0000 7fdc2aaa2700 1 -- 172.21.15.158:0/2167200057 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc2414c840 con 0x7fdc240adc20 2019-12-05T03:50:18.872 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.840+0000 7fdc2883e700 1 --2- 172.21.15.158:0/2167200057 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdc240adc20 0x7fdc24059730 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7fdc2405a450 tx=0x7fdc1400fb70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:18.872 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.840+0000 7fdc19ffb700 1 -- 172.21.15.158:0/2167200057 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fdc20004a90 con 0x7fdc240adc20 2019-12-05T03:50:18.872 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.840+0000 7fdc2883e700 1 --2- 172.21.15.158:0/2167200057 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdc240adc20 0x7fdc24059730 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7fdc2405a450 tx=0x7fdc1400fb70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:18.873 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.844+0000 7fdc19ffb700 1 --2- 172.21.15.158:0/2167200057 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fdc0403b410 0x7fdc0403d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:18.873 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.844+0000 7fdc19ffb700 1 -- 172.21.15.158:0/2167200057 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fdc2004a7d0 con 0x7fdc240adc20 2019-12-05T03:50:18.873 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.844+0000 7fdc2903f700 1 --2- 172.21.15.158:0/2167200057 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fdc0403b410 0x7fdc0403d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:18.873 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.844+0000 7fdc2903f700 1 --2- 172.21.15.158:0/2167200057 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fdc0403b410 0x7fdc0403d920 crc :-1 s=READY pgs=100 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:18.874 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.844+0000 7fdc2aaa2700 1 -- 172.21.15.158:0/2167200057 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc240554e0 con 0x7fdc240adc20 2019-12-05T03:50:18.874 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.852+0000 7fdc2883e700 1 --2- 172.21.15.158:0/2167200057 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdc240adc20 0x7fdc24059730 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7fdc2405a450 tx=0x7fdc1400fb70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:18.875 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:18.852+0000 7fdc19ffb700 1 -- 172.21.15.158:0/2167200057 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fdc20031810 con 0x7fdc240adc20 2019-12-05T03:50:19.021 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.016+0000 7fdc2aaa2700 1 -- 172.21.15.158:0/2167200057 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fdc24099d50 con 0x7fdc240adc20 2019-12-05T03:50:19.022 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.016+0000 7fdc2883e700 1 --2- 172.21.15.158:0/2167200057 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdc240adc20 0x7fdc24059730 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7fdc2405a450 tx=0x7fdc1400fb70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.022 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.016+0000 7fdc19ffb700 1 -- 172.21.15.158:0/2167200057 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdc20004da0 con 0x7fdc240adc20 2019-12-05T03:50:19.024 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:50:19.027 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.020+0000 7fdc2aaa2700 1 -- 172.21.15.158:0/2167200057 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fdc0403b410 msgr2=0x7fdc0403d920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:19.027 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.020+0000 7fdc2aaa2700 1 --2- 172.21.15.158:0/2167200057 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fdc0403b410 0x7fdc0403d920 crc :-1 s=READY pgs=100 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:19.028 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.020+0000 7fdc2aaa2700 1 -- 172.21.15.158:0/2167200057 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdc240adc20 msgr2=0x7fdc24059730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:19.028 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.020+0000 7fdc2aaa2700 1 --2- 172.21.15.158:0/2167200057 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdc240adc20 0x7fdc24059730 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7fdc2405a450 tx=0x7fdc1400fb70).stop 2019-12-05T03:50:19.028 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.020+0000 7fdc2aaa2700 1 -- 172.21.15.158:0/2167200057 shutdown_connections 2019-12-05T03:50:19.028 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.020+0000 7fdc2aaa2700 1 --2- 172.21.15.158:0/2167200057 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fdc0403b410 0x7fdc0403d920 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:19.028 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.020+0000 7fdc2aaa2700 1 --2- 172.21.15.158:0/2167200057 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fdc240adc20 0x7fdc24059730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:19.028 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.020+0000 7fdc2aaa2700 1 -- 172.21.15.158:0/2167200057 shutdown_connections 2019-12-05T03:50:19.029 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.020+0000 7fdc2aaa2700 1 -- 172.21.15.158:0/2167200057 wait complete. 2019-12-05T03:50:19.030 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.020+0000 7fdc2aaa2700 1 -- 172.21.15.158:0/2167200057 >> 172.21.15.158:0/2167200057 conn(0x7fdc240b1e30 msgr2=0x7fdc2409a320 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:19.037 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-12-05T03:50:19.139 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.124+0000 7f3163aa2700 1 Processor -- start 2019-12-05T03:50:19.139 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.124+0000 7f3163aa2700 1 -- start start 2019-12-05T03:50:19.140 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.128+0000 7f3163aa2700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f315c0b6970 0x7f315c09add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:19.140 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.128+0000 7f3163aa2700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f315c09ba40 0x7f315c05a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:19.140 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.128+0000 7f3163aa2700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f315c099e30 con 0x7f315c05a950 2019-12-05T03:50:19.140 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.128+0000 7f3163aa2700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f315c09d210 con 0x7f315c09ba40 2019-12-05T03:50:19.140 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.128+0000 7f3163aa2700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f315c099b90 con 0x7f315c0b6970 2019-12-05T03:50:19.140 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.128+0000 7f3162840700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f315c05a950 0x7f315c155290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48946/0 (socket says 172.21.15.158:48946) 2019-12-05T03:50:19.141 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.128+0000 7f3162840700 1 -- 172.21.15.158:0/3811659487 learned_addr learned my addr 172.21.15.158:0/3811659487 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:19.141 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.128+0000 7f316203f700 1 --2- 172.21.15.158:0/3811659487 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f315c0b6970 0x7f315c09add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:19.141 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.128+0000 7f316183e700 1 --2- 172.21.15.158:0/3811659487 >> v2:172.21.15.96:3300/0 conn(0x7f315c09ba40 0x7f315c05a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:19.141 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.128+0000 7f316103d700 1 -- 172.21.15.158:0/3811659487 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3803509864 0 0) 0x7f315c099e30 con 0x7f315c05a950 2019-12-05T03:50:19.141 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.128+0000 7f316103d700 1 -- 172.21.15.158:0/3811659487 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31480030b0 con 0x7f315c05a950 2019-12-05T03:50:19.141 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.128+0000 7f316203f700 1 -- 172.21.15.158:0/3811659487 >> v2:172.21.15.96:3300/0 conn(0x7f315c09ba40 msgr2=0x7f315c05a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:19.141 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.128+0000 7f316203f700 1 --2- 172.21.15.158:0/3811659487 >> v2:172.21.15.96:3300/0 conn(0x7f315c09ba40 0x7f315c05a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:19.141 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.128+0000 7f316203f700 1 -- 172.21.15.158:0/3811659487 >> v1:172.21.15.158:6789/0 conn(0x7f315c05a950 legacy=0x7f315c155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:19.142 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.128+0000 7f316203f700 1 -- 172.21.15.158:0/3811659487 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f315c07e960 con 0x7f315c0b6970 2019-12-05T03:50:19.142 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.128+0000 7f316183e700 1 --2- 172.21.15.158:0/3811659487 >> v2:172.21.15.96:3300/0 conn(0x7f315c09ba40 0x7f315c05a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:50:19.142 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.128+0000 7f316203f700 1 --2- 172.21.15.158:0/3811659487 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f315c0b6970 0x7f315c09add0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3158008790 tx=0x7f315800fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.142 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.128+0000 7f316203f700 1 --2- 172.21.15.158:0/3811659487 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f315c0b6970 0x7f315c09add0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3158008790 tx=0x7f315800fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.142 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.128+0000 7f316203f700 1 --2- 172.21.15.158:0/3811659487 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f315c0b6970 0x7f315c09add0 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7f3158008790 tx=0x7f315800fc70).ready entity=mon.2 client_cookie=cedcebd5d88e128a server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:19.142 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.128+0000 7f316203f700 1 --2- 172.21.15.158:0/3811659487 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f315c0b6970 0x7f315c09add0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f3158008790 tx=0x7f315800fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.142 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.128+0000 7f316103d700 1 -- 172.21.15.158:0/3811659487 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3158008bb0 con 0x7f315c0b6970 2019-12-05T03:50:19.143 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.128+0000 7f316203f700 1 --2- 172.21.15.158:0/3811659487 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f315c0b6970 0x7f315c09add0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f3158008790 tx=0x7f315800fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.143 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.128+0000 7f316203f700 1 --2- 172.21.15.158:0/3811659487 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f315c0b6970 0x7f315c09add0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f3158008790 tx=0x7f315800fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.143 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.128+0000 7f316103d700 1 -- 172.21.15.158:0/3811659487 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31580087d0 con 0x7f315c0b6970 2019-12-05T03:50:19.143 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.128+0000 7f316103d700 1 -- 172.21.15.158:0/3811659487 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3158011860 con 0x7f315c0b6970 2019-12-05T03:50:19.143 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.128+0000 7f3163aa2700 1 -- 172.21.15.158:0/3811659487 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f315c0b6970 msgr2=0x7f315c09add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:19.143 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.128+0000 7f3163aa2700 1 --2- 172.21.15.158:0/3811659487 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f315c0b6970 0x7f315c09add0 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7f3158008790 tx=0x7f315800fc70).stop 2019-12-05T03:50:19.143 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.132+0000 7f3163aa2700 1 -- 172.21.15.158:0/3811659487 shutdown_connections 2019-12-05T03:50:19.144 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.132+0000 7f3163aa2700 1 --2- 172.21.15.158:0/3811659487 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f315c0b6970 0x7f315c09add0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:19.144 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.132+0000 7f3163aa2700 1 --2- 172.21.15.158:0/3811659487 >> v2:172.21.15.96:3300/0 conn(0x7f315c09ba40 0x7f315c05a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:19.145 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.132+0000 7f3163aa2700 1 -- 172.21.15.158:0/3811659487 shutdown_connections 2019-12-05T03:50:19.146 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.132+0000 7f3163aa2700 1 -- 172.21.15.158:0/3811659487 wait complete. 2019-12-05T03:50:19.146 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.132+0000 7f3163aa2700 1 -- 172.21.15.158:0/3811659487 >> 172.21.15.158:0/3811659487 conn(0x7f315c0b7ef0 msgr2=0x7f315c0b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:19.149 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.132+0000 7f3163aa2700 1 Processor -- start 2019-12-05T03:50:19.149 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.132+0000 7f3163aa2700 1 -- start start 2019-12-05T03:50:19.149 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.136+0000 7f3163aa2700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f315c07b8e0 0x7f315c0ae740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:19.149 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.136+0000 7f3163aa2700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f315c0ad5d0 con 0x7f315c13dd50 2019-12-05T03:50:19.149 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.136+0000 7f3163aa2700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f315c0aec90 con 0x7f315c13e180 2019-12-05T03:50:19.150 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.136+0000 7f3163aa2700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f315c0b1f40 con 0x7f315c07b8e0 2019-12-05T03:50:19.150 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.136+0000 7f316203f700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f315c07b8e0 0x7f315c0ae740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:19.150 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.136+0000 7f316203f700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f315c07b8e0 0x7f315c0ae740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54172/0 (socket says 172.21.15.158:54172) 2019-12-05T03:50:19.150 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.136+0000 7f3162840700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f315c13e180 0x7f315c0ac500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48952/0 (socket says 172.21.15.158:48952) 2019-12-05T03:50:19.150 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.136+0000 7f316203f700 1 -- 172.21.15.158:0/2563914135 learned_addr learned my addr 172.21.15.158:0/2563914135 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:19.150 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.136+0000 7f316203f700 1 -- 172.21.15.158:0/2563914135 >> v1:172.21.15.158:6789/0 conn(0x7f315c13e180 legacy=0x7f315c0ac500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:19.150 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.136+0000 7f3152ffd700 1 -- 172.21.15.158:0/2563914135 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4188958454 0 0) 0x7f315c0ad5d0 con 0x7f315c13dd50 2019-12-05T03:50:19.151 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.136+0000 7f316203f700 1 -- 172.21.15.158:0/2563914135 >> v1:172.21.15.96:6789/0 conn(0x7f315c13dd50 legacy=0x7f315c153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:19.151 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.136+0000 7f316203f700 1 -- 172.21.15.158:0/2563914135 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f315c0acd00 con 0x7f315c07b8e0 2019-12-05T03:50:19.151 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.136+0000 7f316203f700 1 --2- 172.21.15.158:0/2563914135 >> v2:172.21.15.158:3300/0 conn(0x7f315c07b8e0 0x7f315c0ae740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3158008790 tx=0x7f31580118a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.151 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.136+0000 7f316203f700 1 --2- 172.21.15.158:0/2563914135 >> v2:172.21.15.158:3300/0 conn(0x7f315c07b8e0 0x7f315c0ae740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3158008790 tx=0x7f31580118a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.151 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.136+0000 7f316203f700 1 --2- 172.21.15.158:0/2563914135 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f315c07b8e0 0x7f315c0ae740 secure :-1 s=READY pgs=205 cs=0 l=1 rx=0x7f3158008790 tx=0x7f31580118a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:19.151 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.136+0000 7f316203f700 1 --2- 172.21.15.158:0/2563914135 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f315c07b8e0 0x7f315c0ae740 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7f3158008790 tx=0x7f31580118a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.151 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.136+0000 7f3152ffd700 1 -- 172.21.15.158:0/2563914135 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f315800f280 con 0x7f315c07b8e0 2019-12-05T03:50:19.152 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.136+0000 7f316203f700 1 --2- 172.21.15.158:0/2563914135 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f315c07b8e0 0x7f315c0ae740 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7f3158008790 tx=0x7f31580118a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.152 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.136+0000 7f3152ffd700 1 -- 172.21.15.158:0/2563914135 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3158008db0 con 0x7f315c07b8e0 2019-12-05T03:50:19.152 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.136+0000 7f316203f700 1 --2- 172.21.15.158:0/2563914135 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f315c07b8e0 0x7f315c0ae740 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7f3158008790 tx=0x7f31580118a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.152 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.136+0000 7f3152ffd700 1 -- 172.21.15.158:0/2563914135 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3158005540 con 0x7f315c07b8e0 2019-12-05T03:50:19.152 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.136+0000 7f3163aa2700 1 -- 172.21.15.158:0/2563914135 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f315c0acfd0 con 0x7f315c07b8e0 2019-12-05T03:50:19.152 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.136+0000 7f3163aa2700 1 -- 172.21.15.158:0/2563914135 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f315c145dc0 con 0x7f315c07b8e0 2019-12-05T03:50:19.152 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.140+0000 7f316203f700 1 --2- 172.21.15.158:0/2563914135 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f315c07b8e0 0x7f315c0ae740 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7f3158008790 tx=0x7f31580118a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.153 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.140+0000 7f3152ffd700 1 -- 172.21.15.158:0/2563914135 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f3158005820 con 0x7f315c07b8e0 2019-12-05T03:50:19.153 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.140+0000 7f316203f700 1 --2- 172.21.15.158:0/2563914135 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f315c07b8e0 0x7f315c0ae740 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7f3158008790 tx=0x7f31580118a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.153 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.140+0000 7f3152ffd700 1 --2- 172.21.15.158:0/2563914135 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f314403abb0 0x7f314403d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:19.153 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.140+0000 7f3152ffd700 1 -- 172.21.15.158:0/2563914135 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f315804b3c0 con 0x7f315c07b8e0 2019-12-05T03:50:19.153 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.140+0000 7f316183e700 1 --2- 172.21.15.158:0/2563914135 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f314403abb0 0x7f314403d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:19.153 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.140+0000 7f316183e700 1 --2- 172.21.15.158:0/2563914135 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f314403abb0 0x7f314403d0c0 crc :-1 s=READY pgs=101 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:19.153 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.140+0000 7f3163aa2700 1 -- 172.21.15.158:0/2563914135 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f315c0554e0 con 0x7f315c07b8e0 2019-12-05T03:50:19.154 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.144+0000 7f316203f700 1 --2- 172.21.15.158:0/2563914135 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f315c07b8e0 0x7f315c0ae740 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7f3158008790 tx=0x7f31580118a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.154 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.144+0000 7f3152ffd700 1 -- 172.21.15.158:0/2563914135 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f3158032680 con 0x7f315c07b8e0 2019-12-05T03:50:19.306 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.300+0000 7f3163aa2700 1 -- 172.21.15.158:0/2563914135 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f315c066940 con 0x7f315c07b8e0 2019-12-05T03:50:19.307 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.300+0000 7f316203f700 1 --2- 172.21.15.158:0/2563914135 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f315c07b8e0 0x7f315c0ae740 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7f3158008790 tx=0x7f31580118a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.307 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.300+0000 7f3152ffd700 1 -- 172.21.15.158:0/2563914135 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7f3158007f10 con 0x7f315c07b8e0 2019-12-05T03:50:19.307 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:50:19.309 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.300+0000 7f3163aa2700 1 -- 172.21.15.158:0/2563914135 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f314403abb0 msgr2=0x7f314403d0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:19.310 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.300+0000 7f3163aa2700 1 --2- 172.21.15.158:0/2563914135 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f314403abb0 0x7f314403d0c0 crc :-1 s=READY pgs=101 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:19.310 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.300+0000 7f3163aa2700 1 -- 172.21.15.158:0/2563914135 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f315c07b8e0 msgr2=0x7f315c0ae740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:19.310 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.300+0000 7f3163aa2700 1 --2- 172.21.15.158:0/2563914135 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f315c07b8e0 0x7f315c0ae740 secure :-1 s=READY pgs=205 cs=0 l=1 rx=0x7f3158008790 tx=0x7f31580118a0).stop 2019-12-05T03:50:19.310 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.300+0000 7f3163aa2700 1 -- 172.21.15.158:0/2563914135 shutdown_connections 2019-12-05T03:50:19.310 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.300+0000 7f3163aa2700 1 --2- 172.21.15.158:0/2563914135 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f315c07b8e0 0x7f315c0ae740 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:19.310 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.300+0000 7f3163aa2700 1 --2- 172.21.15.158:0/2563914135 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f314403abb0 0x7f314403d0c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:19.311 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.304+0000 7f3163aa2700 1 -- 172.21.15.158:0/2563914135 shutdown_connections 2019-12-05T03:50:19.311 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.304+0000 7f3163aa2700 1 -- 172.21.15.158:0/2563914135 wait complete. 2019-12-05T03:50:19.311 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.304+0000 7f3163aa2700 1 -- 172.21.15.158:0/2563914135 >> 172.21.15.158:0/2563914135 conn(0x7f315c12ec40 msgr2=0x7f315c05a500 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:19.319 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-12-05T03:50:19.421 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.400+0000 7f383ca9f700 1 Processor -- start 2019-12-05T03:50:19.421 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.400+0000 7f383ca9f700 1 -- start start 2019-12-05T03:50:19.422 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.400+0000 7f383ca9f700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f38380b6970 0x7f383809add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:19.422 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f383ca9f700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3838099e30 con 0x7f38380b5370 2019-12-05T03:50:19.422 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f383ca9f700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f383807e960 con 0x7f383809ba40 2019-12-05T03:50:19.422 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f383ca9f700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f383809d210 con 0x7f38380b6970 2019-12-05T03:50:19.422 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f383659c700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f383809ba40 0x7f383805a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48958/0 (socket says 172.21.15.158:48958) 2019-12-05T03:50:19.422 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f383659c700 1 -- 172.21.15.158:0/2969985913 learned_addr learned my addr 172.21.15.158:0/2969985913 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:19.422 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f3836d9d700 1 --2- 172.21.15.158:0/2969985913 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f38380b6970 0x7f383809add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:19.423 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f3835d9b700 1 -- 172.21.15.158:0/2969985913 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4218093259 0 0) 0x7f383807e960 con 0x7f383809ba40 2019-12-05T03:50:19.423 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f3835d9b700 1 -- 172.21.15.158:0/2969985913 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38240030b0 con 0x7f383809ba40 2019-12-05T03:50:19.423 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f3835d9b700 1 -- 172.21.15.158:0/2969985913 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 982048082 0 0) 0x7f3838099e30 con 0x7f38380b5370 2019-12-05T03:50:19.423 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f3835d9b700 1 -- 172.21.15.158:0/2969985913 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f383807e960 con 0x7f38380b5370 2019-12-05T03:50:19.423 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f3835d9b700 1 -- 172.21.15.158:0/2969985913 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3277999346 0 0) 0x7f38240030b0 con 0x7f383809ba40 2019-12-05T03:50:19.423 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f3835d9b700 1 -- 172.21.15.158:0/2969985913 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f38380b6970 msgr2=0x7f383809add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:19.423 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f3835d9b700 1 --2- 172.21.15.158:0/2969985913 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f38380b6970 0x7f383809add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:19.424 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f3835d9b700 1 -- 172.21.15.158:0/2969985913 >> v1:172.21.15.96:6789/0 conn(0x7f38380b5370 legacy=0x7f38380b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:19.424 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f3835d9b700 1 -- 172.21.15.158:0/2969985913 --> v1:172.21.15.158:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38380b5fa0 con 0x7f383809ba40 2019-12-05T03:50:19.424 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f3835d9b700 1 -- 172.21.15.158:0/2969985913 <== mon.1 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 828730332 0 0) 0x7f38200016d0 con 0x7f383809ba40 2019-12-05T03:50:19.424 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f3835d9b700 1 -- 172.21.15.158:0/2969985913 >> v1:172.21.15.158:6789/0 conn(0x7f383809ba40 legacy=0x7f383805a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:19.424 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f3835d9b700 1 --2- 172.21.15.158:0/2969985913 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3824003940 0x7f3824003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:19.425 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f3835d9b700 1 --2- 172.21.15.158:0/2969985913 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3824004470 0x7f38240048c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:19.425 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f3835d9b700 1 --2- 172.21.15.158:0/2969985913 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3824004e80 0x7f382404f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:19.425 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f3835d9b700 1 -- 172.21.15.158:0/2969985913 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383809d210 con 0x7f3824004e80 2019-12-05T03:50:19.425 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f3835d9b700 1 -- 172.21.15.158:0/2969985913 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382404fc00 con 0x7f3824003940 2019-12-05T03:50:19.425 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f3835d9b700 1 -- 172.21.15.158:0/2969985913 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382404fe40 con 0x7f3824004470 2019-12-05T03:50:19.425 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f3836d9d700 1 --2- 172.21.15.158:0/2969985913 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3824003940 0x7f3824003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:19.425 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f383659c700 1 --2- 172.21.15.158:0/2969985913 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3824004470 0x7f38240048c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:19.426 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f383759e700 1 --2- 172.21.15.158:0/2969985913 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3824004e80 0x7f382404f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:19.426 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f3836d9d700 1 -- 172.21.15.158:0/2969985913 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3824004470 msgr2=0x7f38240048c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:19.426 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f3836d9d700 1 --2- 172.21.15.158:0/2969985913 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3824004470 0x7f38240048c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:19.426 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f3836d9d700 1 -- 172.21.15.158:0/2969985913 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3824004e80 msgr2=0x7f382404f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:19.426 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f3836d9d700 1 --2- 172.21.15.158:0/2969985913 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3824004e80 0x7f382404f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:19.426 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f3836d9d700 1 -- 172.21.15.158:0/2969985913 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3824050140 con 0x7f3824003940 2019-12-05T03:50:19.426 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f383759e700 1 --2- 172.21.15.158:0/2969985913 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3824004e80 0x7f382404f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-12-05T03:50:19.427 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f3836d9d700 1 --2- 172.21.15.158:0/2969985913 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3824003940 0x7f3824003db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3828002f30 tx=0x7f382800ffe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.427 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f3836d9d700 1 --2- 172.21.15.158:0/2969985913 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3824003940 0x7f3824003db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3828002f30 tx=0x7f382800ffe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.427 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f3836d9d700 1 --2- 172.21.15.158:0/2969985913 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3824003940 0x7f3824003db0 secure :-1 s=READY pgs=207 cs=0 l=1 rx=0x7f3828002f30 tx=0x7f382800ffe0).ready entity=mon.1 client_cookie=168127529874ee15 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:19.427 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f3836d9d700 1 --2- 172.21.15.158:0/2969985913 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3824003940 0x7f3824003db0 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7f3828002f30 tx=0x7f382800ffe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.427 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f3835d9b700 1 -- 172.21.15.158:0/2969985913 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3828010d10 con 0x7f3824003940 2019-12-05T03:50:19.427 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f3836d9d700 1 --2- 172.21.15.158:0/2969985913 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3824003940 0x7f3824003db0 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7f3828002f30 tx=0x7f382800ffe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.427 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f3835d9b700 1 -- 172.21.15.158:0/2969985913 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3828010930 con 0x7f3824003940 2019-12-05T03:50:19.428 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f3836d9d700 1 --2- 172.21.15.158:0/2969985913 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3824003940 0x7f3824003db0 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7f3828002f30 tx=0x7f382800ffe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.428 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f383ca9f700 1 -- 172.21.15.158:0/2969985913 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3824003940 msgr2=0x7f3824003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:19.428 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f3835d9b700 1 -- 172.21.15.158:0/2969985913 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3828008bb0 con 0x7f3824003940 2019-12-05T03:50:19.428 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f383ca9f700 1 --2- 172.21.15.158:0/2969985913 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3824003940 0x7f3824003db0 secure :-1 s=READY pgs=207 cs=0 l=1 rx=0x7f3828002f30 tx=0x7f382800ffe0).stop 2019-12-05T03:50:19.428 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f383759e700 1 -- 172.21.15.158:0/2969985913 reap_dead start 2019-12-05T03:50:19.428 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f383ca9f700 1 -- 172.21.15.158:0/2969985913 shutdown_connections 2019-12-05T03:50:19.428 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f383ca9f700 1 -- 172.21.15.158:0/2969985913 shutdown_connections 2019-12-05T03:50:19.429 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f383ca9f700 1 -- 172.21.15.158:0/2969985913 wait complete. 2019-12-05T03:50:19.429 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.404+0000 7f383ca9f700 1 -- 172.21.15.158:0/2969985913 >> 172.21.15.158:0/2969985913 conn(0x7f38380b7ef0 msgr2=0x7f38380b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:19.429 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.408+0000 7f383ca9f700 1 Processor -- start 2019-12-05T03:50:19.429 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.408+0000 7f383ca9f700 1 -- start start 2019-12-05T03:50:19.429 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.408+0000 7f383ca9f700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3838140f70 0x7f383807db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:19.429 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.408+0000 7f383ca9f700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f383805a380 0x7f383805a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:19.429 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.408+0000 7f383ca9f700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3838061a50 con 0x7f3838060580 2019-12-05T03:50:19.430 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.408+0000 7f383ca9f700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3838060040 con 0x7f383805a380 2019-12-05T03:50:19.430 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.408+0000 7f383ca9f700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38380602e0 con 0x7f3838140f70 2019-12-05T03:50:19.430 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.408+0000 7f3836d9d700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3838140f70 0x7f383807db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:19.430 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.408+0000 7f383759e700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f383805a380 0x7f383805a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:19.430 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.408+0000 7f3836d9d700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3838140f70 0x7f383807db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.158:36930/0 (socket says 172.21.15.158:36930) 2019-12-05T03:50:19.430 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.408+0000 7f383759e700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f383805a380 0x7f383805a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.158:40782/0 (socket says 172.21.15.158:40782) 2019-12-05T03:50:19.430 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.408+0000 7f3836d9d700 1 -- 172.21.15.158:0/1575922163 learned_addr learned my addr 172.21.15.158:0/1575922163 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:19.431 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.408+0000 7f383659c700 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f3838060580 0x7f383805f690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.158:44106/0 (socket says 172.21.15.158:44106) 2019-12-05T03:50:19.431 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.408+0000 7f3836d9d700 1 -- 172.21.15.158:0/1575922163 >> v2:172.21.15.96:3300/0 conn(0x7f383805a380 msgr2=0x7f383805a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:19.431 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.408+0000 7f3836d9d700 1 --2- 172.21.15.158:0/1575922163 >> v2:172.21.15.96:3300/0 conn(0x7f383805a380 0x7f383805a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:19.431 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.408+0000 7f3836d9d700 1 -- 172.21.15.158:0/1575922163 >> v1:172.21.15.96:6789/0 conn(0x7f3838060580 legacy=0x7f383805f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:19.431 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.408+0000 7f3836d9d700 1 -- 172.21.15.158:0/1575922163 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f383814b6d0 con 0x7f3838140f70 2019-12-05T03:50:19.431 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.408+0000 7f383759e700 1 --2- 172.21.15.158:0/1575922163 >> v2:172.21.15.96:3300/0 conn(0x7f383805a380 0x7f383805a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:50:19.431 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.408+0000 7f3836d9d700 1 --2- 172.21.15.158:0/1575922163 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3838140f70 0x7f383807db40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3828002f30 tx=0x7f3828008f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.432 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.408+0000 7f3836d9d700 1 --2- 172.21.15.158:0/1575922163 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3838140f70 0x7f383807db40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3828002f30 tx=0x7f3828008f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.432 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.408+0000 7f3836d9d700 1 --2- 172.21.15.158:0/1575922163 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3838140f70 0x7f383807db40 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7f3828002f30 tx=0x7f3828008f40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:19.432 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.412+0000 7f3836d9d700 1 --2- 172.21.15.158:0/1575922163 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3838140f70 0x7f383807db40 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7f3828002f30 tx=0x7f3828008f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.432 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.412+0000 7f382f7fe700 1 -- 172.21.15.158:0/1575922163 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3828010d30 con 0x7f3838140f70 2019-12-05T03:50:19.432 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.412+0000 7f3836d9d700 1 --2- 172.21.15.158:0/1575922163 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3838140f70 0x7f383807db40 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7f3828002f30 tx=0x7f3828008f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.432 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.412+0000 7f382f7fe700 1 -- 172.21.15.158:0/1575922163 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38280087d0 con 0x7f3838140f70 2019-12-05T03:50:19.432 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.412+0000 7f3836d9d700 1 --2- 172.21.15.158:0/1575922163 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3838140f70 0x7f383807db40 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7f3828002f30 tx=0x7f3828008f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.433 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.412+0000 7f383ca9f700 1 -- 172.21.15.158:0/1575922163 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3838061c80 con 0x7f3838140f70 2019-12-05T03:50:19.433 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.412+0000 7f382f7fe700 1 -- 172.21.15.158:0/1575922163 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f382800f5d0 con 0x7f3838140f70 2019-12-05T03:50:19.433 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.412+0000 7f383ca9f700 1 -- 172.21.15.158:0/1575922163 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3838062230 con 0x7f3838140f70 2019-12-05T03:50:19.433 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.412+0000 7f3836d9d700 1 --2- 172.21.15.158:0/1575922163 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3838140f70 0x7f383807db40 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7f3828002f30 tx=0x7f3828008f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.433 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.412+0000 7f382f7fe700 1 -- 172.21.15.158:0/1575922163 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f3828005540 con 0x7f3838140f70 2019-12-05T03:50:19.433 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.412+0000 7f3836d9d700 1 --2- 172.21.15.158:0/1575922163 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3838140f70 0x7f383807db40 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7f3828002f30 tx=0x7f3828008f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.433 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.412+0000 7f382f7fe700 1 --2- 172.21.15.158:0/1575922163 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f381c03ad30 0x7f381c03d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:19.434 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.412+0000 7f382f7fe700 1 -- 172.21.15.158:0/1575922163 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f382804b080 con 0x7f3838140f70 2019-12-05T03:50:19.434 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.412+0000 7f383659c700 1 --2- 172.21.15.158:0/1575922163 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f381c03ad30 0x7f381c03d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:19.434 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.412+0000 7f383659c700 1 --2- 172.21.15.158:0/1575922163 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f381c03ad30 0x7f381c03d240 crc :-1 s=READY pgs=102 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:19.434 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.416+0000 7f383ca9f700 1 -- 172.21.15.158:0/1575922163 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38380554e0 con 0x7f3838140f70 2019-12-05T03:50:19.439 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.428+0000 7f3836d9d700 1 --2- 172.21.15.158:0/1575922163 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3838140f70 0x7f383807db40 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7f3828002f30 tx=0x7f3828008f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.439 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.428+0000 7f382f7fe700 1 -- 172.21.15.158:0/1575922163 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f38280320e0 con 0x7f3838140f70 2019-12-05T03:50:19.594 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.588+0000 7f383ca9f700 1 -- 172.21.15.158:0/1575922163 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f3838066940 con 0x7f3838140f70 2019-12-05T03:50:19.595 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.588+0000 7f3836d9d700 1 --2- 172.21.15.158:0/1575922163 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3838140f70 0x7f383807db40 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7f3828002f30 tx=0x7f3828008f40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.595 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.588+0000 7f382f7fe700 1 -- 172.21.15.158:0/1575922163 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7f382802fd10 con 0x7f3838140f70 2019-12-05T03:50:19.597 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:50:19.601 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.592+0000 7f383ca9f700 1 -- 172.21.15.158:0/1575922163 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f381c03ad30 msgr2=0x7f381c03d240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:19.601 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.592+0000 7f383ca9f700 1 --2- 172.21.15.158:0/1575922163 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f381c03ad30 0x7f381c03d240 crc :-1 s=READY pgs=102 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:19.602 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.592+0000 7f383ca9f700 1 -- 172.21.15.158:0/1575922163 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3838140f70 msgr2=0x7f383807db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:19.602 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.592+0000 7f383ca9f700 1 --2- 172.21.15.158:0/1575922163 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3838140f70 0x7f383807db40 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7f3828002f30 tx=0x7f3828008f40).stop 2019-12-05T03:50:19.602 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.592+0000 7f383ca9f700 1 -- 172.21.15.158:0/1575922163 shutdown_connections 2019-12-05T03:50:19.602 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.592+0000 7f383ca9f700 1 --2- 172.21.15.158:0/1575922163 >> v2:172.21.15.96:3300/0 conn(0x7f383805a380 0x7f383805a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:19.602 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.592+0000 7f383ca9f700 1 --2- 172.21.15.158:0/1575922163 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3838140f70 0x7f383807db40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:19.602 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.592+0000 7f383ca9f700 1 --2- 172.21.15.158:0/1575922163 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f381c03ad30 0x7f381c03d240 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:19.602 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.592+0000 7f383ca9f700 1 -- 172.21.15.158:0/1575922163 shutdown_connections 2019-12-05T03:50:19.603 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.592+0000 7f383ca9f700 1 -- 172.21.15.158:0/1575922163 wait complete. 2019-12-05T03:50:19.603 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.592+0000 7f383ca9f700 1 -- 172.21.15.158:0/1575922163 >> 172.21.15.158:0/1575922163 conn(0x7f38380b4040 msgr2=0x7f3838130cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:19.613 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-12-05T03:50:19.614 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-12-05T03:50:19.713 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.696+0000 7fb02b8a4700 1 Processor -- start 2019-12-05T03:50:19.713 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.700+0000 7fb02b8a4700 1 -- start start 2019-12-05T03:50:19.713 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.700+0000 7fb02b8a4700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb02409cf60 0x7fb02409a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:19.713 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.700+0000 7fb02b8a4700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0240accb0 con 0x7fb0241553b0 2019-12-05T03:50:19.713 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.700+0000 7fb02b8a4700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0240b6980 con 0x7fb02405a740 2019-12-05T03:50:19.713 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.700+0000 7fb02b8a4700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0240b1730 con 0x7fb02409cf60 2019-12-05T03:50:19.714 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.700+0000 7fb029640700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fb02405a740 0x7fb024151460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48978/0 (socket says 172.21.15.158:48978) 2019-12-05T03:50:19.714 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.700+0000 7fb029640700 1 -- 172.21.15.158:0/1208133070 learned_addr learned my addr 172.21.15.158:0/1208133070 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:19.714 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.700+0000 7fb029e41700 1 --2- 172.21.15.158:0/1208133070 >> v2:172.21.15.96:3300/0 conn(0x7fb02409cf60 0x7fb02409a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:19.714 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.700+0000 7fb028e3f700 1 -- 172.21.15.158:0/1208133070 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 103386829 0 0) 0x7fb0240b6980 con 0x7fb02405a740 2019-12-05T03:50:19.714 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.700+0000 7fb028e3f700 1 -- 172.21.15.158:0/1208133070 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb00c0030b0 con 0x7fb02405a740 2019-12-05T03:50:19.714 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.700+0000 7fb028e3f700 1 -- 172.21.15.158:0/1208133070 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 255569167 0 0) 0x7fb00c0030b0 con 0x7fb02405a740 2019-12-05T03:50:19.714 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.700+0000 7fb028e3f700 1 -- 172.21.15.158:0/1208133070 >> v2:172.21.15.96:3300/0 conn(0x7fb02409cf60 msgr2=0x7fb02409a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:19.715 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.700+0000 7fb028e3f700 1 --2- 172.21.15.158:0/1208133070 >> v2:172.21.15.96:3300/0 conn(0x7fb02409cf60 0x7fb02409a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:19.715 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.700+0000 7fb028e3f700 1 -- 172.21.15.158:0/1208133070 >> v1:172.21.15.96:6789/0 conn(0x7fb0241553b0 legacy=0x7fb0241557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:19.715 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.700+0000 7fb028e3f700 1 -- 172.21.15.158:0/1208133070 --> v1:172.21.15.158:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02405ab70 con 0x7fb02405a740 2019-12-05T03:50:19.715 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.700+0000 7fb028e3f700 1 -- 172.21.15.158:0/1208133070 <== mon.1 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 828730332 0 0) 0x7fb018001750 con 0x7fb02405a740 2019-12-05T03:50:19.715 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.700+0000 7fb029e41700 1 --2- 172.21.15.158:0/1208133070 >> v2:172.21.15.96:3300/0 conn(0x7fb02409cf60 0x7fb02409a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:50:19.715 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.700+0000 7fb028e3f700 1 -- 172.21.15.158:0/1208133070 >> v1:172.21.15.158:6789/0 conn(0x7fb02405a740 legacy=0x7fb024151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:19.715 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.700+0000 7fb028e3f700 1 --2- 172.21.15.158:0/1208133070 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb00c003710 0x7fb00c003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:19.716 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.700+0000 7fb028e3f700 1 --2- 172.21.15.158:0/1208133070 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb00c004420 0x7fb00c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:19.716 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.700+0000 7fb028e3f700 1 --2- 172.21.15.158:0/1208133070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb00c004da0 0x7fb00c00b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:19.716 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.700+0000 7fb028e3f700 1 -- 172.21.15.158:0/1208133070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0240b1730 con 0x7fb00c004da0 2019-12-05T03:50:19.716 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.700+0000 7fb028e3f700 1 -- 172.21.15.158:0/1208133070 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00c04fc90 con 0x7fb00c004420 2019-12-05T03:50:19.716 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.700+0000 7fb028e3f700 1 -- 172.21.15.158:0/1208133070 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb00c04fed0 con 0x7fb00c003710 2019-12-05T03:50:19.716 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.700+0000 7fb029640700 1 --2- 172.21.15.158:0/1208133070 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb00c004420 0x7fb00c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:19.716 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.700+0000 7fb029e41700 1 --2- 172.21.15.158:0/1208133070 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb00c003710 0x7fb00c003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:19.717 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.700+0000 7fb02a642700 1 --2- 172.21.15.158:0/1208133070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb00c004da0 0x7fb00c00b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:19.717 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.704+0000 7fb029e41700 1 -- 172.21.15.158:0/1208133070 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb00c004420 msgr2=0x7fb00c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:19.717 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.704+0000 7fb029e41700 1 --2- 172.21.15.158:0/1208133070 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb00c004420 0x7fb00c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:19.717 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.704+0000 7fb029e41700 1 -- 172.21.15.158:0/1208133070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb00c004da0 msgr2=0x7fb00c00b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:19.717 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.704+0000 7fb029e41700 1 --2- 172.21.15.158:0/1208133070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb00c004da0 0x7fb00c00b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:19.718 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.704+0000 7fb029e41700 1 -- 172.21.15.158:0/1208133070 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb00c0501d0 con 0x7fb00c003710 2019-12-05T03:50:19.718 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.704+0000 7fb02a642700 1 -- 172.21.15.158:0/1208133070 reap_dead start 2019-12-05T03:50:19.718 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.704+0000 7fb029640700 1 --2- 172.21.15.158:0/1208133070 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb00c004420 0x7fb00c004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:50:19.718 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.704+0000 7fb029e41700 1 --2- 172.21.15.158:0/1208133070 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb00c003710 0x7fb00c003b80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb01c0032b0 tx=0x7fb01c00c250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.718 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.704+0000 7fb029e41700 1 --2- 172.21.15.158:0/1208133070 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb00c003710 0x7fb00c003b80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb01c0032b0 tx=0x7fb01c00c250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.718 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.704+0000 7fb029e41700 1 --2- 172.21.15.158:0/1208133070 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb00c003710 0x7fb00c003b80 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7fb01c0032b0 tx=0x7fb01c00c250).ready entity=mon.2 client_cookie=1c5029d5b494f88e server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:19.719 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.704+0000 7fb029e41700 1 --2- 172.21.15.158:0/1208133070 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb00c003710 0x7fb00c003b80 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7fb01c0032b0 tx=0x7fb01c00c250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.719 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.704+0000 7fb028e3f700 1 -- 172.21.15.158:0/1208133070 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb01c0058c0 con 0x7fb00c003710 2019-12-05T03:50:19.719 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.704+0000 7fb029e41700 1 --2- 172.21.15.158:0/1208133070 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb00c003710 0x7fb00c003b80 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7fb01c0032b0 tx=0x7fb01c00c250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.719 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.704+0000 7fb028e3f700 1 -- 172.21.15.158:0/1208133070 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01c00e160 con 0x7fb00c003710 2019-12-05T03:50:19.719 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.704+0000 7fb029e41700 1 --2- 172.21.15.158:0/1208133070 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb00c003710 0x7fb00c003b80 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7fb01c0032b0 tx=0x7fb01c00c250).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.719 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.704+0000 7fb028e3f700 1 -- 172.21.15.158:0/1208133070 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb01c00c6b0 con 0x7fb00c003710 2019-12-05T03:50:19.719 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.704+0000 7fb02b8a4700 1 -- 172.21.15.158:0/1208133070 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb00c003710 msgr2=0x7fb00c003b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:19.719 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.704+0000 7fb02b8a4700 1 --2- 172.21.15.158:0/1208133070 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb00c003710 0x7fb00c003b80 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7fb01c0032b0 tx=0x7fb01c00c250).stop 2019-12-05T03:50:19.720 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.704+0000 7fb02b8a4700 1 -- 172.21.15.158:0/1208133070 shutdown_connections 2019-12-05T03:50:19.720 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.704+0000 7fb02b8a4700 1 --2- 172.21.15.158:0/1208133070 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb00c003710 0x7fb00c003b80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:19.720 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.704+0000 7fb02b8a4700 1 -- 172.21.15.158:0/1208133070 shutdown_connections 2019-12-05T03:50:19.720 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.704+0000 7fb02b8a4700 1 -- 172.21.15.158:0/1208133070 wait complete. 2019-12-05T03:50:19.720 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.704+0000 7fb02b8a4700 1 -- 172.21.15.158:0/1208133070 >> 172.21.15.158:0/1208133070 conn(0x7fb0240b7e60 msgr2=0x7fb0240b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:19.723 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.708+0000 7fb02b8a4700 1 Processor -- start 2019-12-05T03:50:19.723 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.708+0000 7fb02b8a4700 1 -- start start 2019-12-05T03:50:19.724 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.708+0000 7fb02b8a4700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb024140e20 0x7fb02412cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:19.724 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.708+0000 7fb02b8a4700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb024065180 con 0x7fb02413cde0 2019-12-05T03:50:19.724 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.708+0000 7fb02b8a4700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb024064690 con 0x7fb024064d50 2019-12-05T03:50:19.724 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.708+0000 7fb02b8a4700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb024141250 con 0x7fb024140e20 2019-12-05T03:50:19.724 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.708+0000 7fb029640700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fb024064d50 0x7fb02407af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48990/0 (socket says 172.21.15.158:48990) 2019-12-05T03:50:19.724 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.708+0000 7fb029640700 1 -- 172.21.15.158:0/167917542 learned_addr learned my addr 172.21.15.158:0/167917542 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:19.724 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.708+0000 7fb029e41700 1 --2- 172.21.15.158:0/167917542 >> v2:172.21.15.96:3300/0 conn(0x7fb024140e20 0x7fb02412cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:19.725 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.708+0000 7fb0227fc700 1 -- 172.21.15.158:0/167917542 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1411041399 0 0) 0x7fb024064690 con 0x7fb024064d50 2019-12-05T03:50:19.725 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.708+0000 7fb0227fc700 1 -- 172.21.15.158:0/167917542 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0040030b0 con 0x7fb024064d50 2019-12-05T03:50:19.725 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.708+0000 7fb029e41700 1 -- 172.21.15.158:0/167917542 >> v1:172.21.15.158:6789/0 conn(0x7fb024064d50 legacy=0x7fb02407af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:19.725 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.708+0000 7fb029e41700 1 -- 172.21.15.158:0/167917542 >> v1:172.21.15.96:6789/0 conn(0x7fb02413cde0 legacy=0x7fb02413d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:19.725 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.708+0000 7fb0227fc700 1 -- 172.21.15.158:0/167917542 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1556731918 0 0) 0x7fb024065180 con 0x7fb02413cde0 2019-12-05T03:50:19.725 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.708+0000 7fb029e41700 1 -- 172.21.15.158:0/167917542 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02413da10 con 0x7fb024140e20 2019-12-05T03:50:19.725 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.708+0000 7fb029e41700 1 --2- 172.21.15.158:0/167917542 >> v2:172.21.15.96:3300/0 conn(0x7fb024140e20 0x7fb02412cba0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb01c0032b0 tx=0x7fb01c011f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.726 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.708+0000 7fb029e41700 1 --2- 172.21.15.158:0/167917542 >> v2:172.21.15.96:3300/0 conn(0x7fb024140e20 0x7fb02412cba0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb01c0032b0 tx=0x7fb01c011f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.726 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.708+0000 7fb029e41700 1 --2- 172.21.15.158:0/167917542 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb024140e20 0x7fb02412cba0 secure :-1 s=READY pgs=149 cs=0 l=1 rx=0x7fb01c0032b0 tx=0x7fb01c011f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:19.726 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.708+0000 7fb029e41700 1 --2- 172.21.15.158:0/167917542 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb024140e20 0x7fb02412cba0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7fb01c0032b0 tx=0x7fb01c011f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.726 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.708+0000 7fb0227fc700 1 -- 172.21.15.158:0/167917542 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb01c0075a0 con 0x7fb024140e20 2019-12-05T03:50:19.726 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.708+0000 7fb029e41700 1 --2- 172.21.15.158:0/167917542 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb024140e20 0x7fb02412cba0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7fb01c0032b0 tx=0x7fb01c011f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.726 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.708+0000 7fb029e41700 1 --2- 172.21.15.158:0/167917542 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb024140e20 0x7fb02412cba0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7fb01c0032b0 tx=0x7fb01c011f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.726 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.708+0000 7fb0227fc700 1 -- 172.21.15.158:0/167917542 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01c005ac0 con 0x7fb024140e20 2019-12-05T03:50:19.727 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.708+0000 7fb02b8a4700 1 -- 172.21.15.158:0/167917542 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb02413dc20 con 0x7fb024140e20 2019-12-05T03:50:19.727 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.708+0000 7fb0227fc700 1 -- 172.21.15.158:0/167917542 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb01c00ca90 con 0x7fb024140e20 2019-12-05T03:50:19.727 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.708+0000 7fb02b8a4700 1 -- 172.21.15.158:0/167917542 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb024148550 con 0x7fb024140e20 2019-12-05T03:50:19.727 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.712+0000 7fb029e41700 1 --2- 172.21.15.158:0/167917542 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb024140e20 0x7fb02412cba0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7fb01c0032b0 tx=0x7fb01c011f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.727 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.712+0000 7fb0227fc700 1 -- 172.21.15.158:0/167917542 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fb01c00b250 con 0x7fb024140e20 2019-12-05T03:50:19.727 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.712+0000 7fb029e41700 1 --2- 172.21.15.158:0/167917542 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb024140e20 0x7fb02412cba0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7fb01c0032b0 tx=0x7fb01c011f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.727 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.712+0000 7fb0227fc700 1 --2- 172.21.15.158:0/167917542 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fb00403b1d0 0x7fb00403d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:19.727 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.712+0000 7fb0227fc700 1 -- 172.21.15.158:0/167917542 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fb01c04b690 con 0x7fb024140e20 2019-12-05T03:50:19.730 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.712+0000 7fb029640700 1 --2- 172.21.15.158:0/167917542 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fb00403b1d0 0x7fb00403d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:19.731 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.712+0000 7fb029640700 1 --2- 172.21.15.158:0/167917542 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fb00403b1d0 0x7fb00403d6e0 crc :-1 s=READY pgs=103 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:19.731 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.712+0000 7fb02b8a4700 1 -- 172.21.15.158:0/167917542 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0240554e0 con 0x7fb024140e20 2019-12-05T03:50:19.731 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.720+0000 7fb029e41700 1 --2- 172.21.15.158:0/167917542 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb024140e20 0x7fb02412cba0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7fb01c0032b0 tx=0x7fb01c011f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.731 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.720+0000 7fb0227fc700 1 -- 172.21.15.158:0/167917542 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fb01c00cda0 con 0x7fb024140e20 2019-12-05T03:50:19.899 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.892+0000 7fb02b8a4700 1 -- 172.21.15.158:0/167917542 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb024066940 con 0x7fb024140e20 2019-12-05T03:50:19.900 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.892+0000 7fb029e41700 1 --2- 172.21.15.158:0/167917542 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb024140e20 0x7fb02412cba0 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7fb01c0032b0 tx=0x7fb01c011f70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:19.901 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.892+0000 7fb0227fc700 1 -- 172.21.15.158:0/167917542 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2105 (secure 0 0 0) 0x7fb01c032970 con 0x7fb024140e20 2019-12-05T03:50:19.903 INFO:teuthology.orchestra.run.smithi158.stderr:dumped fsmap epoch 6 2019-12-05T03:50:19.903 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:19.903 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4339,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.158:6833/1485705503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":1485705503},{"type":"v1","addr":"172.21.15.158:6833","nonce":1485705503}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-12-05T03:50:01.249656+0000","modified":"2019-12-05T03:50:09.365441+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"b","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6835/3636871068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":3636871068},{"type":"v1","addr":"172.21.15.96:6835","nonce":3636871068}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2019-12-05T03:50:19.906 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.896+0000 7fb02b8a4700 1 -- 172.21.15.158:0/167917542 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fb00403b1d0 msgr2=0x7fb00403d6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:19.906 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.896+0000 7fb02b8a4700 1 --2- 172.21.15.158:0/167917542 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fb00403b1d0 0x7fb00403d6e0 crc :-1 s=READY pgs=103 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:19.906 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.896+0000 7fb02b8a4700 1 -- 172.21.15.158:0/167917542 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb024140e20 msgr2=0x7fb02412cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:19.906 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.896+0000 7fb02b8a4700 1 --2- 172.21.15.158:0/167917542 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb024140e20 0x7fb02412cba0 secure :-1 s=READY pgs=149 cs=0 l=1 rx=0x7fb01c0032b0 tx=0x7fb01c011f70).stop 2019-12-05T03:50:19.906 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.900+0000 7fb02b8a4700 1 -- 172.21.15.158:0/167917542 shutdown_connections 2019-12-05T03:50:19.906 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.900+0000 7fb02b8a4700 1 --2- 172.21.15.158:0/167917542 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fb00403b1d0 0x7fb00403d6e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:19.906 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.900+0000 7fb02b8a4700 1 --2- 172.21.15.158:0/167917542 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb024140e20 0x7fb02412cba0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:19.907 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.900+0000 7fb02b8a4700 1 -- 172.21.15.158:0/167917542 shutdown_connections 2019-12-05T03:50:19.907 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.900+0000 7fb02b8a4700 1 -- 172.21.15.158:0/167917542 wait complete. 2019-12-05T03:50:19.907 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:19.900+0000 7fb02b8a4700 1 -- 172.21.15.158:0/167917542 >> 172.21.15.158:0/167917542 conn(0x7fb02409ba50 msgr2=0x7fb02407e040 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:20.121 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4241}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 6, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [3], u'info': {u'gid_4241': {u'export_targets': [], u'name': u'b', u'incarnation': 5, u'state_seq': 3, u'state': u'up:active', u'gid': 4241, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 3636871068, u'type': u'v2', u'addr': u'172.21.15.96:6834'}, {u'nonce': 3636871068, u'type': u'v1', u'addr': u'172.21.15.96:6835'}]}, u'addr': u'172.21.15.96:6835/3636871068'}}, u'fs_name': u'cephfs', u'created': u'2019-12-05T03:50:01.249656+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-12-05T03:50:09.365441+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-12-05T03:50:20.121 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-12-05T03:50:20.121 INFO:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2019-12-05T03:50:20.216 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2019-12-05T03:50:20.216 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_fsid": "a91186ae-f496-4de1-918d-820c55ff1feb", 2019-12-05T03:50:20.217 INFO:teuthology.orchestra.run.smithi096.stdout: "whoami": 0, 2019-12-05T03:50:20.217 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 4241, 2019-12-05T03:50:20.217 INFO:teuthology.orchestra.run.smithi096.stdout: "want_state": "up:active", 2019-12-05T03:50:20.217 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "up:active", 2019-12-05T03:50:20.217 INFO:teuthology.orchestra.run.smithi096.stdout: "rank_uptime": 11.851571457, 2019-12-05T03:50:20.217 INFO:teuthology.orchestra.run.smithi096.stdout: "mdsmap_epoch": 6, 2019-12-05T03:50:20.217 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch": 23, 2019-12-05T03:50:20.218 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch_barrier": 23, 2019-12-05T03:50:20.218 INFO:teuthology.orchestra.run.smithi096.stdout: "uptime": 16.567718244999998 2019-12-05T03:50:20.218 INFO:teuthology.orchestra.run.smithi096.stdout:} 2019-12-05T03:50:20.223 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "a91186ae-f496-4de1-918d-820c55ff1feb", "whoami": 0, "id": 4241, "want_state": "up:active", "state": "up:active", "rank_uptime": 11.851571457, "mdsmap_epoch": 6, "osdmap_epoch": 23, "osdmap_epoch_barrier": 23, "uptime": 16.567718244999998 } 2019-12-05T03:50:20.223 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2019-12-05T03:50:20.223 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2019-12-05T03:50:20.223 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.3 at ubuntu@smithi096.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.3... 2019-12-05T03:50:20.223 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:20.223 INFO:teuthology.orchestra.run.smithi096:> mkdir -- /home/ubuntu/cephtest/mnt.3 2019-12-05T03:50:20.231 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:20.231 INFO:teuthology.orchestra.run.smithi096:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2019-12-05T03:50:20.313 DEBUG:teuthology.orchestra.run:got remote process result: 32 2019-12-05T03:50:20.357 INFO:teuthology.orchestra.run.smithi096.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2019-12-05T03:50:20.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:20.358 INFO:teuthology.orchestra.run.smithi096:> ls /sys/fs/fuse/connections 2019-12-05T03:50:20.373 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2019-12-05T03:50:20.374 INFO:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.3 /home/ubuntu/cephtest/mnt.3 2019-12-05T03:50:20.442 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:20.442 INFO:teuthology.orchestra.run.smithi096:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2019-12-05T03:50:20.461 DEBUG:teuthology.orchestra.run:got remote process result: 32 2019-12-05T03:50:20.464 INFO:teuthology.orchestra.run.smithi096.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2019-12-05T03:50:20.464 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:20.465 INFO:teuthology.orchestra.run.smithi096:> ls /sys/fs/fuse/connections 2019-12-05T03:50:20.502 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi096.stderr:2019-12-05T03:50:20.501+0000 7f23a2e6ef40 -1 init, newargv = 0x556258e42fa0 newargc=7 2019-12-05T03:50:20.503 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi096.stderr:ceph-fuse[13064]: starting ceph client 2019-12-05T03:50:20.509 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi096.stderr:ceph-fuse[13064]: starting fuse 2019-12-05T03:50:20.538 INFO:teuthology.orchestra.run.smithi096.stdout:49 2019-12-05T03:50:20.539 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2019-12-05T03:50:20.539 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:20.539 INFO:teuthology.orchestra.run.smithi096:> sudo python2 -c ' 2019-12-05T03:50:20.539 INFO:teuthology.orchestra.run.smithi096:> import glob 2019-12-05T03:50:20.539 INFO:teuthology.orchestra.run.smithi096:> import re 2019-12-05T03:50:20.539 INFO:teuthology.orchestra.run.smithi096:> import os 2019-12-05T03:50:20.540 INFO:teuthology.orchestra.run.smithi096:> import subprocess 2019-12-05T03:50:20.540 INFO:teuthology.orchestra.run.smithi096:> 2019-12-05T03:50:20.540 INFO:teuthology.orchestra.run.smithi096:> def find_socket(client_name): 2019-12-05T03:50:20.540 INFO:teuthology.orchestra.run.smithi096:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2019-12-05T03:50:20.540 INFO:teuthology.orchestra.run.smithi096:> files = glob.glob(asok_path) 2019-12-05T03:50:20.540 INFO:teuthology.orchestra.run.smithi096:> 2019-12-05T03:50:20.540 INFO:teuthology.orchestra.run.smithi096:> # Given a non-glob path, it better be there 2019-12-05T03:50:20.540 INFO:teuthology.orchestra.run.smithi096:> if "*" not in asok_path: 2019-12-05T03:50:20.541 INFO:teuthology.orchestra.run.smithi096:> assert(len(files) == 1) 2019-12-05T03:50:20.541 INFO:teuthology.orchestra.run.smithi096:> return files[0] 2019-12-05T03:50:20.541 INFO:teuthology.orchestra.run.smithi096:> 2019-12-05T03:50:20.541 INFO:teuthology.orchestra.run.smithi096:> for f in files: 2019-12-05T03:50:20.541 INFO:teuthology.orchestra.run.smithi096:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2019-12-05T03:50:20.541 INFO:teuthology.orchestra.run.smithi096:> if os.path.exists("/proc/{0}".format(pid)): 2019-12-05T03:50:20.541 INFO:teuthology.orchestra.run.smithi096:> return f 2019-12-05T03:50:20.541 INFO:teuthology.orchestra.run.smithi096:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2019-12-05T03:50:20.542 INFO:teuthology.orchestra.run.smithi096:> 2019-12-05T03:50:20.542 INFO:teuthology.orchestra.run.smithi096:> print(find_socket("client.3")) 2019-12-05T03:50:20.542 INFO:teuthology.orchestra.run.smithi096:> ' 2019-12-05T03:50:20.643 INFO:teuthology.orchestra.run.smithi096.stdout:/var/run/ceph/ceph-client.3.13064.asok 2019-12-05T03:50:20.643 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.13064.asok 2019-12-05T03:50:20.643 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:20.643 INFO:teuthology.orchestra.run.smithi096:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.13064.asok status 2019-12-05T03:50:20.827 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2019-12-05T03:50:20.828 INFO:teuthology.orchestra.run.smithi096.stdout: "metadata": { 2019-12-05T03:50:20.828 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph_sha1": "c5290805033483ba0cec165c06bde07dae5f19ec", 2019-12-05T03:50:20.828 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph_version": "ceph version 15.0.0-8014-gc529080 (c5290805033483ba0cec165c06bde07dae5f19ec) octopus (dev)", 2019-12-05T03:50:20.829 INFO:teuthology.orchestra.run.smithi096.stdout: "entity_id": "3", 2019-12-05T03:50:20.829 INFO:teuthology.orchestra.run.smithi096.stdout: "hostname": "smithi096", 2019-12-05T03:50:20.829 INFO:teuthology.orchestra.run.smithi096.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2019-12-05T03:50:20.829 INFO:teuthology.orchestra.run.smithi096.stdout: "pid": "13064", 2019-12-05T03:50:20.829 INFO:teuthology.orchestra.run.smithi096.stdout: "root": "/" 2019-12-05T03:50:20.831 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2019-12-05T03:50:20.831 INFO:teuthology.orchestra.run.smithi096.stdout: "dentry_count": 0, 2019-12-05T03:50:20.832 INFO:teuthology.orchestra.run.smithi096.stdout: "dentry_pinned_count": 0, 2019-12-05T03:50:20.832 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 4403, 2019-12-05T03:50:20.832 INFO:teuthology.orchestra.run.smithi096.stdout: "inst": { 2019-12-05T03:50:20.832 INFO:teuthology.orchestra.run.smithi096.stdout: "name": { 2019-12-05T03:50:20.832 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "client", 2019-12-05T03:50:20.833 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 4403 2019-12-05T03:50:20.833 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2019-12-05T03:50:20.833 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": { 2019-12-05T03:50:20.833 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2019-12-05T03:50:20.834 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:0", 2019-12-05T03:50:20.834 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 4150518333 2019-12-05T03:50:20.834 INFO:teuthology.orchestra.run.smithi096.stdout: } 2019-12-05T03:50:20.834 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2019-12-05T03:50:20.834 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": { 2019-12-05T03:50:20.841 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2019-12-05T03:50:20.842 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:0", 2019-12-05T03:50:20.842 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 4150518333 2019-12-05T03:50:20.842 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2019-12-05T03:50:20.842 INFO:teuthology.orchestra.run.smithi096.stdout: "inst_str": "client.4403 172.21.15.96:0/4150518333", 2019-12-05T03:50:20.842 INFO:teuthology.orchestra.run.smithi096.stdout: "addr_str": "172.21.15.96:0/4150518333", 2019-12-05T03:50:20.842 INFO:teuthology.orchestra.run.smithi096.stdout: "inode_count": 1, 2019-12-05T03:50:20.842 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_epoch": 6, 2019-12-05T03:50:20.843 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_epoch": 23, 2019-12-05T03:50:20.843 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_epoch_barrier": 0, 2019-12-05T03:50:20.843 INFO:teuthology.orchestra.run.smithi096.stdout: "blacklisted": false 2019-12-05T03:50:20.843 INFO:teuthology.orchestra.run.smithi096.stdout:} 2019-12-05T03:50:20.844 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-05T03:50:20.957 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.944+0000 7f7e96907700 1 Processor -- start 2019-12-05T03:50:20.957 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.944+0000 7f7e96907700 1 -- start start 2019-12-05T03:50:20.958 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.944+0000 7f7e96907700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7e9005a740 0x7f7e90155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:20.958 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.944+0000 7f7e96907700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e900accb0 con 0x7f7e9009a320 2019-12-05T03:50:20.958 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.944+0000 7f7e96907700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e90156100 con 0x7f7e9009cf60 2019-12-05T03:50:20.958 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.944+0000 7f7e96907700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e9009a750 con 0x7f7e9005a740 2019-12-05T03:50:20.958 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.948+0000 7f7e94ea4700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f7e9009cf60 0x7f7e90151460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:48996/0 (socket says 172.21.15.158:48996) 2019-12-05T03:50:20.958 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.948+0000 7f7e94ea4700 1 -- 172.21.15.158:0/2381258314 learned_addr learned my addr 172.21.15.158:0/2381258314 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:20.958 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.948+0000 7f7e956a5700 1 --2- 172.21.15.158:0/2381258314 >> v2:172.21.15.96:3300/0 conn(0x7f7e9005a740 0x7f7e90155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:20.959 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.948+0000 7f7e8f7fe700 1 -- 172.21.15.158:0/2381258314 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3454206062 0 0) 0x7f7e90156100 con 0x7f7e9009cf60 2019-12-05T03:50:20.959 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.948+0000 7f7e8f7fe700 1 -- 172.21.15.158:0/2381258314 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e7c0030b0 con 0x7f7e9009cf60 2019-12-05T03:50:20.959 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.948+0000 7f7e8f7fe700 1 -- 172.21.15.158:0/2381258314 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2044339384 0 0) 0x7f7e900accb0 con 0x7f7e9009a320 2019-12-05T03:50:20.959 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.948+0000 7f7e8f7fe700 1 -- 172.21.15.158:0/2381258314 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e90156100 con 0x7f7e9009a320 2019-12-05T03:50:20.959 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.948+0000 7f7e956a5700 1 -- 172.21.15.158:0/2381258314 >> v1:172.21.15.158:6789/0 conn(0x7f7e9009cf60 legacy=0x7f7e90151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:20.959 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.948+0000 7f7e956a5700 1 -- 172.21.15.158:0/2381258314 >> v1:172.21.15.96:6789/0 conn(0x7f7e9009a320 legacy=0x7f7e901553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:20.960 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.948+0000 7f7e956a5700 1 -- 172.21.15.158:0/2381258314 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9005ab70 con 0x7f7e9005a740 2019-12-05T03:50:20.960 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.948+0000 7f7e956a5700 1 --2- 172.21.15.158:0/2381258314 >> v2:172.21.15.96:3300/0 conn(0x7f7e9005a740 0x7f7e90155bb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7e9009c740 tx=0x7f7e8800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:20.960 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.948+0000 7f7e956a5700 1 --2- 172.21.15.158:0/2381258314 >> v2:172.21.15.96:3300/0 conn(0x7f7e9005a740 0x7f7e90155bb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7e9009c740 tx=0x7f7e8800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:20.960 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.948+0000 7f7e956a5700 1 --2- 172.21.15.158:0/2381258314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e9005a740 0x7f7e90155bb0 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7f7e9009c740 tx=0x7f7e8800fbf0).ready entity=mon.0 client_cookie=10a2dcc2260b68cb server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:20.960 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.948+0000 7f7e956a5700 1 --2- 172.21.15.158:0/2381258314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e9005a740 0x7f7e90155bb0 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f7e9009c740 tx=0x7f7e8800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:20.960 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.948+0000 7f7e8f7fe700 1 -- 172.21.15.158:0/2381258314 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e88008bb0 con 0x7f7e9005a740 2019-12-05T03:50:20.960 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.948+0000 7f7e956a5700 1 --2- 172.21.15.158:0/2381258314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e9005a740 0x7f7e90155bb0 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f7e9009c740 tx=0x7f7e8800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:20.961 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.948+0000 7f7e956a5700 1 --2- 172.21.15.158:0/2381258314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e9005a740 0x7f7e90155bb0 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f7e9009c740 tx=0x7f7e8800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:20.961 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.948+0000 7f7e8f7fe700 1 -- 172.21.15.158:0/2381258314 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e880087d0 con 0x7f7e9005a740 2019-12-05T03:50:20.961 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.948+0000 7f7e8f7fe700 1 -- 172.21.15.158:0/2381258314 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e880118d0 con 0x7f7e9005a740 2019-12-05T03:50:20.961 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.948+0000 7f7e96907700 1 -- 172.21.15.158:0/2381258314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e9005a740 msgr2=0x7f7e90155bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:20.961 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.948+0000 7f7e96907700 1 --2- 172.21.15.158:0/2381258314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e9005a740 0x7f7e90155bb0 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7f7e9009c740 tx=0x7f7e8800fbf0).stop 2019-12-05T03:50:20.961 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.948+0000 7f7e96907700 1 -- 172.21.15.158:0/2381258314 shutdown_connections 2019-12-05T03:50:20.961 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.948+0000 7f7e96907700 1 --2- 172.21.15.158:0/2381258314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e9005a740 0x7f7e90155bb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:20.962 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.948+0000 7f7e96907700 1 -- 172.21.15.158:0/2381258314 shutdown_connections 2019-12-05T03:50:20.962 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.948+0000 7f7e96907700 1 -- 172.21.15.158:0/2381258314 wait complete. 2019-12-05T03:50:20.962 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.948+0000 7f7e96907700 1 -- 172.21.15.158:0/2381258314 >> 172.21.15.158:0/2381258314 conn(0x7f7e900b7e60 msgr2=0x7f7e900b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:20.967 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.952+0000 7f7e96907700 1 Processor -- start 2019-12-05T03:50:20.967 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.952+0000 7f7e96907700 1 -- start start 2019-12-05T03:50:20.967 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.952+0000 7f7e96907700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7e901234f0 0x7f7e90153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:20.967 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.952+0000 7f7e96907700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e90154c50 con 0x7f7e90139050 2019-12-05T03:50:20.968 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.952+0000 7f7e96907700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e90152050 con 0x7f7e90135980 2019-12-05T03:50:20.968 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.952+0000 7f7e96907700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e901539e0 con 0x7f7e901234f0 2019-12-05T03:50:20.968 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.952+0000 7f7e956a5700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f7e90135980 0x7f7e9007bda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49006/0 (socket says 172.21.15.158:49006) 2019-12-05T03:50:20.968 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.952+0000 7f7e956a5700 1 -- 172.21.15.158:0/2722822564 learned_addr learned my addr 172.21.15.158:0/2722822564 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:20.968 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.952+0000 7f7e8ffff700 1 --2- 172.21.15.158:0/2722822564 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7e901234f0 0x7f7e90153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:20.968 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.952+0000 7f7e8d7fa700 1 -- 172.21.15.158:0/2722822564 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1387537880 0 0) 0x7f7e90152050 con 0x7f7e90135980 2019-12-05T03:50:20.969 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.952+0000 7f7e8d7fa700 1 -- 172.21.15.158:0/2722822564 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e740030b0 con 0x7f7e90135980 2019-12-05T03:50:20.969 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.952+0000 7f7e8d7fa700 1 -- 172.21.15.158:0/2722822564 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3004656054 0 0) 0x7f7e90154c50 con 0x7f7e90139050 2019-12-05T03:50:20.969 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.952+0000 7f7e8d7fa700 1 -- 172.21.15.158:0/2722822564 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e90152050 con 0x7f7e90139050 2019-12-05T03:50:20.969 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.952+0000 7f7e8d7fa700 1 -- 172.21.15.158:0/2722822564 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 109885478 0 0) 0x7f7e740030b0 con 0x7f7e90135980 2019-12-05T03:50:20.969 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.952+0000 7f7e8d7fa700 1 -- 172.21.15.158:0/2722822564 --> v1:172.21.15.158:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7e90154c50 con 0x7f7e90135980 2019-12-05T03:50:20.969 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.952+0000 7f7e8d7fa700 1 -- 172.21.15.158:0/2722822564 <== mon.1 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 828730332 0 0) 0x7f7e88008470 con 0x7f7e90135980 2019-12-05T03:50:20.969 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.952+0000 7f7e8d7fa700 1 -- 172.21.15.158:0/2722822564 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7e901234f0 msgr2=0x7f7e90153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:20.970 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.952+0000 7f7e8d7fa700 1 --2- 172.21.15.158:0/2722822564 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7e901234f0 0x7f7e90153490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:20.970 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.952+0000 7f7e8d7fa700 1 -- 172.21.15.158:0/2722822564 >> v1:172.21.15.158:6789/0 conn(0x7f7e90135980 legacy=0x7f7e9007bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:20.970 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.952+0000 7f7e8d7fa700 1 -- 172.21.15.158:0/2722822564 >> v1:172.21.15.96:6789/0 conn(0x7f7e90139050 legacy=0x7f7e90135180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:20.970 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.952+0000 7f7e8d7fa700 1 --2- 172.21.15.158:0/2722822564 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7e74003ab0 0x7f7e74004420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:20.970 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.952+0000 7f7e8d7fa700 1 --2- 172.21.15.158:0/2722822564 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7e74003f90 0x7f7e740049f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:20.970 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.952+0000 7f7e8d7fa700 1 --2- 172.21.15.158:0/2722822564 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e74005000 0x7f7e7400b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:20.971 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.952+0000 7f7e8d7fa700 1 -- 172.21.15.158:0/2722822564 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e901539e0 con 0x7f7e74005000 2019-12-05T03:50:20.971 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.952+0000 7f7e8d7fa700 1 -- 172.21.15.158:0/2722822564 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7400bdb0 con 0x7f7e74003ab0 2019-12-05T03:50:20.971 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.952+0000 7f7e8d7fa700 1 -- 172.21.15.158:0/2722822564 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7400bff0 con 0x7f7e74003f90 2019-12-05T03:50:20.971 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.952+0000 7f7e8ffff700 1 --2- 172.21.15.158:0/2722822564 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7e901234f0 0x7f7e90153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:50:20.971 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.956+0000 7f7e94ea4700 1 --2- 172.21.15.158:0/2722822564 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7e74003ab0 0x7f7e74004420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:20.971 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.956+0000 7f7e956a5700 1 --2- 172.21.15.158:0/2722822564 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e74005000 0x7f7e7400b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:20.971 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.956+0000 7f7e8ffff700 1 --2- 172.21.15.158:0/2722822564 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7e74003f90 0x7f7e740049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:20.972 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.956+0000 7f7e94ea4700 1 -- 172.21.15.158:0/2722822564 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7e74003f90 msgr2=0x7f7e740049f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:20.972 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.956+0000 7f7e94ea4700 1 --2- 172.21.15.158:0/2722822564 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7e74003f90 0x7f7e740049f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:20.972 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.956+0000 7f7e94ea4700 1 -- 172.21.15.158:0/2722822564 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e74005000 msgr2=0x7f7e7400b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:20.972 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.956+0000 7f7e94ea4700 1 --2- 172.21.15.158:0/2722822564 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e74005000 0x7f7e7400b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:20.972 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.956+0000 7f7e94ea4700 1 -- 172.21.15.158:0/2722822564 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e90123920 con 0x7f7e74003ab0 2019-12-05T03:50:20.972 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.956+0000 7f7e96907700 1 -- 172.21.15.158:0/2722822564 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e90135db0 con 0x7f7e74003ab0 2019-12-05T03:50:20.973 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.956+0000 7f7e8ffff700 1 --2- 172.21.15.158:0/2722822564 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7e74003f90 0x7f7e740049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-12-05T03:50:20.973 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.956+0000 7f7e94ea4700 1 --2- 172.21.15.158:0/2722822564 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7e74003ab0 0x7f7e74004420 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7e78001040 tx=0x7f7e78010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:20.973 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.956+0000 7f7e96907700 1 -- 172.21.15.158:0/2722822564 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e901234f0 con 0x7f7e74003ab0 2019-12-05T03:50:20.973 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.956+0000 7f7e94ea4700 1 --2- 172.21.15.158:0/2722822564 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7e74003ab0 0x7f7e74004420 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7e78001040 tx=0x7f7e78010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:20.973 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.956+0000 7f7e94ea4700 1 --2- 172.21.15.158:0/2722822564 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7e74003ab0 0x7f7e74004420 secure :-1 s=READY pgs=214 cs=0 l=1 rx=0x7f7e78001040 tx=0x7f7e78010bb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:20.973 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.956+0000 7f7e94ea4700 1 --2- 172.21.15.158:0/2722822564 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7e74003ab0 0x7f7e74004420 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7f7e78001040 tx=0x7f7e78010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:20.973 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.956+0000 7f7e8d7fa700 1 -- 172.21.15.158:0/2722822564 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e78013060 con 0x7f7e74003ab0 2019-12-05T03:50:20.974 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.956+0000 7f7e94ea4700 1 --2- 172.21.15.158:0/2722822564 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7e74003ab0 0x7f7e74004420 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7f7e78001040 tx=0x7f7e78010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:20.974 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.956+0000 7f7e94ea4700 1 --2- 172.21.15.158:0/2722822564 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7e74003ab0 0x7f7e74004420 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7f7e78001040 tx=0x7f7e78010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:20.974 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.956+0000 7f7e8d7fa700 1 -- 172.21.15.158:0/2722822564 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7800c7d0 con 0x7f7e74003ab0 2019-12-05T03:50:20.974 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.956+0000 7f7e8d7fa700 1 -- 172.21.15.158:0/2722822564 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e78004430 con 0x7f7e74003ab0 2019-12-05T03:50:20.974 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.956+0000 7f7e94ea4700 1 --2- 172.21.15.158:0/2722822564 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7e74003ab0 0x7f7e74004420 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7f7e78001040 tx=0x7f7e78010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:20.974 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.956+0000 7f7e8d7fa700 1 -- 172.21.15.158:0/2722822564 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f7e78004630 con 0x7f7e74003ab0 2019-12-05T03:50:20.974 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.956+0000 7f7e94ea4700 1 --2- 172.21.15.158:0/2722822564 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7e74003ab0 0x7f7e74004420 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7f7e78001040 tx=0x7f7e78010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:20.975 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.956+0000 7f7e8d7fa700 1 --2- 172.21.15.158:0/2722822564 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f7e74043f20 0x7f7e74046430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:20.975 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.956+0000 7f7e8d7fa700 1 -- 172.21.15.158:0/2722822564 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f7e7804abb0 con 0x7f7e74003ab0 2019-12-05T03:50:20.975 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.956+0000 7f7e8ffff700 1 --2- 172.21.15.158:0/2722822564 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f7e74043f20 0x7f7e74046430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:20.975 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.956+0000 7f7e8ffff700 1 --2- 172.21.15.158:0/2722822564 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f7e74043f20 0x7f7e74046430 crc :-1 s=READY pgs=104 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:20.976 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.960+0000 7f7e96907700 1 -- 172.21.15.158:0/2722822564 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e68003200 con 0x7f7e74003ab0 2019-12-05T03:50:20.976 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.968+0000 7f7e94ea4700 1 --2- 172.21.15.158:0/2722822564 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7e74003ab0 0x7f7e74004420 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7f7e78001040 tx=0x7f7e78010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:20.976 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:20.968+0000 7f7e8d7fa700 1 -- 172.21.15.158:0/2722822564 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f7e78031c50 con 0x7f7e74003ab0 2019-12-05T03:50:21.140 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.132+0000 7f7e96907700 1 -- 172.21.15.158:0/2722822564 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e68003640 con 0x7f7e74003ab0 2019-12-05T03:50:21.142 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.136+0000 7f7e94ea4700 1 --2- 172.21.15.158:0/2722822564 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7e74003ab0 0x7f7e74004420 secure :-1 s=THROTTLE_DONE pgs=214 cs=0 l=1 rx=0x7f7e78001040 tx=0x7f7e78010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.142 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.136+0000 7f7e8d7fa700 1 -- 172.21.15.158:0/2722822564 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+14933 (secure 0 0 0) 0x7f7e78031eb0 con 0x7f7e74003ab0 2019-12-05T03:50:21.143 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:21.144 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":23,"fsid":"a91186ae-f496-4de1-918d-820c55ff1feb","created":"2019-12-05T03:49:39.187523+0000","modified":"2019-12-05T03:50:01.249305+0000","last_up_change":"2019-12-05T03:49:48.551934+0000","last_in_change":"2019-12-05T03:49:48.551934+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-05T03:49:52.900870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-12-05T03:49:55.801462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-12-05T03:49:58.659250+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"782c4258-e28c-4a11-9d54-3c9c7a36fba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":12192},{"type":"v1","addr":"172.21.15.158:6801","nonce":12192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":12192},{"type":"v1","addr":"172.21.15.158:6803","nonce":12192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":12192},{"type":"v1","addr":"172.21.15.158:6807","nonce":12192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":12192},{"type":"v1","addr":"172.21.15.158:6805","nonce":12192}]},"public_addr":"172.21.15.158:6801/12192","cluster_addr":"172.21.15.158:6803/12192","heartbeat_back_addr":"172.21.15.158:6807/12192","heartbeat_front_addr":"172.21.15.158:6805/12192","state":["exists","up"]},{"osd":1,"uuid":"d4426b21-b666-4158-bf34-a24b14572731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":12193},{"type":"v1","addr":"172.21.15.158:6809","nonce":12193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":12193},{"type":"v1","addr":"172.21.15.158:6811","nonce":12193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":12193},{"type":"v1","addr":"172.21.15.158:6815","nonce":12193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":12193},{"type":"v1","addr":"172.21.15.158:6813","nonce":12193}]},"public_addr":"172.21.15.158:6809/12193","cluster_addr":"172.21.15.158:6811/12193","heartbeat_back_addr":"172.21.15.158:6815/12193","heartbeat_front_addr":"172.21.15.158:6813/12193","state":["exists","up"]},{"osd":2,"uuid":"22680edd-6490-4ab0-bb15-0605830e4cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":12195},{"type":"v1","addr":"172.21.15.158:6825","nonce":12195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":12195},{"type":"v1","addr":"172.21.15.158:6827","nonce":12195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":12195},{"type":"v1","addr":"172.21.15.158:6831","nonce":12195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":12195},{"type":"v1","addr":"172.21.15.158:6829","nonce":12195}]},"public_addr":"172.21.15.158:6825/12195","cluster_addr":"172.21.15.158:6827/12195","heartbeat_back_addr":"172.21.15.158:6831/12195","heartbeat_front_addr":"172.21.15.158:6829/12195","state":["exists","up"]},{"osd":3,"uuid":"7ec999ee-ace8-4ccb-a4f9-6f5d313bbbd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":12194},{"type":"v1","addr":"172.21.15.158:6817","nonce":12194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":12194},{"type":"v1","addr":"172.21.15.158:6819","nonce":12194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":12194},{"type":"v1","addr":"172.21.15.158:6823","nonce":12194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":12194},{"type":"v1","addr":"172.21.15.158:6821","nonce":12194}]},"public_addr":"172.21.15.158:6817/12194","cluster_addr":"172.21.15.158:6819/12194","heartbeat_back_addr":"172.21.15.158:6823/12194","heartbeat_front_addr":"172.21.15.158:6821/12194","state":["exists","up"]},{"osd":4,"uuid":"186e69c4-b69f-4dd1-bb8f-faf759c60484","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":12460},{"type":"v1","addr":"172.21.15.96:6803","nonce":12460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":12460},{"type":"v1","addr":"172.21.15.96:6805","nonce":12460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":12460},{"type":"v1","addr":"172.21.15.96:6809","nonce":12460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":12460},{"type":"v1","addr":"172.21.15.96:6807","nonce":12460}]},"public_addr":"172.21.15.96:6803/12460","cluster_addr":"172.21.15.96:6805/12460","heartbeat_back_addr":"172.21.15.96:6809/12460","heartbeat_front_addr":"172.21.15.96:6807/12460","state":["exists","up"]},{"osd":5,"uuid":"86b658b2-8b40-4cea-8163-305a3982758b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":12461},{"type":"v1","addr":"172.21.15.96:6811","nonce":12461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":12461},{"type":"v1","addr":"172.21.15.96:6813","nonce":12461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":12461},{"type":"v1","addr":"172.21.15.96:6817","nonce":12461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":12461},{"type":"v1","addr":"172.21.15.96:6815","nonce":12461}]},"public_addr":"172.21.15.96:6811/12461","cluster_addr":"172.21.15.96:6813/12461","heartbeat_back_addr":"172.21.15.96:6817/12461","heartbeat_front_addr":"172.21.15.96:6815/12461","state":["exists","up"]},{"osd":6,"uuid":"bdadaea8-9296-4788-bc59-d9c9eb8defdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":12463},{"type":"v1","addr":"172.21.15.96:6827","nonce":12463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":12463},{"type":"v1","addr":"172.21.15.96:6829","nonce":12463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":12463},{"type":"v1","addr":"172.21.15.96:6833","nonce":12463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":12463},{"type":"v1","addr":"172.21.15.96:6831","nonce":12463}]},"public_addr":"172.21.15.96:6827/12463","cluster_addr":"172.21.15.96:6829/12463","heartbeat_back_addr":"172.21.15.96:6833/12463","heartbeat_front_addr":"172.21.15.96:6831/12463","state":["exists","up"]},{"osd":7,"uuid":"c6d71846-d68e-430f-ab72-0fb8ea4bf640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":12462},{"type":"v1","addr":"172.21.15.96:6819","nonce":12462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":12462},{"type":"v1","addr":"172.21.15.96:6821","nonce":12462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":12462},{"type":"v1","addr":"172.21.15.96:6825","nonce":12462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":12462},{"type":"v1","addr":"172.21.15.96:6823","nonce":12462}]},"public_addr":"172.21.15.96:6819/12462","cluster_addr":"172.21.15.96:6821/12462","heartbeat_back_addr":"172.21.15.96:6825/12462","heartbeat_front_addr":"172.21.15.96:6823/12462","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.875762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.900817+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.210347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.133973+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.864697+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.131015+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.237225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.154377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-05T03:50:21.146 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.140+0000 7f7e96907700 1 -- 172.21.15.158:0/2722822564 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f7e74043f20 msgr2=0x7f7e74046430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:21.146 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.140+0000 7f7e96907700 1 --2- 172.21.15.158:0/2722822564 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f7e74043f20 0x7f7e74046430 crc :-1 s=READY pgs=104 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:21.146 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.140+0000 7f7e96907700 1 -- 172.21.15.158:0/2722822564 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7e74003ab0 msgr2=0x7f7e74004420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:21.146 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.140+0000 7f7e96907700 1 --2- 172.21.15.158:0/2722822564 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7e74003ab0 0x7f7e74004420 secure :-1 s=READY pgs=214 cs=0 l=1 rx=0x7f7e78001040 tx=0x7f7e78010bb0).stop 2019-12-05T03:50:21.146 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.140+0000 7f7e956a5700 1 -- 172.21.15.158:0/2722822564 reap_dead start 2019-12-05T03:50:21.147 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.140+0000 7f7e96907700 1 -- 172.21.15.158:0/2722822564 shutdown_connections 2019-12-05T03:50:21.147 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.140+0000 7f7e96907700 1 --2- 172.21.15.158:0/2722822564 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7e74003ab0 0x7f7e74004420 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:21.147 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.140+0000 7f7e96907700 1 -- 172.21.15.158:0/2722822564 shutdown_connections 2019-12-05T03:50:21.147 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.140+0000 7f7e96907700 1 -- 172.21.15.158:0/2722822564 wait complete. 2019-12-05T03:50:21.147 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.140+0000 7f7e96907700 1 -- 172.21.15.158:0/2722822564 >> 172.21.15.158:0/2722822564 conn(0x7f7e9009cf60 msgr2=0x7f7e900b3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:21.158 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:49:52.900870+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:49:55.801462+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:49:58.659250+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-12-05T03:50:21.158 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-12-05T03:50:21.265 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.252+0000 7f1308ee8700 1 Processor -- start 2019-12-05T03:50:21.265 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.252+0000 7f1308ee8700 1 -- start start 2019-12-05T03:50:21.265 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.252+0000 7f1308ee8700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f13040b6970 0x7f130409add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:21.266 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.252+0000 7f1308ee8700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f130409ba40 0x7f130405a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:21.266 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.252+0000 7f1308ee8700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1304099e30 con 0x7f130405a950 2019-12-05T03:50:21.266 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.252+0000 7f1308ee8700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f130409d210 con 0x7f130409ba40 2019-12-05T03:50:21.266 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.252+0000 7f1308ee8700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1304099b90 con 0x7f13040b6970 2019-12-05T03:50:21.266 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.252+0000 7f130359e700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f130405a950 0x7f1304155290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49020/0 (socket says 172.21.15.158:49020) 2019-12-05T03:50:21.267 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.252+0000 7f1302d9d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f13040b6970 0x7f130409add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:21.267 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.252+0000 7f130359e700 1 -- 172.21.15.158:0/2781018298 learned_addr learned my addr 172.21.15.158:0/2781018298 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:21.267 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.252+0000 7f130259c700 1 --2- 172.21.15.158:0/2781018298 >> v2:172.21.15.96:3300/0 conn(0x7f130409ba40 0x7f130405a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:21.267 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.252+0000 7f1301d9b700 1 -- 172.21.15.158:0/2781018298 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3963409761 0 0) 0x7f1304099e30 con 0x7f130405a950 2019-12-05T03:50:21.268 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.252+0000 7f1301d9b700 1 -- 172.21.15.158:0/2781018298 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12ec0030b0 con 0x7f130405a950 2019-12-05T03:50:21.268 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.252+0000 7f1302d9d700 1 -- 172.21.15.158:0/2781018298 >> v2:172.21.15.96:3300/0 conn(0x7f130409ba40 msgr2=0x7f130405a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:21.268 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.252+0000 7f1302d9d700 1 --2- 172.21.15.158:0/2781018298 >> v2:172.21.15.96:3300/0 conn(0x7f130409ba40 0x7f130405a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:21.268 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.252+0000 7f1302d9d700 1 -- 172.21.15.158:0/2781018298 >> v1:172.21.15.158:6789/0 conn(0x7f130405a950 legacy=0x7f1304155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:21.269 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.252+0000 7f1302d9d700 1 -- 172.21.15.158:0/2781018298 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130407e960 con 0x7f13040b6970 2019-12-05T03:50:21.269 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.256+0000 7f1302d9d700 1 --2- 172.21.15.158:0/2781018298 >> v2:172.21.15.158:3300/0 conn(0x7f13040b6970 0x7f130409add0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f12f4002f30 tx=0x7f12f400fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.269 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.256+0000 7f1302d9d700 1 --2- 172.21.15.158:0/2781018298 >> v2:172.21.15.158:3300/0 conn(0x7f13040b6970 0x7f130409add0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f12f4002f30 tx=0x7f12f400fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.269 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.256+0000 7f1302d9d700 1 --2- 172.21.15.158:0/2781018298 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f13040b6970 0x7f130409add0 secure :-1 s=READY pgs=216 cs=0 l=1 rx=0x7f12f4002f30 tx=0x7f12f400fc70).ready entity=mon.1 client_cookie=39587900d97f3b69 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:21.270 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.256+0000 7f1302d9d700 1 --2- 172.21.15.158:0/2781018298 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f13040b6970 0x7f130409add0 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7f12f4002f30 tx=0x7f12f400fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.270 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.256+0000 7f1301d9b700 1 -- 172.21.15.158:0/2781018298 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12f4008bb0 con 0x7f13040b6970 2019-12-05T03:50:21.270 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.256+0000 7f1302d9d700 1 --2- 172.21.15.158:0/2781018298 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f13040b6970 0x7f130409add0 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7f12f4002f30 tx=0x7f12f400fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.270 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.256+0000 7f1302d9d700 1 --2- 172.21.15.158:0/2781018298 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f13040b6970 0x7f130409add0 secure :-1 s=THROTTLE_DONE pgs=216 cs=0 l=1 rx=0x7f12f4002f30 tx=0x7f12f400fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.271 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.256+0000 7f1301d9b700 1 -- 172.21.15.158:0/2781018298 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f40087d0 con 0x7f13040b6970 2019-12-05T03:50:21.271 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.256+0000 7f1301d9b700 1 -- 172.21.15.158:0/2781018298 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12f4011820 con 0x7f13040b6970 2019-12-05T03:50:21.271 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.256+0000 7f1308ee8700 1 -- 172.21.15.158:0/2781018298 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f13040b6970 msgr2=0x7f130409add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:21.271 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.256+0000 7f1308ee8700 1 --2- 172.21.15.158:0/2781018298 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f13040b6970 0x7f130409add0 secure :-1 s=READY pgs=216 cs=0 l=1 rx=0x7f12f4002f30 tx=0x7f12f400fc70).stop 2019-12-05T03:50:21.271 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.256+0000 7f1308ee8700 1 -- 172.21.15.158:0/2781018298 shutdown_connections 2019-12-05T03:50:21.272 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.256+0000 7f1308ee8700 1 --2- 172.21.15.158:0/2781018298 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f13040b6970 0x7f130409add0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:21.272 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.256+0000 7f1308ee8700 1 --2- 172.21.15.158:0/2781018298 >> v2:172.21.15.96:3300/0 conn(0x7f130409ba40 0x7f130405a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:21.272 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.256+0000 7f1308ee8700 1 -- 172.21.15.158:0/2781018298 shutdown_connections 2019-12-05T03:50:21.272 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.256+0000 7f1308ee8700 1 -- 172.21.15.158:0/2781018298 wait complete. 2019-12-05T03:50:21.273 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.256+0000 7f1308ee8700 1 -- 172.21.15.158:0/2781018298 >> 172.21.15.158:0/2781018298 conn(0x7f13040b7ef0 msgr2=0x7f13040b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:21.281 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.260+0000 7f1308ee8700 1 Processor -- start 2019-12-05T03:50:21.281 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.260+0000 7f1308ee8700 1 -- start start 2019-12-05T03:50:21.282 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.260+0000 7f1308ee8700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f130413d0a0 0x7f130413c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:21.282 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.260+0000 7f1308ee8700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1304070cf0 0x7f1304071120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:21.282 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.260+0000 7f1308ee8700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1304140860 con 0x7f130413d4d0 2019-12-05T03:50:21.282 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.260+0000 7f1308ee8700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f130413da20 con 0x7f1304070cf0 2019-12-05T03:50:21.282 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.260+0000 7f1308ee8700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130413dcc0 con 0x7f130413d0a0 2019-12-05T03:50:21.283 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.260+0000 7f130259c700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f130413d4d0 0x7f1304154f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49026/0 (socket says 172.21.15.158:49026) 2019-12-05T03:50:21.283 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.260+0000 7f130259c700 1 -- 172.21.15.158:0/1244171040 learned_addr learned my addr 172.21.15.158:0/1244171040 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:21.283 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.260+0000 7f130359e700 1 --2- 172.21.15.158:0/1244171040 >> v2:172.21.15.96:3300/0 conn(0x7f1304070cf0 0x7f1304071120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:21.283 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.260+0000 7f1302d9d700 1 --2- 172.21.15.158:0/1244171040 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f130413d0a0 0x7f130413c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:21.284 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.260+0000 7f12f37fe700 1 -- 172.21.15.158:0/1244171040 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 948145594 0 0) 0x7f1304140860 con 0x7f130413d4d0 2019-12-05T03:50:21.284 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.260+0000 7f12f37fe700 1 -- 172.21.15.158:0/1244171040 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12e80030b0 con 0x7f130413d4d0 2019-12-05T03:50:21.285 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.260+0000 7f12f37fe700 1 -- 172.21.15.158:0/1244171040 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3063829275 0 0) 0x7f12e80030b0 con 0x7f130413d4d0 2019-12-05T03:50:21.285 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.260+0000 7f12f37fe700 1 -- 172.21.15.158:0/1244171040 --> v1:172.21.15.158:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1304140860 con 0x7f130413d4d0 2019-12-05T03:50:21.285 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.260+0000 7f12f37fe700 1 -- 172.21.15.158:0/1244171040 <== mon.1 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 828730332 0 0) 0x7f12f80024c0 con 0x7f130413d4d0 2019-12-05T03:50:21.286 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.260+0000 7f12f37fe700 1 -- 172.21.15.158:0/1244171040 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f130413d0a0 msgr2=0x7f130413c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:21.286 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.260+0000 7f12f37fe700 1 --2- 172.21.15.158:0/1244171040 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f130413d0a0 0x7f130413c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:21.286 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.260+0000 7f12f37fe700 1 -- 172.21.15.158:0/1244171040 >> v2:172.21.15.96:3300/0 conn(0x7f1304070cf0 msgr2=0x7f1304071120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:21.286 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.260+0000 7f12f37fe700 1 --2- 172.21.15.158:0/1244171040 >> v2:172.21.15.96:3300/0 conn(0x7f1304070cf0 0x7f1304071120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:21.287 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.264+0000 7f12f37fe700 1 -- 172.21.15.158:0/1244171040 >> v1:172.21.15.158:6789/0 conn(0x7f130413d4d0 legacy=0x7f1304154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:21.287 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.264+0000 7f12f37fe700 1 --2- 172.21.15.158:0/1244171040 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12e80038a0 0x7f12e8003d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:21.287 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.264+0000 7f12f37fe700 1 --2- 172.21.15.158:0/1244171040 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12e8004420 0x7f12e8004850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:21.288 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.264+0000 7f12f37fe700 1 --2- 172.21.15.158:0/1244171040 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12e8004e40 0x7f12e800b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:21.288 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.264+0000 7f12f37fe700 1 -- 172.21.15.158:0/1244171040 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130413da20 con 0x7f12e80038a0 2019-12-05T03:50:21.288 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.264+0000 7f12f37fe700 1 -- 172.21.15.158:0/1244171040 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130413dcc0 con 0x7f12e8004e40 2019-12-05T03:50:21.288 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.264+0000 7f12f37fe700 1 -- 172.21.15.158:0/1244171040 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e800bc40 con 0x7f12e8004420 2019-12-05T03:50:21.288 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.264+0000 7f130359e700 1 --2- 172.21.15.158:0/1244171040 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12e8004e40 0x7f12e800b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:21.289 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.264+0000 7f130259c700 1 --2- 172.21.15.158:0/1244171040 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12e8004420 0x7f12e8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:21.289 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.264+0000 7f1302d9d700 1 --2- 172.21.15.158:0/1244171040 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12e80038a0 0x7f12e8003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:21.289 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.264+0000 7f130359e700 1 -- 172.21.15.158:0/1244171040 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12e8004420 msgr2=0x7f12e8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:21.289 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.264+0000 7f130359e700 1 --2- 172.21.15.158:0/1244171040 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12e8004420 0x7f12e8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:21.290 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.264+0000 7f130359e700 1 -- 172.21.15.158:0/1244171040 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12e80038a0 msgr2=0x7f12e8003d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:21.290 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.264+0000 7f130359e700 1 --2- 172.21.15.158:0/1244171040 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12e80038a0 0x7f12e8003d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:21.290 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.264+0000 7f130359e700 1 -- 172.21.15.158:0/1244171040 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130413cc30 con 0x7f12e8004e40 2019-12-05T03:50:21.290 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.264+0000 7f1308ee8700 1 -- 172.21.15.158:0/1244171040 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f130413d0a0 con 0x7f12e8004e40 2019-12-05T03:50:21.291 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.264+0000 7f130359e700 1 --2- 172.21.15.158:0/1244171040 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12e8004e40 0x7f12e800b670 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f12fc004720 tx=0x7f12fc010f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.291 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.264+0000 7f130259c700 1 --2- 172.21.15.158:0/1244171040 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12e8004420 0x7f12e8004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-12-05T03:50:21.292 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.264+0000 7f1308ee8700 1 -- 172.21.15.158:0/1244171040 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f130413c6e0 con 0x7f12e8004e40 2019-12-05T03:50:21.292 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.264+0000 7f130359e700 1 --2- 172.21.15.158:0/1244171040 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12e8004e40 0x7f12e800b670 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f12fc004720 tx=0x7f12fc010f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.292 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.264+0000 7f130359e700 1 --2- 172.21.15.158:0/1244171040 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12e8004e40 0x7f12e800b670 secure :-1 s=READY pgs=218 cs=0 l=1 rx=0x7f12fc004720 tx=0x7f12fc010f90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:21.292 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.264+0000 7f130359e700 1 --2- 172.21.15.158:0/1244171040 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12e8004e40 0x7f12e800b670 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7f12fc004720 tx=0x7f12fc010f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.293 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.264+0000 7f12f37fe700 1 -- 172.21.15.158:0/1244171040 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12fc0047b0 con 0x7f12e8004e40 2019-12-05T03:50:21.293 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.264+0000 7f130359e700 1 --2- 172.21.15.158:0/1244171040 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12e8004e40 0x7f12e800b670 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7f12fc004720 tx=0x7f12fc010f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.293 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.264+0000 7f130359e700 1 --2- 172.21.15.158:0/1244171040 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12e8004e40 0x7f12e800b670 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7f12fc004720 tx=0x7f12fc010f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.293 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.264+0000 7f12f37fe700 1 -- 172.21.15.158:0/1244171040 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12fc00cb30 con 0x7f12e8004e40 2019-12-05T03:50:21.293 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.264+0000 7f12f37fe700 1 -- 172.21.15.158:0/1244171040 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12fc004d90 con 0x7f12e8004e40 2019-12-05T03:50:21.294 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.264+0000 7f130359e700 1 --2- 172.21.15.158:0/1244171040 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12e8004e40 0x7f12e800b670 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7f12fc004720 tx=0x7f12fc010f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.294 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.264+0000 7f12f37fe700 1 -- 172.21.15.158:0/1244171040 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f12fc006180 con 0x7f12e8004e40 2019-12-05T03:50:21.294 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.264+0000 7f130359e700 1 --2- 172.21.15.158:0/1244171040 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12e8004e40 0x7f12e800b670 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7f12fc004720 tx=0x7f12fc010f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.294 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.264+0000 7f12f37fe700 1 --2- 172.21.15.158:0/1244171040 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f12e8043b30 0x7f12e8046040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:21.295 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.264+0000 7f12f37fe700 1 -- 172.21.15.158:0/1244171040 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f12fc04afa0 con 0x7f12e8004e40 2019-12-05T03:50:21.295 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.264+0000 7f1302d9d700 1 --2- 172.21.15.158:0/1244171040 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f12e8043b30 0x7f12e8046040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:21.295 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.268+0000 7f1308ee8700 1 -- 172.21.15.158:0/1244171040 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12dc003200 con 0x7f12e8004e40 2019-12-05T03:50:21.295 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.268+0000 7f1302d9d700 1 --2- 172.21.15.158:0/1244171040 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f12e8043b30 0x7f12e8046040 crc :-1 s=READY pgs=105 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:21.296 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.268+0000 7f130359e700 1 --2- 172.21.15.158:0/1244171040 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12e8004e40 0x7f12e800b670 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7f12fc004720 tx=0x7f12fc010f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.296 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.268+0000 7f12f37fe700 1 -- 172.21.15.158:0/1244171040 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f12fc032280 con 0x7f12e8004e40 2019-12-05T03:50:21.432 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.424+0000 7f1308ee8700 1 -- 172.21.15.158:0/1244171040 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f12dc003650 con 0x7f12e8004e40 2019-12-05T03:50:21.433 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.424+0000 7f130359e700 1 --2- 172.21.15.158:0/1244171040 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12e8004e40 0x7f12e800b670 secure :-1 s=THROTTLE_DONE pgs=218 cs=0 l=1 rx=0x7f12fc004720 tx=0x7f12fc010f90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.433 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.424+0000 7f12f37fe700 1 -- 172.21.15.158:0/1244171040 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f12fc032e30 con 0x7f12e8004e40 2019-12-05T03:50:21.433 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:50:21.435 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.428+0000 7f1308ee8700 1 -- 172.21.15.158:0/1244171040 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f12e8043b30 msgr2=0x7f12e8046040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:21.435 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.428+0000 7f1308ee8700 1 --2- 172.21.15.158:0/1244171040 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f12e8043b30 0x7f12e8046040 crc :-1 s=READY pgs=105 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:21.435 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.428+0000 7f1308ee8700 1 -- 172.21.15.158:0/1244171040 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12e8004e40 msgr2=0x7f12e800b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:21.435 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.428+0000 7f1308ee8700 1 --2- 172.21.15.158:0/1244171040 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12e8004e40 0x7f12e800b670 secure :-1 s=READY pgs=218 cs=0 l=1 rx=0x7f12fc004720 tx=0x7f12fc010f90).stop 2019-12-05T03:50:21.436 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.428+0000 7f130359e700 1 -- 172.21.15.158:0/1244171040 reap_dead start 2019-12-05T03:50:21.436 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.428+0000 7f1308ee8700 1 -- 172.21.15.158:0/1244171040 shutdown_connections 2019-12-05T03:50:21.436 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.428+0000 7f1308ee8700 1 --2- 172.21.15.158:0/1244171040 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12e8004e40 0x7f12e800b670 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:21.436 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.428+0000 7f1308ee8700 1 -- 172.21.15.158:0/1244171040 shutdown_connections 2019-12-05T03:50:21.436 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.428+0000 7f1308ee8700 1 -- 172.21.15.158:0/1244171040 wait complete. 2019-12-05T03:50:21.436 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.428+0000 7f1308ee8700 1 -- 172.21.15.158:0/1244171040 >> 172.21.15.158:0/1244171040 conn(0x7f1304068c60 msgr2=0x7f130412fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:21.445 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-12-05T03:50:21.548 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.536+0000 7f12c7474700 1 Processor -- start 2019-12-05T03:50:21.549 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.536+0000 7f12c7474700 1 -- start start 2019-12-05T03:50:21.549 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.540+0000 7f12c7474700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f12c00b6970 0x7f12c009add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:21.549 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.540+0000 7f12c7474700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f12c009ba40 0x7f12c005a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:21.549 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.540+0000 7f12c7474700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12c005a950 0x7f12c0155290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:21.549 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.540+0000 7f12c7474700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12c009d210 con 0x7f12c009ba40 2019-12-05T03:50:21.549 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.540+0000 7f12c7474700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12c0099b90 con 0x7f12c00b6970 2019-12-05T03:50:21.550 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.540+0000 7f12c7474700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c0099e30 con 0x7f12c005a950 2019-12-05T03:50:21.550 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.540+0000 7f12c5a11700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f12c00b6970 0x7f12c009add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:21.550 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.540+0000 7f12c5a11700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f12c00b6970 0x7f12c009add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54260/0 (socket says 172.21.15.158:54260) 2019-12-05T03:50:21.550 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.540+0000 7f12c6212700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12c005a950 0x7f12c0155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:21.550 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.540+0000 7f12c5a11700 1 -- 172.21.15.158:0/504781987 learned_addr learned my addr 172.21.15.158:0/504781987 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:21.550 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.540+0000 7f12c5210700 1 --2- 172.21.15.158:0/504781987 >> v2:172.21.15.96:3300/0 conn(0x7f12c009ba40 0x7f12c005a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:21.550 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.540+0000 7f12c5a11700 1 -- 172.21.15.158:0/504781987 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12c005a950 msgr2=0x7f12c0155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:21.551 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.540+0000 7f12c5a11700 1 --2- 172.21.15.158:0/504781987 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12c005a950 0x7f12c0155290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:21.551 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.540+0000 7f12c5a11700 1 -- 172.21.15.158:0/504781987 >> v2:172.21.15.96:3300/0 conn(0x7f12c009ba40 msgr2=0x7f12c005a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:21.551 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.540+0000 7f12c5a11700 1 --2- 172.21.15.158:0/504781987 >> v2:172.21.15.96:3300/0 conn(0x7f12c009ba40 0x7f12c005a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:21.551 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.540+0000 7f12c5a11700 1 -- 172.21.15.158:0/504781987 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c007e960 con 0x7f12c00b6970 2019-12-05T03:50:21.551 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.540+0000 7f12c5a11700 1 --2- 172.21.15.158:0/504781987 >> v2:172.21.15.158:3300/0 conn(0x7f12c00b6970 0x7f12c009add0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f12b0002f30 tx=0x7f12b000fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.551 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.540+0000 7f12c5a11700 1 --2- 172.21.15.158:0/504781987 >> v2:172.21.15.158:3300/0 conn(0x7f12c00b6970 0x7f12c009add0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f12b0002f30 tx=0x7f12b000fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.551 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.540+0000 7f12c5a11700 1 --2- 172.21.15.158:0/504781987 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12c00b6970 0x7f12c009add0 secure :-1 s=READY pgs=219 cs=0 l=1 rx=0x7f12b0002f30 tx=0x7f12b000fdb0).ready entity=mon.1 client_cookie=28bd814cbff37b0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:21.552 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.540+0000 7f12c5a11700 1 --2- 172.21.15.158:0/504781987 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12c00b6970 0x7f12c009add0 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7f12b0002f30 tx=0x7f12b000fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.552 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.540+0000 7f12c4a0f700 1 -- 172.21.15.158:0/504781987 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12b0008c90 con 0x7f12c00b6970 2019-12-05T03:50:21.552 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.540+0000 7f12c5a11700 1 --2- 172.21.15.158:0/504781987 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12c00b6970 0x7f12c009add0 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7f12b0002f30 tx=0x7f12b000fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.552 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.540+0000 7f12c5a11700 1 --2- 172.21.15.158:0/504781987 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12c00b6970 0x7f12c009add0 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7f12b0002f30 tx=0x7f12b000fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.552 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.540+0000 7f12c4a0f700 1 -- 172.21.15.158:0/504781987 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b00088b0 con 0x7f12c00b6970 2019-12-05T03:50:21.553 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.540+0000 7f12c4a0f700 1 -- 172.21.15.158:0/504781987 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12b0011b50 con 0x7f12c00b6970 2019-12-05T03:50:21.553 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.540+0000 7f12c7474700 1 -- 172.21.15.158:0/504781987 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12c00b6970 msgr2=0x7f12c009add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:21.553 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.540+0000 7f12c7474700 1 --2- 172.21.15.158:0/504781987 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12c00b6970 0x7f12c009add0 secure :-1 s=READY pgs=219 cs=0 l=1 rx=0x7f12b0002f30 tx=0x7f12b000fdb0).stop 2019-12-05T03:50:21.553 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.540+0000 7f12c7474700 1 -- 172.21.15.158:0/504781987 shutdown_connections 2019-12-05T03:50:21.554 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.540+0000 7f12c7474700 1 --2- 172.21.15.158:0/504781987 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12c005a950 0x7f12c0155290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:21.554 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.540+0000 7f12c7474700 1 --2- 172.21.15.158:0/504781987 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f12c00b6970 0x7f12c009add0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:21.554 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.540+0000 7f12c7474700 1 --2- 172.21.15.158:0/504781987 >> v2:172.21.15.96:3300/0 conn(0x7f12c009ba40 0x7f12c005a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:21.554 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.540+0000 7f12c7474700 1 -- 172.21.15.158:0/504781987 shutdown_connections 2019-12-05T03:50:21.554 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.540+0000 7f12c7474700 1 -- 172.21.15.158:0/504781987 wait complete. 2019-12-05T03:50:21.554 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.540+0000 7f12c7474700 1 -- 172.21.15.158:0/504781987 >> 172.21.15.158:0/504781987 conn(0x7f12c00b7ef0 msgr2=0x7f12c00b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:21.558 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.544+0000 7f12c7474700 1 Processor -- start 2019-12-05T03:50:21.558 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.544+0000 7f12c7474700 1 -- start start 2019-12-05T03:50:21.558 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.544+0000 7f12c7474700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12c0141d30 0x7f12c00b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:21.558 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.544+0000 7f12c7474700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12c0152990 con 0x7f12c013df20 2019-12-05T03:50:21.558 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.544+0000 7f12c7474700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12c012dd70 con 0x7f12c0154120 2019-12-05T03:50:21.559 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.544+0000 7f12c7474700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c0152c60 con 0x7f12c0141d30 2019-12-05T03:50:21.559 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.544+0000 7f12c5a11700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f12c0154120 0x7f12c012d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49044/0 (socket says 172.21.15.158:49044) 2019-12-05T03:50:21.559 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.544+0000 7f12c5a11700 1 -- 172.21.15.158:0/3036914325 learned_addr learned my addr 172.21.15.158:0/3036914325 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:21.559 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.544+0000 7f12c5210700 1 --2- 172.21.15.158:0/3036914325 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12c0141d30 0x7f12c00b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:21.559 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.544+0000 7f12b67fc700 1 -- 172.21.15.158:0/3036914325 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3986684714 0 0) 0x7f12c012dd70 con 0x7f12c0154120 2019-12-05T03:50:21.559 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.544+0000 7f12b67fc700 1 -- 172.21.15.158:0/3036914325 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12a80030b0 con 0x7f12c0154120 2019-12-05T03:50:21.559 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.544+0000 7f12b67fc700 1 -- 172.21.15.158:0/3036914325 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1776789755 0 0) 0x7f12c0152990 con 0x7f12c013df20 2019-12-05T03:50:21.560 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.544+0000 7f12b67fc700 1 -- 172.21.15.158:0/3036914325 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12c012dd70 con 0x7f12c013df20 2019-12-05T03:50:21.560 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.544+0000 7f12c5210700 1 -- 172.21.15.158:0/3036914325 >> v1:172.21.15.158:6789/0 conn(0x7f12c0154120 legacy=0x7f12c012d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:21.560 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.544+0000 7f12c5210700 1 -- 172.21.15.158:0/3036914325 >> v1:172.21.15.96:6789/0 conn(0x7f12c013df20 legacy=0x7f12c013e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:21.560 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.544+0000 7f12c5210700 1 -- 172.21.15.158:0/3036914325 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c0154550 con 0x7f12c0141d30 2019-12-05T03:50:21.560 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.544+0000 7f12c5210700 1 --2- 172.21.15.158:0/3036914325 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12c0141d30 0x7f12c00b06e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f12bc002f30 tx=0x7f12bc010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.560 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.544+0000 7f12c5210700 1 --2- 172.21.15.158:0/3036914325 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12c0141d30 0x7f12c00b06e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f12bc002f30 tx=0x7f12bc010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.560 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.544+0000 7f12c5210700 1 --2- 172.21.15.158:0/3036914325 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12c0141d30 0x7f12c00b06e0 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7f12bc002f30 tx=0x7f12bc010a60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:21.561 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.544+0000 7f12c5210700 1 --2- 172.21.15.158:0/3036914325 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12c0141d30 0x7f12c00b06e0 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f12bc002f30 tx=0x7f12bc010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.561 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.544+0000 7f12b67fc700 1 -- 172.21.15.158:0/3036914325 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12bc0059c0 con 0x7f12c0141d30 2019-12-05T03:50:21.561 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.544+0000 7f12c5210700 1 --2- 172.21.15.158:0/3036914325 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12c0141d30 0x7f12c00b06e0 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f12bc002f30 tx=0x7f12bc010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.561 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.544+0000 7f12c5210700 1 --2- 172.21.15.158:0/3036914325 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12c0141d30 0x7f12c00b06e0 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f12bc002f30 tx=0x7f12bc010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.561 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.544+0000 7f12b67fc700 1 -- 172.21.15.158:0/3036914325 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12bc0055e0 con 0x7f12c0141d30 2019-12-05T03:50:21.561 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.544+0000 7f12c7474700 1 -- 172.21.15.158:0/3036914325 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12c0142160 con 0x7f12c0141d30 2019-12-05T03:50:21.561 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.544+0000 7f12b67fc700 1 -- 172.21.15.158:0/3036914325 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12bc0124a0 con 0x7f12c0141d30 2019-12-05T03:50:21.562 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.544+0000 7f12c7474700 1 -- 172.21.15.158:0/3036914325 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c00652f0 con 0x7f12c0141d30 2019-12-05T03:50:21.562 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.548+0000 7f12c5210700 1 --2- 172.21.15.158:0/3036914325 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12c0141d30 0x7f12c00b06e0 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f12bc002f30 tx=0x7f12bc010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.562 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.548+0000 7f12c5210700 1 --2- 172.21.15.158:0/3036914325 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12c0141d30 0x7f12c00b06e0 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f12bc002f30 tx=0x7f12bc010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.562 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.548+0000 7f12b67fc700 1 -- 172.21.15.158:0/3036914325 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f12bc012780 con 0x7f12c0141d30 2019-12-05T03:50:21.562 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.548+0000 7f12b67fc700 1 --2- 172.21.15.158:0/3036914325 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f12a803b3c0 0x7f12a803d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:21.562 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.548+0000 7f12b67fc700 1 -- 172.21.15.158:0/3036914325 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f12bc04ae20 con 0x7f12c0141d30 2019-12-05T03:50:21.562 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.548+0000 7f12c5a11700 1 --2- 172.21.15.158:0/3036914325 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f12a803b3c0 0x7f12a803d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:21.562 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.548+0000 7f12c5a11700 1 --2- 172.21.15.158:0/3036914325 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f12a803b3c0 0x7f12a803d8d0 crc :-1 s=READY pgs=106 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:21.563 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.552+0000 7f12c7474700 1 -- 172.21.15.158:0/3036914325 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12c00554e0 con 0x7f12c0141d30 2019-12-05T03:50:21.569 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.564+0000 7f12c5210700 1 --2- 172.21.15.158:0/3036914325 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12c0141d30 0x7f12c00b06e0 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f12bc002f30 tx=0x7f12bc010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.569 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.564+0000 7f12b67fc700 1 -- 172.21.15.158:0/3036914325 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f12bc031de0 con 0x7f12c0141d30 2019-12-05T03:50:21.729 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.720+0000 7f12c7474700 1 -- 172.21.15.158:0/3036914325 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f12c00b27b0 con 0x7f12c0141d30 2019-12-05T03:50:21.729 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.724+0000 7f12c5210700 1 --2- 172.21.15.158:0/3036914325 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12c0141d30 0x7f12c00b06e0 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f12bc002f30 tx=0x7f12bc010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.730 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.724+0000 7f12b67fc700 1 -- 172.21.15.158:0/3036914325 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7f12bc032040 con 0x7f12c0141d30 2019-12-05T03:50:21.732 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:50:21.735 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.728+0000 7f12c7474700 1 -- 172.21.15.158:0/3036914325 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f12a803b3c0 msgr2=0x7f12a803d8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:21.735 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.728+0000 7f12c7474700 1 --2- 172.21.15.158:0/3036914325 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f12a803b3c0 0x7f12a803d8d0 crc :-1 s=READY pgs=106 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:21.735 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.728+0000 7f12c7474700 1 -- 172.21.15.158:0/3036914325 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12c0141d30 msgr2=0x7f12c00b06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:21.735 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.728+0000 7f12c7474700 1 --2- 172.21.15.158:0/3036914325 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12c0141d30 0x7f12c00b06e0 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7f12bc002f30 tx=0x7f12bc010a60).stop 2019-12-05T03:50:21.735 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.728+0000 7f12c7474700 1 -- 172.21.15.158:0/3036914325 shutdown_connections 2019-12-05T03:50:21.736 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.728+0000 7f12c7474700 1 --2- 172.21.15.158:0/3036914325 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f12a803b3c0 0x7f12a803d8d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:21.736 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.728+0000 7f12c7474700 1 --2- 172.21.15.158:0/3036914325 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f12c0141d30 0x7f12c00b06e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:21.736 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.728+0000 7f12c7474700 1 -- 172.21.15.158:0/3036914325 shutdown_connections 2019-12-05T03:50:21.736 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.728+0000 7f12c7474700 1 -- 172.21.15.158:0/3036914325 wait complete. 2019-12-05T03:50:21.737 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.728+0000 7f12c7474700 1 -- 172.21.15.158:0/3036914325 >> 172.21.15.158:0/3036914325 conn(0x7f12c00b7ef0 msgr2=0x7f12c007d800 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:21.749 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-12-05T03:50:21.857 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.844+0000 7fe00c385700 1 Processor -- start 2019-12-05T03:50:21.857 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.844+0000 7fe00c385700 1 -- start start 2019-12-05T03:50:21.857 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.844+0000 7fe00c385700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe0040b6970 0x7fe00409add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:21.857 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.844+0000 7fe00c385700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe0040b5370 0x7fe0040b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:21.857 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.844+0000 7fe00c385700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe004099e30 con 0x7fe00409ba40 2019-12-05T03:50:21.857 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.844+0000 7fe00c385700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe00409d210 con 0x7fe0040b6970 2019-12-05T03:50:21.858 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.844+0000 7fe00c385700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe004099b90 con 0x7fe0040b5370 2019-12-05T03:50:21.858 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.844+0000 7fe00a922700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe0040b6970 0x7fe00409add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:21.858 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.844+0000 7fe00a121700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fe00409ba40 0x7fe00405a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49050/0 (socket says 172.21.15.158:49050) 2019-12-05T03:50:21.858 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.844+0000 7fe00a121700 1 -- 172.21.15.158:0/2613862937 learned_addr learned my addr 172.21.15.158:0/2613862937 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:21.858 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.844+0000 7fe00b123700 1 --2- 172.21.15.158:0/2613862937 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe0040b5370 0x7fe0040b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:21.858 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.844+0000 7fe00a922700 1 -- 172.21.15.158:0/2613862937 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe0040b5370 msgr2=0x7fe0040b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:21.858 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.844+0000 7fe00a922700 1 --2- 172.21.15.158:0/2613862937 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe0040b5370 0x7fe0040b57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:21.859 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.844+0000 7fe00a922700 1 -- 172.21.15.158:0/2613862937 >> v1:172.21.15.158:6789/0 conn(0x7fe00409ba40 legacy=0x7fe00405a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:21.859 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.844+0000 7fe009920700 1 -- 172.21.15.158:0/2613862937 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2953363972 0 0) 0x7fe004099e30 con 0x7fe00409ba40 2019-12-05T03:50:21.859 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.844+0000 7fe00a922700 1 -- 172.21.15.158:0/2613862937 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe00407e960 con 0x7fe0040b6970 2019-12-05T03:50:21.859 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.844+0000 7fe00b123700 1 --2- 172.21.15.158:0/2613862937 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe0040b5370 0x7fe0040b57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-12-05T03:50:21.859 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.844+0000 7fe00a922700 1 --2- 172.21.15.158:0/2613862937 >> v2:172.21.15.158:3300/0 conn(0x7fe0040b6970 0x7fe00409add0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe000002f30 tx=0x7fe00000fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.859 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.844+0000 7fe00a922700 1 --2- 172.21.15.158:0/2613862937 >> v2:172.21.15.158:3300/0 conn(0x7fe0040b6970 0x7fe00409add0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe000002f30 tx=0x7fe00000fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.859 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.844+0000 7fe00a922700 1 --2- 172.21.15.158:0/2613862937 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe0040b6970 0x7fe00409add0 secure :-1 s=READY pgs=222 cs=0 l=1 rx=0x7fe000002f30 tx=0x7fe00000fc70).ready entity=mon.1 client_cookie=db1a164eaef85112 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:21.860 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.844+0000 7fe00a922700 1 --2- 172.21.15.158:0/2613862937 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe0040b6970 0x7fe00409add0 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7fe000002f30 tx=0x7fe00000fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.860 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.844+0000 7fe009920700 1 -- 172.21.15.158:0/2613862937 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe000008bb0 con 0x7fe0040b6970 2019-12-05T03:50:21.860 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.844+0000 7fe00a922700 1 --2- 172.21.15.158:0/2613862937 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe0040b6970 0x7fe00409add0 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7fe000002f30 tx=0x7fe00000fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.860 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.844+0000 7fe009920700 1 -- 172.21.15.158:0/2613862937 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0000087d0 con 0x7fe0040b6970 2019-12-05T03:50:21.860 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.844+0000 7fe00a922700 1 --2- 172.21.15.158:0/2613862937 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe0040b6970 0x7fe00409add0 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7fe000002f30 tx=0x7fe00000fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.860 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.844+0000 7fe009920700 1 -- 172.21.15.158:0/2613862937 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe000011820 con 0x7fe0040b6970 2019-12-05T03:50:21.860 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.844+0000 7fe00c385700 1 -- 172.21.15.158:0/2613862937 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe0040b6970 msgr2=0x7fe00409add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:21.861 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.844+0000 7fe00c385700 1 --2- 172.21.15.158:0/2613862937 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe0040b6970 0x7fe00409add0 secure :-1 s=READY pgs=222 cs=0 l=1 rx=0x7fe000002f30 tx=0x7fe00000fc70).stop 2019-12-05T03:50:21.861 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.848+0000 7fe00c385700 1 -- 172.21.15.158:0/2613862937 shutdown_connections 2019-12-05T03:50:21.861 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.848+0000 7fe00c385700 1 --2- 172.21.15.158:0/2613862937 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe0040b6970 0x7fe00409add0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:21.861 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.848+0000 7fe00c385700 1 --2- 172.21.15.158:0/2613862937 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe0040b5370 0x7fe0040b57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:21.861 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.848+0000 7fe00c385700 1 -- 172.21.15.158:0/2613862937 shutdown_connections 2019-12-05T03:50:21.861 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.848+0000 7fe00c385700 1 -- 172.21.15.158:0/2613862937 wait complete. 2019-12-05T03:50:21.861 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.848+0000 7fe00c385700 1 -- 172.21.15.158:0/2613862937 >> 172.21.15.158:0/2613862937 conn(0x7fe0040b7ef0 msgr2=0x7fe0040b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:21.864 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.852+0000 7fe00c385700 1 Processor -- start 2019-12-05T03:50:21.865 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.852+0000 7fe00c385700 1 -- start start 2019-12-05T03:50:21.865 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.852+0000 7fe00c385700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe0040acc20 0x7fe0040b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:21.865 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.852+0000 7fe00c385700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe00413a570 con 0x7fe00407b340 2019-12-05T03:50:21.865 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.852+0000 7fe00c385700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0041522f0 con 0x7fe00413d600 2019-12-05T03:50:21.865 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.852+0000 7fe00c385700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe004154940 con 0x7fe0040acc20 2019-12-05T03:50:21.865 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.852+0000 7fe00a922700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fe00413d600 0x7fe004139d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49056/0 (socket says 172.21.15.158:49056) 2019-12-05T03:50:21.866 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.852+0000 7fe00a922700 1 -- 172.21.15.158:0/2998539125 learned_addr learned my addr 172.21.15.158:0/2998539125 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:21.866 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.852+0000 7fe00a121700 1 --2- 172.21.15.158:0/2998539125 >> v2:172.21.15.158:3300/0 conn(0x7fe0040acc20 0x7fe0040b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:21.866 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.852+0000 7fe00a121700 1 -- 172.21.15.158:0/2998539125 >> v1:172.21.15.158:6789/0 conn(0x7fe00413d600 legacy=0x7fe004139d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:21.866 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.852+0000 7fe00a121700 1 -- 172.21.15.158:0/2998539125 >> v1:172.21.15.96:6789/0 conn(0x7fe00407b340 legacy=0x7fe004151af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:21.866 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.852+0000 7fdffb7fe700 1 -- 172.21.15.158:0/2998539125 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1947802527 0 0) 0x7fe0041522f0 con 0x7fe00413d600 2019-12-05T03:50:21.866 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.852+0000 7fe00a121700 1 -- 172.21.15.158:0/2998539125 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe004152520 con 0x7fe0040acc20 2019-12-05T03:50:21.866 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.852+0000 7fe00a121700 1 --2- 172.21.15.158:0/2998539125 >> v2:172.21.15.158:3300/0 conn(0x7fe0040acc20 0x7fe0040b29c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdff40043a0 tx=0x7fdff4010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.867 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.852+0000 7fe00a121700 1 --2- 172.21.15.158:0/2998539125 >> v2:172.21.15.158:3300/0 conn(0x7fe0040acc20 0x7fe0040b29c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdff40043a0 tx=0x7fdff4010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.867 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.852+0000 7fe00a121700 1 --2- 172.21.15.158:0/2998539125 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe0040acc20 0x7fe0040b29c0 secure :-1 s=READY pgs=224 cs=0 l=1 rx=0x7fdff40043a0 tx=0x7fdff4010820).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:21.867 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.856+0000 7fe00a121700 1 --2- 172.21.15.158:0/2998539125 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe0040acc20 0x7fe0040b29c0 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7fdff40043a0 tx=0x7fdff4010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.867 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.856+0000 7fdffb7fe700 1 -- 172.21.15.158:0/2998539125 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdff4011640 con 0x7fe0040acc20 2019-12-05T03:50:21.867 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.856+0000 7fe00a121700 1 --2- 172.21.15.158:0/2998539125 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe0040acc20 0x7fe0040b29c0 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7fdff40043a0 tx=0x7fdff4010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.867 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.856+0000 7fe00a121700 1 --2- 172.21.15.158:0/2998539125 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe0040acc20 0x7fe0040b29c0 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7fdff40043a0 tx=0x7fdff4010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.868 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.856+0000 7fdffb7fe700 1 -- 172.21.15.158:0/2998539125 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff4011260 con 0x7fe0040acc20 2019-12-05T03:50:21.868 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.856+0000 7fe00c385700 1 -- 172.21.15.158:0/2998539125 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe00407b770 con 0x7fe0040acc20 2019-12-05T03:50:21.868 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.856+0000 7fdffb7fe700 1 -- 172.21.15.158:0/2998539125 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdff4011c20 con 0x7fe0040acc20 2019-12-05T03:50:21.868 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.856+0000 7fe00c385700 1 -- 172.21.15.158:0/2998539125 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe004144da0 con 0x7fe0040acc20 2019-12-05T03:50:21.868 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.856+0000 7fe00a121700 1 --2- 172.21.15.158:0/2998539125 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe0040acc20 0x7fe0040b29c0 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7fdff40043a0 tx=0x7fdff4010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.869 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.856+0000 7fdffb7fe700 1 -- 172.21.15.158:0/2998539125 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fdff400b330 con 0x7fe0040acc20 2019-12-05T03:50:21.869 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.856+0000 7fe00a121700 1 --2- 172.21.15.158:0/2998539125 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe0040acc20 0x7fe0040b29c0 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7fdff40043a0 tx=0x7fdff4010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.870 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.856+0000 7fdffb7fe700 1 --2- 172.21.15.158:0/2998539125 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fdfec03ab90 0x7fdfec03d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:21.870 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.856+0000 7fdffb7fe700 1 -- 172.21.15.158:0/2998539125 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fdff404b260 con 0x7fe0040acc20 2019-12-05T03:50:21.870 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.856+0000 7fe00a922700 1 --2- 172.21.15.158:0/2998539125 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fdfec03ab90 0x7fdfec03d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:21.870 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.856+0000 7fe00a922700 1 --2- 172.21.15.158:0/2998539125 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fdfec03ab90 0x7fdfec03d0a0 crc :-1 s=READY pgs=107 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:21.870 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.860+0000 7fe00c385700 1 -- 172.21.15.158:0/2998539125 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0040554e0 con 0x7fe0040acc20 2019-12-05T03:50:21.873 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.868+0000 7fe00a121700 1 --2- 172.21.15.158:0/2998539125 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe0040acc20 0x7fe0040b29c0 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7fdff40043a0 tx=0x7fdff4010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:21.874 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:21.868+0000 7fdffb7fe700 1 -- 172.21.15.158:0/2998539125 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fdff40322c0 con 0x7fe0040acc20 2019-12-05T03:50:22.039 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.032+0000 7fe00c385700 1 -- 172.21.15.158:0/2998539125 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7fe004066940 con 0x7fe0040acc20 2019-12-05T03:50:22.040 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.032+0000 7fe00a121700 1 --2- 172.21.15.158:0/2998539125 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe0040acc20 0x7fe0040b29c0 secure :-1 s=THROTTLE_DONE pgs=224 cs=0 l=1 rx=0x7fdff40043a0 tx=0x7fdff4010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:22.040 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.032+0000 7fdffb7fe700 1 -- 172.21.15.158:0/2998539125 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7fdff4032520 con 0x7fe0040acc20 2019-12-05T03:50:22.040 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:50:22.043 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.036+0000 7fe00c385700 1 -- 172.21.15.158:0/2998539125 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fdfec03ab90 msgr2=0x7fdfec03d0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:22.043 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.036+0000 7fe00c385700 1 --2- 172.21.15.158:0/2998539125 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fdfec03ab90 0x7fdfec03d0a0 crc :-1 s=READY pgs=107 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:22.043 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.036+0000 7fe00c385700 1 -- 172.21.15.158:0/2998539125 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe0040acc20 msgr2=0x7fe0040b29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:22.043 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.036+0000 7fe00c385700 1 --2- 172.21.15.158:0/2998539125 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe0040acc20 0x7fe0040b29c0 secure :-1 s=READY pgs=224 cs=0 l=1 rx=0x7fdff40043a0 tx=0x7fdff4010820).stop 2019-12-05T03:50:22.043 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.036+0000 7fe00c385700 1 -- 172.21.15.158:0/2998539125 shutdown_connections 2019-12-05T03:50:22.043 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.036+0000 7fe00c385700 1 --2- 172.21.15.158:0/2998539125 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fdfec03ab90 0x7fdfec03d0a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:22.044 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.036+0000 7fe00c385700 1 --2- 172.21.15.158:0/2998539125 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe0040acc20 0x7fe0040b29c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:22.044 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.036+0000 7fe00c385700 1 -- 172.21.15.158:0/2998539125 shutdown_connections 2019-12-05T03:50:22.044 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.036+0000 7fe00c385700 1 -- 172.21.15.158:0/2998539125 wait complete. 2019-12-05T03:50:22.044 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.036+0000 7fe00c385700 1 -- 172.21.15.158:0/2998539125 >> 172.21.15.158:0/2998539125 conn(0x7fe0040b1e80 msgr2=0x7fe0040b5370 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:22.053 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-12-05T03:50:22.054 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-12-05T03:50:22.150 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.136+0000 7fc6efcae700 1 Processor -- start 2019-12-05T03:50:22.151 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.136+0000 7fc6efcae700 1 -- start start 2019-12-05T03:50:22.151 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.140+0000 7fc6efcae700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc6e809cf60 0x7fc6e809a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:22.151 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.140+0000 7fc6efcae700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e80accb0 con 0x7fc6e81553b0 2019-12-05T03:50:22.151 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.140+0000 7fc6efcae700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e80b6980 con 0x7fc6e805a740 2019-12-05T03:50:22.151 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.140+0000 7fc6efcae700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6e80b1730 con 0x7fc6e809cf60 2019-12-05T03:50:22.151 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.140+0000 7fc6eda4a700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fc6e805a740 0x7fc6e8151460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49066/0 (socket says 172.21.15.158:49066) 2019-12-05T03:50:22.152 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.140+0000 7fc6eda4a700 1 -- 172.21.15.158:0/1080815491 learned_addr learned my addr 172.21.15.158:0/1080815491 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:22.152 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.140+0000 7fc6ee24b700 1 --2- 172.21.15.158:0/1080815491 >> v2:172.21.15.96:3300/0 conn(0x7fc6e809cf60 0x7fc6e809a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:22.152 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.140+0000 7fc6ed249700 1 -- 172.21.15.158:0/1080815491 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 790209193 0 0) 0x7fc6e80b6980 con 0x7fc6e805a740 2019-12-05T03:50:22.152 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.140+0000 7fc6ed249700 1 -- 172.21.15.158:0/1080815491 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6d40030b0 con 0x7fc6e805a740 2019-12-05T03:50:22.152 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.140+0000 7fc6ee24b700 1 -- 172.21.15.158:0/1080815491 >> v1:172.21.15.158:6789/0 conn(0x7fc6e805a740 legacy=0x7fc6e8151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:22.152 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.140+0000 7fc6ed249700 1 -- 172.21.15.158:0/1080815491 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 158712959 0 0) 0x7fc6d40030b0 con 0x7fc6e805a740 2019-12-05T03:50:22.152 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.140+0000 7fc6ee24b700 1 -- 172.21.15.158:0/1080815491 >> v1:172.21.15.96:6789/0 conn(0x7fc6e81553b0 legacy=0x7fc6e81557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:22.153 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.140+0000 7fc6ee24b700 1 -- 172.21.15.158:0/1080815491 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e805ab70 con 0x7fc6e809cf60 2019-12-05T03:50:22.153 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.140+0000 7fc6ee24b700 1 --2- 172.21.15.158:0/1080815491 >> v2:172.21.15.96:3300/0 conn(0x7fc6e809cf60 0x7fc6e809a320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc6e4008790 tx=0x7fc6e400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:22.153 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.140+0000 7fc6ee24b700 1 --2- 172.21.15.158:0/1080815491 >> v2:172.21.15.96:3300/0 conn(0x7fc6e809cf60 0x7fc6e809a320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc6e4008790 tx=0x7fc6e400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:22.153 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.140+0000 7fc6ee24b700 1 --2- 172.21.15.158:0/1080815491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e809cf60 0x7fc6e809a320 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7fc6e4008790 tx=0x7fc6e400fbf0).ready entity=mon.0 client_cookie=8dbe4b0f596cfdeb server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:22.153 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.140+0000 7fc6ee24b700 1 --2- 172.21.15.158:0/1080815491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e809cf60 0x7fc6e809a320 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7fc6e4008790 tx=0x7fc6e400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:22.153 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.140+0000 7fc6ed249700 1 -- 172.21.15.158:0/1080815491 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6e4011230 con 0x7fc6e809cf60 2019-12-05T03:50:22.153 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.140+0000 7fc6ee24b700 1 --2- 172.21.15.158:0/1080815491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e809cf60 0x7fc6e809a320 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7fc6e4008790 tx=0x7fc6e400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:22.154 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.140+0000 7fc6ee24b700 1 --2- 172.21.15.158:0/1080815491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e809cf60 0x7fc6e809a320 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7fc6e4008790 tx=0x7fc6e400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:22.154 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.140+0000 7fc6ed249700 1 -- 172.21.15.158:0/1080815491 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e4008bc0 con 0x7fc6e809cf60 2019-12-05T03:50:22.154 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.140+0000 7fc6ed249700 1 -- 172.21.15.158:0/1080815491 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6e4011810 con 0x7fc6e809cf60 2019-12-05T03:50:22.154 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.140+0000 7fc6efcae700 1 -- 172.21.15.158:0/1080815491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e809cf60 msgr2=0x7fc6e809a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:22.154 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.140+0000 7fc6efcae700 1 --2- 172.21.15.158:0/1080815491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e809cf60 0x7fc6e809a320 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7fc6e4008790 tx=0x7fc6e400fbf0).stop 2019-12-05T03:50:22.154 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.140+0000 7fc6efcae700 1 -- 172.21.15.158:0/1080815491 shutdown_connections 2019-12-05T03:50:22.154 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.140+0000 7fc6efcae700 1 --2- 172.21.15.158:0/1080815491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e809cf60 0x7fc6e809a320 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:22.155 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.140+0000 7fc6efcae700 1 -- 172.21.15.158:0/1080815491 shutdown_connections 2019-12-05T03:50:22.155 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.140+0000 7fc6efcae700 1 -- 172.21.15.158:0/1080815491 wait complete. 2019-12-05T03:50:22.155 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.140+0000 7fc6efcae700 1 -- 172.21.15.158:0/1080815491 >> 172.21.15.158:0/1080815491 conn(0x7fc6e80b7e60 msgr2=0x7fc6e80b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:22.158 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.144+0000 7fc6efcae700 1 Processor -- start 2019-12-05T03:50:22.158 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.144+0000 7fc6efcae700 1 -- start start 2019-12-05T03:50:22.158 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.144+0000 7fc6efcae700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc6e812cf60 0x7fc6e812f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:22.158 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.144+0000 7fc6efcae700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fc6e813c720 0x7fc6e813cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:22.158 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.144+0000 7fc6efcae700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e80645b0 con 0x7fc6e809b310 2019-12-05T03:50:22.159 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.144+0000 7fc6efcae700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6e813c220 con 0x7fc6e812cf60 2019-12-05T03:50:22.159 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.144+0000 7fc6efcae700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6e809b8d0 con 0x7fc6e813c720 2019-12-05T03:50:22.159 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.144+0000 7fc6eda4a700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fc6e809b310 0x7fc6e8063db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49070/0 (socket says 172.21.15.158:49070) 2019-12-05T03:50:22.159 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.144+0000 7fc6eda4a700 1 -- 172.21.15.158:0/45528334 learned_addr learned my addr 172.21.15.158:0/45528334 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:22.159 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.144+0000 7fc6eea4c700 1 --2- 172.21.15.158:0/45528334 >> v2:172.21.15.158:3300/0 conn(0x7fc6e813c720 0x7fc6e813cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:22.159 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.144+0000 7fc6ee24b700 1 --2- 172.21.15.158:0/45528334 >> v2:172.21.15.96:3300/0 conn(0x7fc6e812cf60 0x7fc6e812f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:22.160 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.148+0000 7fc6deffd700 1 -- 172.21.15.158:0/45528334 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4073348630 0 0) 0x7fc6e80645b0 con 0x7fc6e809b310 2019-12-05T03:50:22.160 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.148+0000 7fc6deffd700 1 -- 172.21.15.158:0/45528334 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6d00030b0 con 0x7fc6e809b310 2019-12-05T03:50:22.160 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.148+0000 7fc6ee24b700 1 -- 172.21.15.158:0/45528334 >> v2:172.21.15.158:3300/0 conn(0x7fc6e813c720 msgr2=0x7fc6e813cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:22.160 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.148+0000 7fc6ee24b700 1 --2- 172.21.15.158:0/45528334 >> v2:172.21.15.158:3300/0 conn(0x7fc6e813c720 0x7fc6e813cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:22.160 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.148+0000 7fc6ee24b700 1 -- 172.21.15.158:0/45528334 >> v1:172.21.15.158:6789/0 conn(0x7fc6e809b310 legacy=0x7fc6e8063db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:22.160 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.148+0000 7fc6ee24b700 1 -- 172.21.15.158:0/45528334 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e807b060 con 0x7fc6e812cf60 2019-12-05T03:50:22.160 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.148+0000 7fc6ee24b700 1 --2- 172.21.15.158:0/45528334 >> v2:172.21.15.96:3300/0 conn(0x7fc6e812cf60 0x7fc6e812f220 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc6e4008790 tx=0x7fc6e40118d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:22.161 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.148+0000 7fc6ee24b700 1 --2- 172.21.15.158:0/45528334 >> v2:172.21.15.96:3300/0 conn(0x7fc6e812cf60 0x7fc6e812f220 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc6e4008790 tx=0x7fc6e40118d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:22.161 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.148+0000 7fc6ee24b700 1 --2- 172.21.15.158:0/45528334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e812cf60 0x7fc6e812f220 secure :-1 s=READY pgs=160 cs=0 l=1 rx=0x7fc6e4008790 tx=0x7fc6e40118d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:22.161 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.148+0000 7fc6ee24b700 1 --2- 172.21.15.158:0/45528334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e812cf60 0x7fc6e812f220 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7fc6e4008790 tx=0x7fc6e40118d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:22.161 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.148+0000 7fc6deffd700 1 -- 172.21.15.158:0/45528334 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6e4007150 con 0x7fc6e812cf60 2019-12-05T03:50:22.161 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.148+0000 7fc6efcae700 1 -- 172.21.15.158:0/45528334 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e807b2d0 con 0x7fc6e812cf60 2019-12-05T03:50:22.161 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.148+0000 7fc6ee24b700 1 --2- 172.21.15.158:0/45528334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e812cf60 0x7fc6e812f220 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7fc6e4008790 tx=0x7fc6e40118d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:22.161 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.148+0000 7fc6deffd700 1 -- 172.21.15.158:0/45528334 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e4011430 con 0x7fc6e812cf60 2019-12-05T03:50:22.162 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.148+0000 7fc6ee24b700 1 --2- 172.21.15.158:0/45528334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e812cf60 0x7fc6e812f220 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7fc6e4008790 tx=0x7fc6e40118d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:22.162 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.148+0000 7fc6deffd700 1 -- 172.21.15.158:0/45528334 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6e400f550 con 0x7fc6e812cf60 2019-12-05T03:50:22.162 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.148+0000 7fc6efcae700 1 -- 172.21.15.158:0/45528334 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e807b850 con 0x7fc6e812cf60 2019-12-05T03:50:22.162 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.148+0000 7fc6ee24b700 1 --2- 172.21.15.158:0/45528334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e812cf60 0x7fc6e812f220 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7fc6e4008790 tx=0x7fc6e40118d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:22.162 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.148+0000 7fc6deffd700 1 -- 172.21.15.158:0/45528334 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fc6e4005540 con 0x7fc6e812cf60 2019-12-05T03:50:22.162 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.148+0000 7fc6ee24b700 1 --2- 172.21.15.158:0/45528334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e812cf60 0x7fc6e812f220 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7fc6e4008790 tx=0x7fc6e40118d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:22.162 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.148+0000 7fc6deffd700 1 --2- 172.21.15.158:0/45528334 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fc6d003b2d0 0x7fc6d003d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:22.163 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.148+0000 7fc6deffd700 1 -- 172.21.15.158:0/45528334 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fc6e404ba50 con 0x7fc6e812cf60 2019-12-05T03:50:22.163 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.148+0000 7fc6eda4a700 1 --2- 172.21.15.158:0/45528334 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fc6d003b2d0 0x7fc6d003d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:22.163 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.152+0000 7fc6eda4a700 1 --2- 172.21.15.158:0/45528334 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fc6d003b2d0 0x7fc6d003d7e0 crc :-1 s=READY pgs=108 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:22.163 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.152+0000 7fc6efcae700 1 -- 172.21.15.158:0/45528334 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e80554e0 con 0x7fc6e812cf60 2019-12-05T03:50:22.168 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.160+0000 7fc6ee24b700 1 --2- 172.21.15.158:0/45528334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e812cf60 0x7fc6e812f220 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7fc6e4008790 tx=0x7fc6e40118d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:22.169 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.160+0000 7fc6deffd700 1 -- 172.21.15.158:0/45528334 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fc6e404bde0 con 0x7fc6e812cf60 2019-12-05T03:50:22.334 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.328+0000 7fc6efcae700 1 -- 172.21.15.158:0/45528334 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc6e8066940 con 0x7fc6e812cf60 2019-12-05T03:50:22.335 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.328+0000 7fc6ee24b700 1 --2- 172.21.15.158:0/45528334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e812cf60 0x7fc6e812f220 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7fc6e4008790 tx=0x7fc6e40118d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:22.335 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.328+0000 7fc6deffd700 1 -- 172.21.15.158:0/45528334 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2105 (secure 0 0 0) 0x7fc6e40306f0 con 0x7fc6e812cf60 2019-12-05T03:50:22.337 INFO:teuthology.orchestra.run.smithi158.stderr:dumped fsmap epoch 6 2019-12-05T03:50:22.337 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:22.338 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4339,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.158:6833/1485705503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":1485705503},{"type":"v1","addr":"172.21.15.158:6833","nonce":1485705503}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-12-05T03:50:01.249656+0000","modified":"2019-12-05T03:50:09.365441+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4241},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4241":{"gid":4241,"name":"b","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6835/3636871068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":3636871068},{"type":"v1","addr":"172.21.15.96:6835","nonce":3636871068}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2019-12-05T03:50:22.340 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.332+0000 7fc6efcae700 1 -- 172.21.15.158:0/45528334 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fc6d003b2d0 msgr2=0x7fc6d003d7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:22.340 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.332+0000 7fc6efcae700 1 --2- 172.21.15.158:0/45528334 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fc6d003b2d0 0x7fc6d003d7e0 crc :-1 s=READY pgs=108 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:22.340 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.332+0000 7fc6efcae700 1 -- 172.21.15.158:0/45528334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e812cf60 msgr2=0x7fc6e812f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:22.340 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.332+0000 7fc6efcae700 1 --2- 172.21.15.158:0/45528334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e812cf60 0x7fc6e812f220 secure :-1 s=READY pgs=160 cs=0 l=1 rx=0x7fc6e4008790 tx=0x7fc6e40118d0).stop 2019-12-05T03:50:22.340 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.332+0000 7fc6efcae700 1 -- 172.21.15.158:0/45528334 shutdown_connections 2019-12-05T03:50:22.341 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.332+0000 7fc6efcae700 1 --2- 172.21.15.158:0/45528334 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fc6d003b2d0 0x7fc6d003d7e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:22.341 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.332+0000 7fc6efcae700 1 --2- 172.21.15.158:0/45528334 >> v2:172.21.15.158:3300/0 conn(0x7fc6e813c720 0x7fc6e813cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:22.341 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.332+0000 7fc6efcae700 1 --2- 172.21.15.158:0/45528334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6e812cf60 0x7fc6e812f220 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:22.341 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.332+0000 7fc6efcae700 1 -- 172.21.15.158:0/45528334 shutdown_connections 2019-12-05T03:50:22.341 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.332+0000 7fc6efcae700 1 -- 172.21.15.158:0/45528334 wait complete. 2019-12-05T03:50:22.341 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:22.332+0000 7fc6efcae700 1 -- 172.21.15.158:0/45528334 >> 172.21.15.158:0/45528334 conn(0x7fc6e812b290 msgr2=0x7fc6e812bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:22.551 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4241}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 6, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [3], u'info': {u'gid_4241': {u'export_targets': [], u'name': u'b', u'incarnation': 5, u'state_seq': 3, u'state': u'up:active', u'gid': 4241, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 3636871068, u'type': u'v2', u'addr': u'172.21.15.96:6834'}, {u'nonce': 3636871068, u'type': u'v1', u'addr': u'172.21.15.96:6835'}]}, u'addr': u'172.21.15.96:6835/3636871068'}}, u'fs_name': u'cephfs', u'created': u'2019-12-05T03:50:01.249656+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-12-05T03:50:09.365441+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-12-05T03:50:22.552 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-12-05T03:50:22.552 INFO:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2019-12-05T03:50:22.644 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2019-12-05T03:50:22.645 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_fsid": "a91186ae-f496-4de1-918d-820c55ff1feb", 2019-12-05T03:50:22.645 INFO:teuthology.orchestra.run.smithi096.stdout: "whoami": 0, 2019-12-05T03:50:22.645 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 4241, 2019-12-05T03:50:22.645 INFO:teuthology.orchestra.run.smithi096.stdout: "want_state": "up:active", 2019-12-05T03:50:22.645 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "up:active", 2019-12-05T03:50:22.645 INFO:teuthology.orchestra.run.smithi096.stdout: "rank_uptime": 14.279852746, 2019-12-05T03:50:22.645 INFO:teuthology.orchestra.run.smithi096.stdout: "mdsmap_epoch": 6, 2019-12-05T03:50:22.646 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch": 23, 2019-12-05T03:50:22.646 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch_barrier": 23, 2019-12-05T03:50:22.646 INFO:teuthology.orchestra.run.smithi096.stdout: "uptime": 18.995990958 2019-12-05T03:50:22.646 INFO:teuthology.orchestra.run.smithi096.stdout:} 2019-12-05T03:50:22.650 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "a91186ae-f496-4de1-918d-820c55ff1feb", "whoami": 0, "id": 4241, "want_state": "up:active", "state": "up:active", "rank_uptime": 14.279852746, "mdsmap_epoch": 6, "osdmap_epoch": 23, "osdmap_epoch_barrier": 23, "uptime": 18.995990958 } 2019-12-05T03:50:22.651 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2019-12-05T03:50:22.651 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2019-12-05T03:50:22.651 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.2 at ubuntu@smithi096.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.2... 2019-12-05T03:50:22.651 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:22.651 INFO:teuthology.orchestra.run.smithi096:> mkdir -- /home/ubuntu/cephtest/mnt.2 2019-12-05T03:50:22.660 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:22.660 INFO:teuthology.orchestra.run.smithi096:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2019-12-05T03:50:22.741 DEBUG:teuthology.orchestra.run:got remote process result: 32 2019-12-05T03:50:22.744 INFO:teuthology.orchestra.run.smithi096.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2019-12-05T03:50:22.744 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:22.744 INFO:teuthology.orchestra.run.smithi096:> ls /sys/fs/fuse/connections 2019-12-05T03:50:22.820 INFO:teuthology.orchestra.run.smithi096.stdout:49 2019-12-05T03:50:22.820 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [49] 2019-12-05T03:50:22.820 INFO:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.2 /home/ubuntu/cephtest/mnt.2 2019-12-05T03:50:22.887 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:22.887 INFO:teuthology.orchestra.run.smithi096:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2019-12-05T03:50:22.903 DEBUG:teuthology.orchestra.run:got remote process result: 32 2019-12-05T03:50:22.907 INFO:teuthology.orchestra.run.smithi096.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2019-12-05T03:50:22.907 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:22.907 INFO:teuthology.orchestra.run.smithi096:> ls /sys/fs/fuse/connections 2019-12-05T03:50:22.947 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi096.stderr:2019-12-05T03:50:22.945+0000 7ff21994bf40 -1 init, newargv = 0x564cffd47fa0 newargc=7ceph-fuse[13116]: starting ceph client 2019-12-05T03:50:22.947 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi096.stderr: 2019-12-05T03:50:22.953 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi096.stderr:ceph-fuse[13116]: starting fuse 2019-12-05T03:50:22.979 INFO:teuthology.orchestra.run.smithi096.stdout:49 2019-12-05T03:50:22.979 INFO:teuthology.orchestra.run.smithi096.stdout:50 2019-12-05T03:50:22.979 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49, 50] 2019-12-05T03:50:22.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:22.980 INFO:teuthology.orchestra.run.smithi096:> sudo python2 -c ' 2019-12-05T03:50:22.980 INFO:teuthology.orchestra.run.smithi096:> import glob 2019-12-05T03:50:22.980 INFO:teuthology.orchestra.run.smithi096:> import re 2019-12-05T03:50:22.980 INFO:teuthology.orchestra.run.smithi096:> import os 2019-12-05T03:50:22.980 INFO:teuthology.orchestra.run.smithi096:> import subprocess 2019-12-05T03:50:22.981 INFO:teuthology.orchestra.run.smithi096:> 2019-12-05T03:50:22.981 INFO:teuthology.orchestra.run.smithi096:> def find_socket(client_name): 2019-12-05T03:50:22.981 INFO:teuthology.orchestra.run.smithi096:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2019-12-05T03:50:22.981 INFO:teuthology.orchestra.run.smithi096:> files = glob.glob(asok_path) 2019-12-05T03:50:22.981 INFO:teuthology.orchestra.run.smithi096:> 2019-12-05T03:50:22.981 INFO:teuthology.orchestra.run.smithi096:> # Given a non-glob path, it better be there 2019-12-05T03:50:22.981 INFO:teuthology.orchestra.run.smithi096:> if "*" not in asok_path: 2019-12-05T03:50:22.981 INFO:teuthology.orchestra.run.smithi096:> assert(len(files) == 1) 2019-12-05T03:50:22.982 INFO:teuthology.orchestra.run.smithi096:> return files[0] 2019-12-05T03:50:22.982 INFO:teuthology.orchestra.run.smithi096:> 2019-12-05T03:50:22.982 INFO:teuthology.orchestra.run.smithi096:> for f in files: 2019-12-05T03:50:22.982 INFO:teuthology.orchestra.run.smithi096:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2019-12-05T03:50:22.982 INFO:teuthology.orchestra.run.smithi096:> if os.path.exists("/proc/{0}".format(pid)): 2019-12-05T03:50:22.982 INFO:teuthology.orchestra.run.smithi096:> return f 2019-12-05T03:50:22.982 INFO:teuthology.orchestra.run.smithi096:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2019-12-05T03:50:22.982 INFO:teuthology.orchestra.run.smithi096:> 2019-12-05T03:50:22.983 INFO:teuthology.orchestra.run.smithi096:> print(find_socket("client.2")) 2019-12-05T03:50:22.983 INFO:teuthology.orchestra.run.smithi096:> ' 2019-12-05T03:50:23.085 INFO:teuthology.orchestra.run.smithi096.stdout:/var/run/ceph/ceph-client.2.13116.asok 2019-12-05T03:50:23.086 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.13116.asok 2019-12-05T03:50:23.086 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:23.086 INFO:teuthology.orchestra.run.smithi096:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.13116.asok status 2019-12-05T03:50:23.277 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2019-12-05T03:50:23.277 INFO:teuthology.orchestra.run.smithi096.stdout: "metadata": { 2019-12-05T03:50:23.277 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph_sha1": "c5290805033483ba0cec165c06bde07dae5f19ec", 2019-12-05T03:50:23.278 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph_version": "ceph version 15.0.0-8014-gc529080 (c5290805033483ba0cec165c06bde07dae5f19ec) octopus (dev)", 2019-12-05T03:50:23.278 INFO:teuthology.orchestra.run.smithi096.stdout: "entity_id": "2", 2019-12-05T03:50:23.278 INFO:teuthology.orchestra.run.smithi096.stdout: "hostname": "smithi096", 2019-12-05T03:50:23.278 INFO:teuthology.orchestra.run.smithi096.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2019-12-05T03:50:23.278 INFO:teuthology.orchestra.run.smithi096.stdout: "pid": "13116", 2019-12-05T03:50:23.278 INFO:teuthology.orchestra.run.smithi096.stdout: "root": "/" 2019-12-05T03:50:23.278 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2019-12-05T03:50:23.279 INFO:teuthology.orchestra.run.smithi096.stdout: "dentry_count": 0, 2019-12-05T03:50:23.279 INFO:teuthology.orchestra.run.smithi096.stdout: "dentry_pinned_count": 0, 2019-12-05T03:50:23.279 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 4427, 2019-12-05T03:50:23.279 INFO:teuthology.orchestra.run.smithi096.stdout: "inst": { 2019-12-05T03:50:23.279 INFO:teuthology.orchestra.run.smithi096.stdout: "name": { 2019-12-05T03:50:23.279 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "client", 2019-12-05T03:50:23.279 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 4427 2019-12-05T03:50:23.280 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2019-12-05T03:50:23.280 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": { 2019-12-05T03:50:23.280 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2019-12-05T03:50:23.280 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:0", 2019-12-05T03:50:23.280 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1729145881 2019-12-05T03:50:23.280 INFO:teuthology.orchestra.run.smithi096.stdout: } 2019-12-05T03:50:23.280 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2019-12-05T03:50:23.281 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": { 2019-12-05T03:50:23.281 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2019-12-05T03:50:23.281 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:0", 2019-12-05T03:50:23.281 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1729145881 2019-12-05T03:50:23.281 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2019-12-05T03:50:23.281 INFO:teuthology.orchestra.run.smithi096.stdout: "inst_str": "client.4427 172.21.15.96:0/1729145881", 2019-12-05T03:50:23.281 INFO:teuthology.orchestra.run.smithi096.stdout: "addr_str": "172.21.15.96:0/1729145881", 2019-12-05T03:50:23.282 INFO:teuthology.orchestra.run.smithi096.stdout: "inode_count": 1, 2019-12-05T03:50:23.282 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_epoch": 6, 2019-12-05T03:50:23.282 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_epoch": 23, 2019-12-05T03:50:23.282 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_epoch_barrier": 0, 2019-12-05T03:50:23.282 INFO:teuthology.orchestra.run.smithi096.stdout: "blacklisted": false 2019-12-05T03:50:23.282 INFO:teuthology.orchestra.run.smithi096.stdout:} 2019-12-05T03:50:23.283 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:23.283 INFO:teuthology.orchestra.run.smithi158:> stat --file-system '--printf=%T 2019-12-05T03:50:23.283 INFO:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1 2019-12-05T03:50:23.317 INFO:teuthology.orchestra.run.smithi158.stdout:fuseblk 2019-12-05T03:50:23.318 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2019-12-05T03:50:23.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:23.318 INFO:teuthology.orchestra.run.smithi158:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2019-12-05T03:50:23.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:23.420 INFO:teuthology.orchestra.run.smithi158:> stat --file-system '--printf=%T 2019-12-05T03:50:23.420 INFO:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.0 2019-12-05T03:50:23.462 INFO:teuthology.orchestra.run.smithi158.stdout:fuseblk 2019-12-05T03:50:23.462 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2019-12-05T03:50:23.463 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:23.463 INFO:teuthology.orchestra.run.smithi158:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2019-12-05T03:50:23.564 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:23.564 INFO:teuthology.orchestra.run.smithi096:> stat --file-system '--printf=%T 2019-12-05T03:50:23.565 INFO:teuthology.orchestra.run.smithi096:> ' -- /home/ubuntu/cephtest/mnt.3 2019-12-05T03:50:23.581 INFO:teuthology.orchestra.run.smithi096.stdout:fuseblk 2019-12-05T03:50:23.581 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2019-12-05T03:50:23.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:23.582 INFO:teuthology.orchestra.run.smithi096:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2019-12-05T03:50:23.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:23.666 INFO:teuthology.orchestra.run.smithi096:> stat --file-system '--printf=%T 2019-12-05T03:50:23.666 INFO:teuthology.orchestra.run.smithi096:> ' -- /home/ubuntu/cephtest/mnt.2 2019-12-05T03:50:23.741 INFO:teuthology.orchestra.run.smithi096.stdout:fuseblk 2019-12-05T03:50:23.741 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2019-12-05T03:50:23.742 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:23.742 INFO:teuthology.orchestra.run.smithi096:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2019-12-05T03:50:23.844 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2019-12-05T03:50:23.883 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-05T03:50:23.993 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.976+0000 7efde478c700 1 Processor -- start 2019-12-05T03:50:23.994 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.980+0000 7efde478c700 1 -- start start 2019-12-05T03:50:23.994 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.980+0000 7efde478c700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efddc09a320 0x7efddc05a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:23.995 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.980+0000 7efde478c700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efddc0accb0 con 0x7efddc09cf60 2019-12-05T03:50:23.995 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.980+0000 7efde478c700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efddc0b6980 con 0x7efddc1553b0 2019-12-05T03:50:23.995 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.980+0000 7efde478c700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efddc09a750 con 0x7efddc09a320 2019-12-05T03:50:23.995 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.980+0000 7efde352a700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7efddc1553b0 0x7efddc1557e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49082/0 (socket says 172.21.15.158:49082) 2019-12-05T03:50:23.995 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.980+0000 7efde352a700 1 -- 172.21.15.158:0/1092242018 learned_addr learned my addr 172.21.15.158:0/1092242018 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:23.995 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.980+0000 7efde2528700 1 --2- 172.21.15.158:0/1092242018 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efddc09a320 0x7efddc05a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:23.995 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.980+0000 7efde1d27700 1 -- 172.21.15.158:0/1092242018 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2577720020 0 0) 0x7efddc0b6980 con 0x7efddc1553b0 2019-12-05T03:50:23.996 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.980+0000 7efde1d27700 1 -- 172.21.15.158:0/1092242018 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdc80030b0 con 0x7efddc1553b0 2019-12-05T03:50:23.996 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.980+0000 7efde1d27700 1 -- 172.21.15.158:0/1092242018 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2582729913 0 0) 0x7efddc0accb0 con 0x7efddc09cf60 2019-12-05T03:50:23.996 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.980+0000 7efde1d27700 1 -- 172.21.15.158:0/1092242018 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efddc0b6980 con 0x7efddc09cf60 2019-12-05T03:50:23.996 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.980+0000 7efde1d27700 1 -- 172.21.15.158:0/1092242018 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1621268302 0 0) 0x7efdc80030b0 con 0x7efddc1553b0 2019-12-05T03:50:23.996 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.980+0000 7efde1d27700 1 -- 172.21.15.158:0/1092242018 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efddc09a320 msgr2=0x7efddc05a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:23.996 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.980+0000 7efde1d27700 1 --2- 172.21.15.158:0/1092242018 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efddc09a320 0x7efddc05a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:23.996 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.980+0000 7efde1d27700 1 -- 172.21.15.158:0/1092242018 >> v1:172.21.15.96:6789/0 conn(0x7efddc09cf60 legacy=0x7efddc151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:23.997 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.980+0000 7efde1d27700 1 -- 172.21.15.158:0/1092242018 --> v1:172.21.15.158:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efddc155fe0 con 0x7efddc1553b0 2019-12-05T03:50:23.997 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.980+0000 7efde1d27700 1 -- 172.21.15.158:0/1092242018 <== mon.1 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 828730332 0 0) 0x7efdd4001ad0 con 0x7efddc1553b0 2019-12-05T03:50:23.997 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.980+0000 7efde1d27700 1 -- 172.21.15.158:0/1092242018 >> v1:172.21.15.158:6789/0 conn(0x7efddc1553b0 legacy=0x7efddc1557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:23.997 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.980+0000 7efde1d27700 1 --2- 172.21.15.158:0/1092242018 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efdc8003940 0x7efdc8003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:23.997 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.980+0000 7efde1d27700 1 --2- 172.21.15.158:0/1092242018 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efdc8004420 0x7efdc8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:23.997 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.980+0000 7efde2528700 1 --2- 172.21.15.158:0/1092242018 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efdc8004420 0x7efdc8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:23.997 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.980+0000 7efde1d27700 1 --2- 172.21.15.158:0/1092242018 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdc8004e40 0x7efdc804f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:23.998 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.980+0000 7efde1d27700 1 -- 172.21.15.158:0/1092242018 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efddc09a750 con 0x7efdc8004e40 2019-12-05T03:50:23.998 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.980+0000 7efde1d27700 1 -- 172.21.15.158:0/1092242018 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc804fc90 con 0x7efdc8004420 2019-12-05T03:50:23.998 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.980+0000 7efde1d27700 1 -- 172.21.15.158:0/1092242018 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc804fed0 con 0x7efdc8003940 2019-12-05T03:50:23.998 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.980+0000 7efde2d29700 1 --2- 172.21.15.158:0/1092242018 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efdc8003940 0x7efdc8003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:23.998 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.984+0000 7efde352a700 1 --2- 172.21.15.158:0/1092242018 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdc8004e40 0x7efdc804f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:23.998 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.984+0000 7efde2528700 1 -- 172.21.15.158:0/1092242018 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efdc8003940 msgr2=0x7efdc8003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:23.998 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.984+0000 7efde2528700 1 --2- 172.21.15.158:0/1092242018 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efdc8003940 0x7efdc8003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:23.999 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.984+0000 7efde2528700 1 -- 172.21.15.158:0/1092242018 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdc8004e40 msgr2=0x7efdc804f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:23.999 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.984+0000 7efde2528700 1 --2- 172.21.15.158:0/1092242018 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdc8004e40 0x7efdc804f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:23.999 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.984+0000 7efde2528700 1 -- 172.21.15.158:0/1092242018 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc80501d0 con 0x7efdc8004420 2019-12-05T03:50:23.999 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.984+0000 7efde352a700 1 --2- 172.21.15.158:0/1092242018 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efdc8004e40 0x7efdc804f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-12-05T03:50:23.999 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.984+0000 7efde2528700 1 --2- 172.21.15.158:0/1092242018 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efdc8004420 0x7efdc8004850 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7efdd8007580 tx=0x7efdd8010000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:23.999 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.984+0000 7efde2528700 1 --2- 172.21.15.158:0/1092242018 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efdc8004420 0x7efdc8004850 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7efdd8007580 tx=0x7efdd8010000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:23.999 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.984+0000 7efde2528700 1 --2- 172.21.15.158:0/1092242018 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efdc8004420 0x7efdc8004850 secure :-1 s=READY pgs=229 cs=0 l=1 rx=0x7efdd8007580 tx=0x7efdd8010000).ready entity=mon.1 client_cookie=3feb2c54d1ab146f server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:24.000 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.984+0000 7efde2528700 1 --2- 172.21.15.158:0/1092242018 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efdc8004420 0x7efdc8004850 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7efdd8007580 tx=0x7efdd8010000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.000 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.984+0000 7efde2528700 1 --2- 172.21.15.158:0/1092242018 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efdc8004420 0x7efdc8004850 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7efdd8007580 tx=0x7efdd8010000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.000 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.984+0000 7efde1d27700 1 -- 172.21.15.158:0/1092242018 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdd8010cf0 con 0x7efdc8004420 2019-12-05T03:50:24.000 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.984+0000 7efde2528700 1 --2- 172.21.15.158:0/1092242018 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efdc8004420 0x7efdc8004850 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7efdd8007580 tx=0x7efdd8010000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.000 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.984+0000 7efde1d27700 1 -- 172.21.15.158:0/1092242018 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd8010910 con 0x7efdc8004420 2019-12-05T03:50:24.000 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.984+0000 7efde1d27700 1 -- 172.21.15.158:0/1092242018 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdd8008bb0 con 0x7efdc8004420 2019-12-05T03:50:24.001 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.984+0000 7efde478c700 1 -- 172.21.15.158:0/1092242018 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efdc8004420 msgr2=0x7efdc8004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:24.001 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.984+0000 7efde478c700 1 --2- 172.21.15.158:0/1092242018 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efdc8004420 0x7efdc8004850 secure :-1 s=READY pgs=229 cs=0 l=1 rx=0x7efdd8007580 tx=0x7efdd8010000).stop 2019-12-05T03:50:24.001 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.984+0000 7efde352a700 1 -- 172.21.15.158:0/1092242018 reap_dead start 2019-12-05T03:50:24.001 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.984+0000 7efde478c700 1 -- 172.21.15.158:0/1092242018 shutdown_connections 2019-12-05T03:50:24.001 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.984+0000 7efde478c700 1 -- 172.21.15.158:0/1092242018 shutdown_connections 2019-12-05T03:50:24.001 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.984+0000 7efde478c700 1 -- 172.21.15.158:0/1092242018 wait complete. 2019-12-05T03:50:24.001 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.984+0000 7efde478c700 1 -- 172.21.15.158:0/1092242018 >> 172.21.15.158:0/1092242018 conn(0x7efddc0b7e60 msgr2=0x7efddc0b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:24.005 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.988+0000 7efde478c700 1 Processor -- start 2019-12-05T03:50:24.005 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.988+0000 7efde478c700 1 -- start start 2019-12-05T03:50:24.005 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.988+0000 7efde478c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7efddc151680 0x7efddc0b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:24.005 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.988+0000 7efde478c700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efddc13fb80 0x7efddc152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:24.005 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.988+0000 7efde478c700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efddc13ffb0 con 0x7efddc152690 2019-12-05T03:50:24.006 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.988+0000 7efde478c700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efddc1538d0 con 0x7efddc151680 2019-12-05T03:50:24.006 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.988+0000 7efde478c700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efddc153b70 con 0x7efddc13fb80 2019-12-05T03:50:24.006 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.988+0000 7efde2d29700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7efddc151680 0x7efddc0b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:24.006 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.988+0000 7efde2d29700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7efddc151680 0x7efddc0b0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54310/0 (socket says 172.21.15.158:54310) 2019-12-05T03:50:24.006 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.988+0000 7efde2d29700 1 -- 172.21.15.158:0/842267459 learned_addr learned my addr 172.21.15.158:0/842267459 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:24.006 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.988+0000 7efde2528700 1 --2- 172.21.15.158:0/842267459 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efddc13fb80 0x7efddc152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:24.006 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.988+0000 7efde2d29700 1 -- 172.21.15.158:0/842267459 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efddc13fb80 msgr2=0x7efddc152140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:24.007 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.988+0000 7efde2d29700 1 --2- 172.21.15.158:0/842267459 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efddc13fb80 0x7efddc152140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:24.007 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.988+0000 7efde2d29700 1 -- 172.21.15.158:0/842267459 >> v1:172.21.15.96:6789/0 conn(0x7efddc152690 legacy=0x7efddc0b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:24.007 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.988+0000 7efde2d29700 1 -- 172.21.15.158:0/842267459 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efddc152d20 con 0x7efddc151680 2019-12-05T03:50:24.007 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.992+0000 7efde2d29700 1 --2- 172.21.15.158:0/842267459 >> v2:172.21.15.158:3300/0 conn(0x7efddc151680 0x7efddc0b0ad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7efddc153a90 tx=0x7efdd0010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.007 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.992+0000 7efde2d29700 1 --2- 172.21.15.158:0/842267459 >> v2:172.21.15.158:3300/0 conn(0x7efddc151680 0x7efddc0b0ad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7efddc153a90 tx=0x7efdd0010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.007 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.992+0000 7efde2d29700 1 --2- 172.21.15.158:0/842267459 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efddc151680 0x7efddc0b0ad0 secure :-1 s=READY pgs=230 cs=0 l=1 rx=0x7efddc153a90 tx=0x7efdd0010c30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:24.007 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.992+0000 7efde2d29700 1 --2- 172.21.15.158:0/842267459 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efddc151680 0x7efddc0b0ad0 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7efddc153a90 tx=0x7efdd0010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.008 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.992+0000 7efdcf7fe700 1 -- 172.21.15.158:0/842267459 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdd000cb60 con 0x7efddc151680 2019-12-05T03:50:24.008 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.992+0000 7efde2d29700 1 --2- 172.21.15.158:0/842267459 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efddc151680 0x7efddc0b0ad0 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7efddc153a90 tx=0x7efdd0010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.008 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.992+0000 7efde2d29700 1 --2- 172.21.15.158:0/842267459 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efddc151680 0x7efddc0b0ad0 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7efddc153a90 tx=0x7efdd0010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.008 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.992+0000 7efdcf7fe700 1 -- 172.21.15.158:0/842267459 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd000c780 con 0x7efddc151680 2019-12-05T03:50:24.008 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.992+0000 7efde478c700 1 -- 172.21.15.158:0/842267459 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efddc0b25a0 con 0x7efddc151680 2019-12-05T03:50:24.008 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.992+0000 7efdcf7fe700 1 -- 172.21.15.158:0/842267459 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdd0012460 con 0x7efddc151680 2019-12-05T03:50:24.008 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.992+0000 7efde478c700 1 -- 172.21.15.158:0/842267459 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efddc0b2b50 con 0x7efddc151680 2019-12-05T03:50:24.009 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.992+0000 7efde2d29700 1 --2- 172.21.15.158:0/842267459 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efddc151680 0x7efddc0b0ad0 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7efddc153a90 tx=0x7efdd0010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.009 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.992+0000 7efdcf7fe700 1 -- 172.21.15.158:0/842267459 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7efdd0012770 con 0x7efddc151680 2019-12-05T03:50:24.009 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.992+0000 7efde2d29700 1 --2- 172.21.15.158:0/842267459 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efddc151680 0x7efddc0b0ad0 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7efddc153a90 tx=0x7efdd0010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.009 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.992+0000 7efdcf7fe700 1 --2- 172.21.15.158:0/842267459 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7efdc403ace0 0x7efdc403d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:24.009 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.992+0000 7efdcf7fe700 1 -- 172.21.15.158:0/842267459 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7efdd004b700 con 0x7efddc151680 2019-12-05T03:50:24.009 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.992+0000 7efde2528700 1 --2- 172.21.15.158:0/842267459 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7efdc403ace0 0x7efdc403d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:24.009 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.992+0000 7efde478c700 1 -- 172.21.15.158:0/842267459 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efddc130690 con 0x7efddc151680 2019-12-05T03:50:24.010 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:23.992+0000 7efde2528700 1 --2- 172.21.15.158:0/842267459 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7efdc403ace0 0x7efdc403d1f0 crc :-1 s=READY pgs=109 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:24.010 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.000+0000 7efde2d29700 1 --2- 172.21.15.158:0/842267459 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efddc151680 0x7efddc0b0ad0 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7efddc153a90 tx=0x7efdd0010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.010 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.000+0000 7efdcf7fe700 1 -- 172.21.15.158:0/842267459 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7efdd0032780 con 0x7efddc151680 2019-12-05T03:50:24.175 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.168+0000 7efde478c700 1 -- 172.21.15.158:0/842267459 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efddc0554e0 con 0x7efddc151680 2019-12-05T03:50:24.176 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.168+0000 7efde2d29700 1 --2- 172.21.15.158:0/842267459 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efddc151680 0x7efddc0b0ad0 secure :-1 s=THROTTLE_DONE pgs=230 cs=0 l=1 rx=0x7efddc153a90 tx=0x7efdd0010c30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.176 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.168+0000 7efdcf7fe700 1 -- 172.21.15.158:0/842267459 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+14933 (secure 0 0 0) 0x7efdd00329e0 con 0x7efddc151680 2019-12-05T03:50:24.178 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:24.179 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":23,"fsid":"a91186ae-f496-4de1-918d-820c55ff1feb","created":"2019-12-05T03:49:39.187523+0000","modified":"2019-12-05T03:50:01.249305+0000","last_up_change":"2019-12-05T03:49:48.551934+0000","last_in_change":"2019-12-05T03:49:48.551934+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-05T03:49:52.900870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-12-05T03:49:55.801462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-12-05T03:49:58.659250+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"782c4258-e28c-4a11-9d54-3c9c7a36fba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":12192},{"type":"v1","addr":"172.21.15.158:6801","nonce":12192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":12192},{"type":"v1","addr":"172.21.15.158:6803","nonce":12192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":12192},{"type":"v1","addr":"172.21.15.158:6807","nonce":12192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":12192},{"type":"v1","addr":"172.21.15.158:6805","nonce":12192}]},"public_addr":"172.21.15.158:6801/12192","cluster_addr":"172.21.15.158:6803/12192","heartbeat_back_addr":"172.21.15.158:6807/12192","heartbeat_front_addr":"172.21.15.158:6805/12192","state":["exists","up"]},{"osd":1,"uuid":"d4426b21-b666-4158-bf34-a24b14572731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":12193},{"type":"v1","addr":"172.21.15.158:6809","nonce":12193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":12193},{"type":"v1","addr":"172.21.15.158:6811","nonce":12193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":12193},{"type":"v1","addr":"172.21.15.158:6815","nonce":12193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":12193},{"type":"v1","addr":"172.21.15.158:6813","nonce":12193}]},"public_addr":"172.21.15.158:6809/12193","cluster_addr":"172.21.15.158:6811/12193","heartbeat_back_addr":"172.21.15.158:6815/12193","heartbeat_front_addr":"172.21.15.158:6813/12193","state":["exists","up"]},{"osd":2,"uuid":"22680edd-6490-4ab0-bb15-0605830e4cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":12195},{"type":"v1","addr":"172.21.15.158:6825","nonce":12195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":12195},{"type":"v1","addr":"172.21.15.158:6827","nonce":12195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":12195},{"type":"v1","addr":"172.21.15.158:6831","nonce":12195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":12195},{"type":"v1","addr":"172.21.15.158:6829","nonce":12195}]},"public_addr":"172.21.15.158:6825/12195","cluster_addr":"172.21.15.158:6827/12195","heartbeat_back_addr":"172.21.15.158:6831/12195","heartbeat_front_addr":"172.21.15.158:6829/12195","state":["exists","up"]},{"osd":3,"uuid":"7ec999ee-ace8-4ccb-a4f9-6f5d313bbbd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":12194},{"type":"v1","addr":"172.21.15.158:6817","nonce":12194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":12194},{"type":"v1","addr":"172.21.15.158:6819","nonce":12194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":12194},{"type":"v1","addr":"172.21.15.158:6823","nonce":12194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":12194},{"type":"v1","addr":"172.21.15.158:6821","nonce":12194}]},"public_addr":"172.21.15.158:6817/12194","cluster_addr":"172.21.15.158:6819/12194","heartbeat_back_addr":"172.21.15.158:6823/12194","heartbeat_front_addr":"172.21.15.158:6821/12194","state":["exists","up"]},{"osd":4,"uuid":"186e69c4-b69f-4dd1-bb8f-faf759c60484","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":12460},{"type":"v1","addr":"172.21.15.96:6803","nonce":12460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":12460},{"type":"v1","addr":"172.21.15.96:6805","nonce":12460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":12460},{"type":"v1","addr":"172.21.15.96:6809","nonce":12460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":12460},{"type":"v1","addr":"172.21.15.96:6807","nonce":12460}]},"public_addr":"172.21.15.96:6803/12460","cluster_addr":"172.21.15.96:6805/12460","heartbeat_back_addr":"172.21.15.96:6809/12460","heartbeat_front_addr":"172.21.15.96:6807/12460","state":["exists","up"]},{"osd":5,"uuid":"86b658b2-8b40-4cea-8163-305a3982758b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":12461},{"type":"v1","addr":"172.21.15.96:6811","nonce":12461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":12461},{"type":"v1","addr":"172.21.15.96:6813","nonce":12461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":12461},{"type":"v1","addr":"172.21.15.96:6817","nonce":12461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":12461},{"type":"v1","addr":"172.21.15.96:6815","nonce":12461}]},"public_addr":"172.21.15.96:6811/12461","cluster_addr":"172.21.15.96:6813/12461","heartbeat_back_addr":"172.21.15.96:6817/12461","heartbeat_front_addr":"172.21.15.96:6815/12461","state":["exists","up"]},{"osd":6,"uuid":"bdadaea8-9296-4788-bc59-d9c9eb8defdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":12463},{"type":"v1","addr":"172.21.15.96:6827","nonce":12463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":12463},{"type":"v1","addr":"172.21.15.96:6829","nonce":12463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":12463},{"type":"v1","addr":"172.21.15.96:6833","nonce":12463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":12463},{"type":"v1","addr":"172.21.15.96:6831","nonce":12463}]},"public_addr":"172.21.15.96:6827/12463","cluster_addr":"172.21.15.96:6829/12463","heartbeat_back_addr":"172.21.15.96:6833/12463","heartbeat_front_addr":"172.21.15.96:6831/12463","state":["exists","up"]},{"osd":7,"uuid":"c6d71846-d68e-430f-ab72-0fb8ea4bf640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":12462},{"type":"v1","addr":"172.21.15.96:6819","nonce":12462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":12462},{"type":"v1","addr":"172.21.15.96:6821","nonce":12462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":12462},{"type":"v1","addr":"172.21.15.96:6825","nonce":12462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":12462},{"type":"v1","addr":"172.21.15.96:6823","nonce":12462}]},"public_addr":"172.21.15.96:6819/12462","cluster_addr":"172.21.15.96:6821/12462","heartbeat_back_addr":"172.21.15.96:6825/12462","heartbeat_front_addr":"172.21.15.96:6823/12462","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.875762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.900817+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.210347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.133973+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.864697+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.131015+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.237225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.154377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-05T03:50:24.181 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.172+0000 7efde478c700 1 -- 172.21.15.158:0/842267459 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7efdc403ace0 msgr2=0x7efdc403d1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:24.181 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.172+0000 7efde478c700 1 --2- 172.21.15.158:0/842267459 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7efdc403ace0 0x7efdc403d1f0 crc :-1 s=READY pgs=109 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:24.181 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.172+0000 7efde478c700 1 -- 172.21.15.158:0/842267459 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efddc151680 msgr2=0x7efddc0b0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:24.181 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.172+0000 7efde478c700 1 --2- 172.21.15.158:0/842267459 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efddc151680 0x7efddc0b0ad0 secure :-1 s=READY pgs=230 cs=0 l=1 rx=0x7efddc153a90 tx=0x7efdd0010c30).stop 2019-12-05T03:50:24.182 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.172+0000 7efde478c700 1 -- 172.21.15.158:0/842267459 shutdown_connections 2019-12-05T03:50:24.182 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.172+0000 7efde478c700 1 --2- 172.21.15.158:0/842267459 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7efdc403ace0 0x7efdc403d1f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:24.182 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.172+0000 7efde478c700 1 --2- 172.21.15.158:0/842267459 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7efddc151680 0x7efddc0b0ad0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:24.182 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.172+0000 7efde478c700 1 --2- 172.21.15.158:0/842267459 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7efddc13fb80 0x7efddc152140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:24.182 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.172+0000 7efde478c700 1 -- 172.21.15.158:0/842267459 shutdown_connections 2019-12-05T03:50:24.182 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.172+0000 7efde478c700 1 -- 172.21.15.158:0/842267459 wait complete. 2019-12-05T03:50:24.182 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.172+0000 7efde478c700 1 -- 172.21.15.158:0/842267459 >> 172.21.15.158:0/842267459 conn(0x7efddc0b49c0 msgr2=0x7efddc0b5670 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:24.195 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:49:52.900870+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:49:55.801462+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:49:58.659250+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-12-05T03:50:24.196 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-12-05T03:50:24.297 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.284+0000 7fd23fd0c700 1 Processor -- start 2019-12-05T03:50:24.297 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.284+0000 7fd23fd0c700 1 -- start start 2019-12-05T03:50:24.298 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.284+0000 7fd23fd0c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd2380b6970 0x7fd23809add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:24.298 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.284+0000 7fd23fd0c700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd23809ba40 0x7fd23805a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:24.298 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.284+0000 7fd23fd0c700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd23805a950 0x7fd238155290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:24.298 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.288+0000 7fd23fd0c700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23809d210 con 0x7fd23805a950 2019-12-05T03:50:24.298 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.288+0000 7fd23fd0c700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd238099b90 con 0x7fd2380b6970 2019-12-05T03:50:24.298 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.288+0000 7fd23fd0c700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd238099e30 con 0x7fd23809ba40 2019-12-05T03:50:24.299 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.288+0000 7fd23e2a9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd2380b6970 0x7fd23809add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:24.299 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.288+0000 7fd23e2a9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd2380b6970 0x7fd23809add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54320/0 (socket says 172.21.15.158:54320) 2019-12-05T03:50:24.299 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.288+0000 7fd23e2a9700 1 -- 172.21.15.158:0/3128947842 learned_addr learned my addr 172.21.15.158:0/3128947842 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:24.299 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.288+0000 7fd23eaaa700 1 --2- 172.21.15.158:0/3128947842 >> v2:172.21.15.96:3300/0 conn(0x7fd23805a950 0x7fd238155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:24.299 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.288+0000 7fd23daa8700 1 --2- 172.21.15.158:0/3128947842 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd23809ba40 0x7fd23805a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:24.299 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.288+0000 7fd23e2a9700 1 -- 172.21.15.158:0/3128947842 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd23809ba40 msgr2=0x7fd23805a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:24.299 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.288+0000 7fd23e2a9700 1 --2- 172.21.15.158:0/3128947842 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd23809ba40 0x7fd23805a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:24.300 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.288+0000 7fd23e2a9700 1 -- 172.21.15.158:0/3128947842 >> v2:172.21.15.96:3300/0 conn(0x7fd23805a950 msgr2=0x7fd238155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:24.300 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.288+0000 7fd23e2a9700 1 --2- 172.21.15.158:0/3128947842 >> v2:172.21.15.96:3300/0 conn(0x7fd23805a950 0x7fd238155290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:24.300 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.288+0000 7fd23e2a9700 1 -- 172.21.15.158:0/3128947842 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23807e960 con 0x7fd2380b6970 2019-12-05T03:50:24.300 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.288+0000 7fd23e2a9700 1 --2- 172.21.15.158:0/3128947842 >> v2:172.21.15.158:3300/0 conn(0x7fd2380b6970 0x7fd23809add0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd234002f30 tx=0x7fd23400fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.300 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.288+0000 7fd23e2a9700 1 --2- 172.21.15.158:0/3128947842 >> v2:172.21.15.158:3300/0 conn(0x7fd2380b6970 0x7fd23809add0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd234002f30 tx=0x7fd23400fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.300 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.288+0000 7fd23e2a9700 1 --2- 172.21.15.158:0/3128947842 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2380b6970 0x7fd23809add0 secure :-1 s=READY pgs=231 cs=0 l=1 rx=0x7fd234002f30 tx=0x7fd23400fdb0).ready entity=mon.1 client_cookie=4b897517aca8335f server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:24.301 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.288+0000 7fd23e2a9700 1 --2- 172.21.15.158:0/3128947842 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2380b6970 0x7fd23809add0 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7fd234002f30 tx=0x7fd23400fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.301 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.288+0000 7fd23e2a9700 1 --2- 172.21.15.158:0/3128947842 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2380b6970 0x7fd23809add0 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7fd234002f30 tx=0x7fd23400fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.301 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.288+0000 7fd23d2a7700 1 -- 172.21.15.158:0/3128947842 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd234008c90 con 0x7fd2380b6970 2019-12-05T03:50:24.301 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.288+0000 7fd23e2a9700 1 --2- 172.21.15.158:0/3128947842 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2380b6970 0x7fd23809add0 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7fd234002f30 tx=0x7fd23400fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.301 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.288+0000 7fd23d2a7700 1 -- 172.21.15.158:0/3128947842 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2340088b0 con 0x7fd2380b6970 2019-12-05T03:50:24.301 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.288+0000 7fd23d2a7700 1 -- 172.21.15.158:0/3128947842 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd234011b50 con 0x7fd2380b6970 2019-12-05T03:50:24.301 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.288+0000 7fd23fd0c700 1 -- 172.21.15.158:0/3128947842 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2380b6970 msgr2=0x7fd23809add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:24.302 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.288+0000 7fd23fd0c700 1 --2- 172.21.15.158:0/3128947842 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2380b6970 0x7fd23809add0 secure :-1 s=READY pgs=231 cs=0 l=1 rx=0x7fd234002f30 tx=0x7fd23400fdb0).stop 2019-12-05T03:50:24.302 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.288+0000 7fd23fd0c700 1 -- 172.21.15.158:0/3128947842 shutdown_connections 2019-12-05T03:50:24.302 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.288+0000 7fd23fd0c700 1 --2- 172.21.15.158:0/3128947842 >> v2:172.21.15.96:3300/0 conn(0x7fd23805a950 0x7fd238155290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:24.302 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.288+0000 7fd23fd0c700 1 --2- 172.21.15.158:0/3128947842 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2380b6970 0x7fd23809add0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:24.302 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.288+0000 7fd23fd0c700 1 --2- 172.21.15.158:0/3128947842 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd23809ba40 0x7fd23805a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:24.302 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.288+0000 7fd23fd0c700 1 -- 172.21.15.158:0/3128947842 shutdown_connections 2019-12-05T03:50:24.303 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.288+0000 7fd23fd0c700 1 -- 172.21.15.158:0/3128947842 wait complete. 2019-12-05T03:50:24.303 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.288+0000 7fd23fd0c700 1 -- 172.21.15.158:0/3128947842 >> 172.21.15.158:0/3128947842 conn(0x7fd2380b7ef0 msgr2=0x7fd2380b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:24.306 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.292+0000 7fd23fd0c700 1 Processor -- start 2019-12-05T03:50:24.306 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.292+0000 7fd23fd0c700 1 -- start start 2019-12-05T03:50:24.306 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.292+0000 7fd23fd0c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd2380b15e0 0x7fd23807d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:24.306 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.292+0000 7fd23fd0c700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd2380ad5a0 0x7fd2380b2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:24.306 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.292+0000 7fd23fd0c700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2381541f0 con 0x7fd2380b2ca0 2019-12-05T03:50:24.306 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.292+0000 7fd23fd0c700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd238154570 con 0x7fd2380ad5a0 2019-12-05T03:50:24.307 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.292+0000 7fd23fd0c700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2380ace60 con 0x7fd2380b15e0 2019-12-05T03:50:24.307 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.292+0000 7fd23e2a9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd2380b15e0 0x7fd23807d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:24.307 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.292+0000 7fd23e2a9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd2380b15e0 0x7fd23807d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54328/0 (socket says 172.21.15.158:54328) 2019-12-05T03:50:24.307 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.292+0000 7fd23e2a9700 1 -- 172.21.15.158:0/4239573770 learned_addr learned my addr 172.21.15.158:0/4239573770 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:24.307 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.292+0000 7fd23daa8700 1 --2- 172.21.15.158:0/4239573770 >> v2:172.21.15.96:3300/0 conn(0x7fd2380ad5a0 0x7fd2380b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:24.307 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.292+0000 7fd23e2a9700 1 -- 172.21.15.158:0/4239573770 >> v2:172.21.15.96:3300/0 conn(0x7fd2380ad5a0 msgr2=0x7fd2380b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:24.307 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.292+0000 7fd23e2a9700 1 --2- 172.21.15.158:0/4239573770 >> v2:172.21.15.96:3300/0 conn(0x7fd2380ad5a0 0x7fd2380b2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:24.308 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.292+0000 7fd23e2a9700 1 -- 172.21.15.158:0/4239573770 >> v1:172.21.15.96:6789/0 conn(0x7fd2380b2ca0 legacy=0x7fd2380aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:24.308 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.292+0000 7fd23e2a9700 1 -- 172.21.15.158:0/4239573770 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2380af980 con 0x7fd2380b15e0 2019-12-05T03:50:24.308 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.292+0000 7fd23e2a9700 1 --2- 172.21.15.158:0/4239573770 >> v2:172.21.15.158:3300/0 conn(0x7fd2380b15e0 0x7fd23807d690 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd238132180 tx=0x7fd234008b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.308 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.296+0000 7fd23e2a9700 1 --2- 172.21.15.158:0/4239573770 >> v2:172.21.15.158:3300/0 conn(0x7fd2380b15e0 0x7fd23807d690 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd238132180 tx=0x7fd234008b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.308 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.296+0000 7fd23e2a9700 1 --2- 172.21.15.158:0/4239573770 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2380b15e0 0x7fd23807d690 secure :-1 s=READY pgs=232 cs=0 l=1 rx=0x7fd238132180 tx=0x7fd234008b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:24.308 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.296+0000 7fd23e2a9700 1 --2- 172.21.15.158:0/4239573770 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2380b15e0 0x7fd23807d690 secure :-1 s=THROTTLE_DONE pgs=232 cs=0 l=1 rx=0x7fd238132180 tx=0x7fd234008b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.308 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.296+0000 7fd23e2a9700 1 --2- 172.21.15.158:0/4239573770 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2380b15e0 0x7fd23807d690 secure :-1 s=THROTTLE_DONE pgs=232 cs=0 l=1 rx=0x7fd238132180 tx=0x7fd234008b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.309 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.296+0000 7fd23e2a9700 1 --2- 172.21.15.158:0/4239573770 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2380b15e0 0x7fd23807d690 secure :-1 s=THROTTLE_DONE pgs=232 cs=0 l=1 rx=0x7fd238132180 tx=0x7fd234008b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.309 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.296+0000 7fd22effd700 1 -- 172.21.15.158:0/4239573770 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd23400f280 con 0x7fd2380b15e0 2019-12-05T03:50:24.309 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.296+0000 7fd22effd700 1 -- 172.21.15.158:0/4239573770 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd234011770 con 0x7fd2380b15e0 2019-12-05T03:50:24.309 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.296+0000 7fd23fd0c700 1 -- 172.21.15.158:0/4239573770 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2380ad100 con 0x7fd2380b15e0 2019-12-05T03:50:24.309 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.296+0000 7fd22effd700 1 -- 172.21.15.158:0/4239573770 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd234005540 con 0x7fd2380b15e0 2019-12-05T03:50:24.309 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.296+0000 7fd23fd0c700 1 -- 172.21.15.158:0/4239573770 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2380b08b0 con 0x7fd2380b15e0 2019-12-05T03:50:24.309 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.296+0000 7fd23e2a9700 1 --2- 172.21.15.158:0/4239573770 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2380b15e0 0x7fd23807d690 secure :-1 s=THROTTLE_DONE pgs=232 cs=0 l=1 rx=0x7fd238132180 tx=0x7fd234008b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.310 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.296+0000 7fd22effd700 1 -- 172.21.15.158:0/4239573770 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fd234005850 con 0x7fd2380b15e0 2019-12-05T03:50:24.310 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.296+0000 7fd23e2a9700 1 --2- 172.21.15.158:0/4239573770 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2380b15e0 0x7fd23807d690 secure :-1 s=THROTTLE_DONE pgs=232 cs=0 l=1 rx=0x7fd238132180 tx=0x7fd234008b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.310 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.296+0000 7fd22effd700 1 --2- 172.21.15.158:0/4239573770 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd22003ad40 0x7fd22003d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:24.310 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.296+0000 7fd22effd700 1 -- 172.21.15.158:0/4239573770 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fd23408f370 con 0x7fd2380b15e0 2019-12-05T03:50:24.310 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.296+0000 7fd23daa8700 1 --2- 172.21.15.158:0/4239573770 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd22003ad40 0x7fd22003d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:24.310 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.296+0000 7fd23daa8700 1 --2- 172.21.15.158:0/4239573770 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd22003ad40 0x7fd22003d250 crc :-1 s=READY pgs=110 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:24.311 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.300+0000 7fd23fd0c700 1 -- 172.21.15.158:0/4239573770 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2380554e0 con 0x7fd2380b15e0 2019-12-05T03:50:24.311 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.304+0000 7fd23e2a9700 1 --2- 172.21.15.158:0/4239573770 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2380b15e0 0x7fd23807d690 secure :-1 s=THROTTLE_DONE pgs=232 cs=0 l=1 rx=0x7fd238132180 tx=0x7fd234008b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.311 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.304+0000 7fd22effd700 1 -- 172.21.15.158:0/4239573770 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fd234077200 con 0x7fd2380b15e0 2019-12-05T03:50:24.478 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.472+0000 7fd23fd0c700 1 -- 172.21.15.158:0/4239573770 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fd2380b4a30 con 0x7fd2380b15e0 2019-12-05T03:50:24.479 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.472+0000 7fd23e2a9700 1 --2- 172.21.15.158:0/4239573770 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2380b15e0 0x7fd23807d690 secure :-1 s=THROTTLE_DONE pgs=232 cs=0 l=1 rx=0x7fd238132180 tx=0x7fd234008b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.479 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.472+0000 7fd22effd700 1 -- 172.21.15.158:0/4239573770 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd234005b60 con 0x7fd2380b15e0 2019-12-05T03:50:24.479 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:50:24.482 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.472+0000 7fd23fd0c700 1 -- 172.21.15.158:0/4239573770 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd22003ad40 msgr2=0x7fd22003d250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:24.482 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.472+0000 7fd23fd0c700 1 --2- 172.21.15.158:0/4239573770 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd22003ad40 0x7fd22003d250 crc :-1 s=READY pgs=110 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:24.482 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.472+0000 7fd23fd0c700 1 -- 172.21.15.158:0/4239573770 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2380b15e0 msgr2=0x7fd23807d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:24.482 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.472+0000 7fd23fd0c700 1 --2- 172.21.15.158:0/4239573770 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2380b15e0 0x7fd23807d690 secure :-1 s=READY pgs=232 cs=0 l=1 rx=0x7fd238132180 tx=0x7fd234008b90).stop 2019-12-05T03:50:24.482 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.472+0000 7fd23fd0c700 1 -- 172.21.15.158:0/4239573770 shutdown_connections 2019-12-05T03:50:24.483 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.472+0000 7fd23fd0c700 1 --2- 172.21.15.158:0/4239573770 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd22003ad40 0x7fd22003d250 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:24.483 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.472+0000 7fd23fd0c700 1 --2- 172.21.15.158:0/4239573770 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2380b15e0 0x7fd23807d690 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:24.483 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.472+0000 7fd23fd0c700 1 --2- 172.21.15.158:0/4239573770 >> v2:172.21.15.96:3300/0 conn(0x7fd2380ad5a0 0x7fd2380b2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:24.483 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.476+0000 7fd23fd0c700 1 -- 172.21.15.158:0/4239573770 shutdown_connections 2019-12-05T03:50:24.483 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.476+0000 7fd23fd0c700 1 -- 172.21.15.158:0/4239573770 wait complete. 2019-12-05T03:50:24.484 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.476+0000 7fd23fd0c700 1 -- 172.21.15.158:0/4239573770 >> 172.21.15.158:0/4239573770 conn(0x7fd2380b5ea0 msgr2=0x7fd23812f850 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:24.491 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-12-05T03:50:24.602 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.584+0000 7f44b2eb0700 1 Processor -- start 2019-12-05T03:50:24.603 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.584+0000 7f44b2eb0700 1 -- start start 2019-12-05T03:50:24.603 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.588+0000 7f44b2eb0700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f44ac09ba40 0x7f44ac09add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:24.603 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.588+0000 7f44b2eb0700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f44ac0b5370 0x7f44ac0b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:24.603 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.588+0000 7f44b2eb0700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44ac099e30 con 0x7f44ac0b6970 2019-12-05T03:50:24.603 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.588+0000 7f44b2eb0700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44ac09d210 con 0x7f44ac0b5370 2019-12-05T03:50:24.603 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.588+0000 7f44b2eb0700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac099b90 con 0x7f44ac09ba40 2019-12-05T03:50:24.603 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.588+0000 7f44b1c4e700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f44ac0b5370 0x7f44ac0b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:24.604 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.588+0000 7f44b1c4e700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f44ac0b5370 0x7f44ac0b57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.158:40924/0 (socket says 172.21.15.158:40924) 2019-12-05T03:50:24.604 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.588+0000 7f44b1c4e700 1 -- 172.21.15.158:0/355601213 learned_addr learned my addr 172.21.15.158:0/355601213 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:24.604 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.588+0000 7f44b0c4c700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f44ac09ba40 0x7f44ac09add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:24.604 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.588+0000 7f44b1c4e700 1 -- 172.21.15.158:0/355601213 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f44ac09ba40 msgr2=0x7f44ac09add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:24.604 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.588+0000 7f44b1c4e700 1 --2- 172.21.15.158:0/355601213 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f44ac09ba40 0x7f44ac09add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:24.604 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.588+0000 7f44b1c4e700 1 -- 172.21.15.158:0/355601213 >> v1:172.21.15.96:6789/0 conn(0x7f44ac0b6970 legacy=0x7f44ac05a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:24.604 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.588+0000 7f44b1c4e700 1 -- 172.21.15.158:0/355601213 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ac07e960 con 0x7f44ac0b5370 2019-12-05T03:50:24.605 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.588+0000 7f44b1c4e700 1 --2- 172.21.15.158:0/355601213 >> v2:172.21.15.96:3300/0 conn(0x7f44ac0b5370 0x7f44ac0b57a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f44a4008b10 tx=0x7f44a40100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.605 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.588+0000 7f44b1c4e700 1 --2- 172.21.15.158:0/355601213 >> v2:172.21.15.96:3300/0 conn(0x7f44ac0b5370 0x7f44ac0b57a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f44a4008b10 tx=0x7f44a40100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.605 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.588+0000 7f44b1c4e700 1 --2- 172.21.15.158:0/355601213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44ac0b5370 0x7f44ac0b57a0 secure :-1 s=READY pgs=168 cs=0 l=1 rx=0x7f44a4008b10 tx=0x7f44a40100b0).ready entity=mon.0 client_cookie=6909a48acbfe2385 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:24.605 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.588+0000 7f44b1c4e700 1 --2- 172.21.15.158:0/355601213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44ac0b5370 0x7f44ac0b57a0 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f44a4008b10 tx=0x7f44a40100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.605 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.588+0000 7f44b1c4e700 1 --2- 172.21.15.158:0/355601213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44ac0b5370 0x7f44ac0b57a0 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f44a4008b10 tx=0x7f44a40100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.605 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.588+0000 7f44a3fff700 1 -- 172.21.15.158:0/355601213 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44a4010da0 con 0x7f44ac0b5370 2019-12-05T03:50:24.605 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.588+0000 7f44b1c4e700 1 --2- 172.21.15.158:0/355601213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44ac0b5370 0x7f44ac0b57a0 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7f44a4008b10 tx=0x7f44a40100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.606 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.588+0000 7f44a3fff700 1 -- 172.21.15.158:0/355601213 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a40109c0 con 0x7f44ac0b5370 2019-12-05T03:50:24.606 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.588+0000 7f44b2eb0700 1 -- 172.21.15.158:0/355601213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44ac0b5370 msgr2=0x7f44ac0b57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:24.606 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.588+0000 7f44b2eb0700 1 --2- 172.21.15.158:0/355601213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44ac0b5370 0x7f44ac0b57a0 secure :-1 s=READY pgs=168 cs=0 l=1 rx=0x7f44a4008b10 tx=0x7f44a40100b0).stop 2019-12-05T03:50:24.606 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.588+0000 7f44a3fff700 1 -- 172.21.15.158:0/355601213 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44a40114a0 con 0x7f44ac0b5370 2019-12-05T03:50:24.606 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.588+0000 7f44b2eb0700 1 -- 172.21.15.158:0/355601213 shutdown_connections 2019-12-05T03:50:24.606 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.588+0000 7f44b2eb0700 1 --2- 172.21.15.158:0/355601213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44ac0b5370 0x7f44ac0b57a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:24.606 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.588+0000 7f44b2eb0700 1 --2- 172.21.15.158:0/355601213 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f44ac09ba40 0x7f44ac09add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:24.607 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.588+0000 7f44b2eb0700 1 -- 172.21.15.158:0/355601213 shutdown_connections 2019-12-05T03:50:24.607 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.588+0000 7f44b2eb0700 1 -- 172.21.15.158:0/355601213 wait complete. 2019-12-05T03:50:24.607 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.588+0000 7f44b2eb0700 1 -- 172.21.15.158:0/355601213 >> 172.21.15.158:0/355601213 conn(0x7f44ac0b7ef0 msgr2=0x7f44ac0b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:24.607 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.592+0000 7f44b2eb0700 1 Processor -- start 2019-12-05T03:50:24.607 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.592+0000 7f44b2eb0700 1 -- start start 2019-12-05T03:50:24.607 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.592+0000 7f44b2eb0700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f44ac154650 0x7f44ac059730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:24.607 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.592+0000 7f44b2eb0700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f44ac12fcd0 0x7f44ac13cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:24.608 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.592+0000 7f44b2eb0700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f44ac07b3f0 0x7f44ac07b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:24.608 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.592+0000 7f44b2eb0700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44ac151af0 con 0x7f44ac07b3f0 2019-12-05T03:50:24.608 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.592+0000 7f44b2eb0700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44ac151d90 con 0x7f44ac12fcd0 2019-12-05T03:50:24.608 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.592+0000 7f44b2eb0700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac1401e0 con 0x7f44ac154650 2019-12-05T03:50:24.608 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.592+0000 7f44b0c4c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f44ac12fcd0 0x7f44ac13cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:24.608 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.592+0000 7f44b0c4c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f44ac12fcd0 0x7f44ac13cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54338/0 (socket says 172.21.15.158:54338) 2019-12-05T03:50:24.608 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.592+0000 7f44b0c4c700 1 -- 172.21.15.158:0/3314286963 learned_addr learned my addr 172.21.15.158:0/3314286963 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:24.609 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.592+0000 7f44b1c4e700 1 --2- 172.21.15.158:0/3314286963 >> v2:172.21.15.96:3300/0 conn(0x7f44ac07b3f0 0x7f44ac07b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:24.609 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.592+0000 7f44b144d700 1 --2- 172.21.15.158:0/3314286963 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f44ac154650 0x7f44ac059730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:24.609 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.592+0000 7f44b0c4c700 1 -- 172.21.15.158:0/3314286963 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f44ac154650 msgr2=0x7f44ac059730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:24.609 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.592+0000 7f44b0c4c700 1 --2- 172.21.15.158:0/3314286963 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f44ac154650 0x7f44ac059730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:24.609 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.592+0000 7f44b0c4c700 1 -- 172.21.15.158:0/3314286963 >> v2:172.21.15.96:3300/0 conn(0x7f44ac07b3f0 msgr2=0x7f44ac07b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:24.609 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.592+0000 7f44b0c4c700 1 --2- 172.21.15.158:0/3314286963 >> v2:172.21.15.96:3300/0 conn(0x7f44ac07b3f0 0x7f44ac07b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:24.609 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.592+0000 7f44b0c4c700 1 -- 172.21.15.158:0/3314286963 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ac152030 con 0x7f44ac12fcd0 2019-12-05T03:50:24.610 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.592+0000 7f44b0c4c700 1 --2- 172.21.15.158:0/3314286963 >> v2:172.21.15.158:3300/0 conn(0x7f44ac12fcd0 0x7f44ac13cc00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f44ac151cb0 tx=0x7f449c010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.610 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.592+0000 7f44b0c4c700 1 --2- 172.21.15.158:0/3314286963 >> v2:172.21.15.158:3300/0 conn(0x7f44ac12fcd0 0x7f44ac13cc00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f44ac151cb0 tx=0x7f449c010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.610 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.592+0000 7f44b0c4c700 1 --2- 172.21.15.158:0/3314286963 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f44ac12fcd0 0x7f44ac13cc00 secure :-1 s=READY pgs=233 cs=0 l=1 rx=0x7f44ac151cb0 tx=0x7f449c010cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:24.610 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.592+0000 7f44b0c4c700 1 --2- 172.21.15.158:0/3314286963 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f44ac12fcd0 0x7f44ac13cc00 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f44ac151cb0 tx=0x7f449c010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.610 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.592+0000 7f44a1ffb700 1 -- 172.21.15.158:0/3314286963 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f449c005930 con 0x7f44ac12fcd0 2019-12-05T03:50:24.610 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.592+0000 7f44b0c4c700 1 --2- 172.21.15.158:0/3314286963 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f44ac12fcd0 0x7f44ac13cc00 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f44ac151cb0 tx=0x7f449c010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.610 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.592+0000 7f44b0c4c700 1 --2- 172.21.15.158:0/3314286963 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f44ac12fcd0 0x7f44ac13cc00 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f44ac151cb0 tx=0x7f449c010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.611 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.592+0000 7f44a1ffb700 1 -- 172.21.15.158:0/3314286963 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449c007160 con 0x7f44ac12fcd0 2019-12-05T03:50:24.611 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.592+0000 7f44b2eb0700 1 -- 172.21.15.158:0/3314286963 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44ac13d150 con 0x7f44ac12fcd0 2019-12-05T03:50:24.611 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.592+0000 7f44a1ffb700 1 -- 172.21.15.158:0/3314286963 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f449c012330 con 0x7f44ac12fcd0 2019-12-05T03:50:24.611 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.592+0000 7f44b2eb0700 1 -- 172.21.15.158:0/3314286963 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44ac140480 con 0x7f44ac12fcd0 2019-12-05T03:50:24.611 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.596+0000 7f44b0c4c700 1 --2- 172.21.15.158:0/3314286963 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f44ac12fcd0 0x7f44ac13cc00 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f44ac151cb0 tx=0x7f449c010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.611 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.596+0000 7f44a1ffb700 1 -- 172.21.15.158:0/3314286963 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f449c012600 con 0x7f44ac12fcd0 2019-12-05T03:50:24.611 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.596+0000 7f44b0c4c700 1 --2- 172.21.15.158:0/3314286963 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f44ac12fcd0 0x7f44ac13cc00 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f44ac151cb0 tx=0x7f449c010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.612 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.596+0000 7f44a1ffb700 1 --2- 172.21.15.158:0/3314286963 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f448c03ad40 0x7f448c03d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:24.612 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.596+0000 7f44a1ffb700 1 -- 172.21.15.158:0/3314286963 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f449c04b430 con 0x7f44ac12fcd0 2019-12-05T03:50:24.612 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.596+0000 7f44b144d700 1 --2- 172.21.15.158:0/3314286963 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f448c03ad40 0x7f448c03d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:24.613 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.596+0000 7f44b144d700 1 --2- 172.21.15.158:0/3314286963 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f448c03ad40 0x7f448c03d250 crc :-1 s=READY pgs=111 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:24.613 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.600+0000 7f44b2eb0700 1 -- 172.21.15.158:0/3314286963 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44ac0554e0 con 0x7f44ac12fcd0 2019-12-05T03:50:24.618 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.612+0000 7f44b0c4c700 1 --2- 172.21.15.158:0/3314286963 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f44ac12fcd0 0x7f44ac13cc00 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f44ac151cb0 tx=0x7f449c010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.618 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.612+0000 7f44a1ffb700 1 -- 172.21.15.158:0/3314286963 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f449c0324b0 con 0x7f44ac12fcd0 2019-12-05T03:50:24.780 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.772+0000 7f44b2eb0700 1 -- 172.21.15.158:0/3314286963 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f44ac09ab10 con 0x7f44ac12fcd0 2019-12-05T03:50:24.781 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.772+0000 7f44b0c4c700 1 --2- 172.21.15.158:0/3314286963 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f44ac12fcd0 0x7f44ac13cc00 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f44ac151cb0 tx=0x7f449c010cb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.781 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.772+0000 7f44a1ffb700 1 -- 172.21.15.158:0/3314286963 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7f449c032710 con 0x7f44ac12fcd0 2019-12-05T03:50:24.781 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:50:24.784 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.776+0000 7f44b2eb0700 1 -- 172.21.15.158:0/3314286963 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f448c03ad40 msgr2=0x7f448c03d250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:24.784 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.776+0000 7f44b2eb0700 1 --2- 172.21.15.158:0/3314286963 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f448c03ad40 0x7f448c03d250 crc :-1 s=READY pgs=111 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:24.784 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.776+0000 7f44b2eb0700 1 -- 172.21.15.158:0/3314286963 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f44ac12fcd0 msgr2=0x7f44ac13cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:24.784 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.776+0000 7f44b2eb0700 1 --2- 172.21.15.158:0/3314286963 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f44ac12fcd0 0x7f44ac13cc00 secure :-1 s=READY pgs=233 cs=0 l=1 rx=0x7f44ac151cb0 tx=0x7f449c010cb0).stop 2019-12-05T03:50:24.784 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.776+0000 7f44b2eb0700 1 -- 172.21.15.158:0/3314286963 shutdown_connections 2019-12-05T03:50:24.785 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.776+0000 7f44b2eb0700 1 --2- 172.21.15.158:0/3314286963 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f448c03ad40 0x7f448c03d250 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:24.785 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.776+0000 7f44b2eb0700 1 --2- 172.21.15.158:0/3314286963 >> v2:172.21.15.96:3300/0 conn(0x7f44ac07b3f0 0x7f44ac07b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:24.785 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.776+0000 7f44b2eb0700 1 --2- 172.21.15.158:0/3314286963 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f44ac154650 0x7f44ac059730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:24.785 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.776+0000 7f44b2eb0700 1 --2- 172.21.15.158:0/3314286963 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f44ac12fcd0 0x7f44ac13cc00 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:24.785 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.776+0000 7f44b2eb0700 1 -- 172.21.15.158:0/3314286963 shutdown_connections 2019-12-05T03:50:24.785 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.776+0000 7f44b2eb0700 1 -- 172.21.15.158:0/3314286963 wait complete. 2019-12-05T03:50:24.785 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.776+0000 7f44b2eb0700 1 -- 172.21.15.158:0/3314286963 >> 172.21.15.158:0/3314286963 conn(0x7f44ac09b490 msgr2=0x7f44ac154f90 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:24.793 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-12-05T03:50:24.896 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.884+0000 7fd8e4747700 1 Processor -- start 2019-12-05T03:50:24.896 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.884+0000 7fd8e4747700 1 -- start start 2019-12-05T03:50:24.896 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.884+0000 7fd8e4747700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd8dc0b6970 0x7fd8dc09add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:24.897 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.884+0000 7fd8e4747700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd8dc0b5370 0x7fd8dc0b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:24.897 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.884+0000 7fd8e4747700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8dc099e30 con 0x7fd8dc09ba40 2019-12-05T03:50:24.897 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.884+0000 7fd8e4747700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8dc09d210 con 0x7fd8dc0b5370 2019-12-05T03:50:24.897 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.884+0000 7fd8e4747700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc099b90 con 0x7fd8dc0b6970 2019-12-05T03:50:24.897 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.884+0000 7fd8e34e5700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd8dc0b5370 0x7fd8dc0b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:24.897 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.884+0000 7fd8e34e5700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd8dc0b5370 0x7fd8dc0b57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54350/0 (socket says 172.21.15.158:54350) 2019-12-05T03:50:24.897 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.884+0000 7fd8e34e5700 1 -- 172.21.15.158:0/3919389669 learned_addr learned my addr 172.21.15.158:0/3919389669 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:24.898 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.884+0000 7fd8e2ce4700 1 --2- 172.21.15.158:0/3919389669 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd8dc0b6970 0x7fd8dc09add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:24.898 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.888+0000 7fd8e34e5700 1 -- 172.21.15.158:0/3919389669 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd8dc0b6970 msgr2=0x7fd8dc09add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:24.898 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.888+0000 7fd8e34e5700 1 --2- 172.21.15.158:0/3919389669 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd8dc0b6970 0x7fd8dc09add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:24.898 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.888+0000 7fd8e34e5700 1 -- 172.21.15.158:0/3919389669 >> v1:172.21.15.96:6789/0 conn(0x7fd8dc09ba40 legacy=0x7fd8dc05a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:24.898 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.888+0000 7fd8e34e5700 1 -- 172.21.15.158:0/3919389669 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8dc07e960 con 0x7fd8dc0b5370 2019-12-05T03:50:24.898 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.888+0000 7fd8e2ce4700 1 --2- 172.21.15.158:0/3919389669 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd8dc0b6970 0x7fd8dc09add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-12-05T03:50:24.898 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.888+0000 7fd8e34e5700 1 --2- 172.21.15.158:0/3919389669 >> v2:172.21.15.158:3300/0 conn(0x7fd8dc0b5370 0x7fd8dc0b57a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd8d40032b0 tx=0x7fd8d40100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.899 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.888+0000 7fd8e34e5700 1 --2- 172.21.15.158:0/3919389669 >> v2:172.21.15.158:3300/0 conn(0x7fd8dc0b5370 0x7fd8dc0b57a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd8d40032b0 tx=0x7fd8d40100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.899 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.888+0000 7fd8e34e5700 1 --2- 172.21.15.158:0/3919389669 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd8dc0b5370 0x7fd8dc0b57a0 secure :-1 s=READY pgs=234 cs=0 l=1 rx=0x7fd8d40032b0 tx=0x7fd8d40100b0).ready entity=mon.1 client_cookie=3fc498a588f1d6b2 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:24.899 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.888+0000 7fd8e34e5700 1 --2- 172.21.15.158:0/3919389669 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd8dc0b5370 0x7fd8dc0b57a0 secure :-1 s=THROTTLE_DONE pgs=234 cs=0 l=1 rx=0x7fd8d40032b0 tx=0x7fd8d40100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.899 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.888+0000 7fd8e34e5700 1 --2- 172.21.15.158:0/3919389669 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd8dc0b5370 0x7fd8dc0b57a0 secure :-1 s=THROTTLE_DONE pgs=234 cs=0 l=1 rx=0x7fd8d40032b0 tx=0x7fd8d40100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.899 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.888+0000 7fd8e1ce2700 1 -- 172.21.15.158:0/3919389669 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8d4010d60 con 0x7fd8dc0b5370 2019-12-05T03:50:24.899 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.888+0000 7fd8e34e5700 1 --2- 172.21.15.158:0/3919389669 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd8dc0b5370 0x7fd8dc0b57a0 secure :-1 s=THROTTLE_DONE pgs=234 cs=0 l=1 rx=0x7fd8d40032b0 tx=0x7fd8d40100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.899 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.888+0000 7fd8e1ce2700 1 -- 172.21.15.158:0/3919389669 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d4010980 con 0x7fd8dc0b5370 2019-12-05T03:50:24.900 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.888+0000 7fd8e1ce2700 1 -- 172.21.15.158:0/3919389669 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8d40114a0 con 0x7fd8dc0b5370 2019-12-05T03:50:24.900 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.888+0000 7fd8e4747700 1 -- 172.21.15.158:0/3919389669 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd8dc0b5370 msgr2=0x7fd8dc0b57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:24.900 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.888+0000 7fd8e4747700 1 --2- 172.21.15.158:0/3919389669 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd8dc0b5370 0x7fd8dc0b57a0 secure :-1 s=READY pgs=234 cs=0 l=1 rx=0x7fd8d40032b0 tx=0x7fd8d40100b0).stop 2019-12-05T03:50:24.900 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.888+0000 7fd8e4747700 1 -- 172.21.15.158:0/3919389669 shutdown_connections 2019-12-05T03:50:24.900 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.888+0000 7fd8e4747700 1 --2- 172.21.15.158:0/3919389669 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd8dc0b5370 0x7fd8dc0b57a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:24.900 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.888+0000 7fd8e4747700 1 --2- 172.21.15.158:0/3919389669 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd8dc0b6970 0x7fd8dc09add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:24.900 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.888+0000 7fd8e4747700 1 -- 172.21.15.158:0/3919389669 shutdown_connections 2019-12-05T03:50:24.901 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.888+0000 7fd8e4747700 1 -- 172.21.15.158:0/3919389669 wait complete. 2019-12-05T03:50:24.901 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.888+0000 7fd8e4747700 1 -- 172.21.15.158:0/3919389669 >> 172.21.15.158:0/3919389669 conn(0x7fd8dc0b7ef0 msgr2=0x7fd8dc0b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:24.904 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.892+0000 7fd8e4747700 1 Processor -- start 2019-12-05T03:50:24.904 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.892+0000 7fd8e4747700 1 -- start start 2019-12-05T03:50:24.904 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.892+0000 7fd8e4747700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd8dc0adac0 0x7fd8dc151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:24.904 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.892+0000 7fd8e4747700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8dc0adef0 con 0x7fd8dc153cd0 2019-12-05T03:50:24.904 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.892+0000 7fd8e4747700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8dc154450 con 0x7fd8dc099260 2019-12-05T03:50:24.904 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.892+0000 7fd8e4747700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8dc07b020 con 0x7fd8dc0adac0 2019-12-05T03:50:24.905 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.892+0000 7fd8e34e5700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd8dc0adac0 0x7fd8dc151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:24.905 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.892+0000 7fd8e34e5700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd8dc0adac0 0x7fd8dc151ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54356/0 (socket says 172.21.15.158:54356) 2019-12-05T03:50:24.905 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.892+0000 7fd8e34e5700 1 -- 172.21.15.158:0/1654959441 learned_addr learned my addr 172.21.15.158:0/1654959441 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:24.905 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.892+0000 7fd8e34e5700 1 -- 172.21.15.158:0/1654959441 >> v1:172.21.15.158:6789/0 conn(0x7fd8dc099260 legacy=0x7fd8dc0ad2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:24.905 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.892+0000 7fd8d37fe700 1 -- 172.21.15.158:0/1654959441 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3591216687 0 0) 0x7fd8dc0adef0 con 0x7fd8dc153cd0 2019-12-05T03:50:24.905 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.892+0000 7fd8e34e5700 1 -- 172.21.15.158:0/1654959441 >> v1:172.21.15.96:6789/0 conn(0x7fd8dc153cd0 legacy=0x7fd8dc07a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:24.905 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.892+0000 7fd8e34e5700 1 -- 172.21.15.158:0/1654959441 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8dc099690 con 0x7fd8dc0adac0 2019-12-05T03:50:24.906 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.892+0000 7fd8e34e5700 1 --2- 172.21.15.158:0/1654959441 >> v2:172.21.15.158:3300/0 conn(0x7fd8dc0adac0 0x7fd8dc151ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd8d40032b0 tx=0x7fd8d4010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.906 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.892+0000 7fd8e34e5700 1 --2- 172.21.15.158:0/1654959441 >> v2:172.21.15.158:3300/0 conn(0x7fd8dc0adac0 0x7fd8dc151ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd8d40032b0 tx=0x7fd8d4010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.906 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.892+0000 7fd8e34e5700 1 --2- 172.21.15.158:0/1654959441 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd8dc0adac0 0x7fd8dc151ea0 secure :-1 s=READY pgs=236 cs=0 l=1 rx=0x7fd8d40032b0 tx=0x7fd8d4010e80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:24.906 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.892+0000 7fd8e34e5700 1 --2- 172.21.15.158:0/1654959441 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd8dc0adac0 0x7fd8dc151ea0 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7fd8d40032b0 tx=0x7fd8d4010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.906 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.892+0000 7fd8d37fe700 1 -- 172.21.15.158:0/1654959441 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8d4011bb0 con 0x7fd8dc0adac0 2019-12-05T03:50:24.906 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.892+0000 7fd8e34e5700 1 --2- 172.21.15.158:0/1654959441 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd8dc0adac0 0x7fd8dc151ea0 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7fd8d40032b0 tx=0x7fd8d4010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.906 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.892+0000 7fd8e34e5700 1 --2- 172.21.15.158:0/1654959441 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd8dc0adac0 0x7fd8dc151ea0 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7fd8d40032b0 tx=0x7fd8d4010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.907 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.892+0000 7fd8d37fe700 1 -- 172.21.15.158:0/1654959441 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d40110c0 con 0x7fd8dc0adac0 2019-12-05T03:50:24.907 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.892+0000 7fd8e4747700 1 -- 172.21.15.158:0/1654959441 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8dc1523f0 con 0x7fd8dc0adac0 2019-12-05T03:50:24.907 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.892+0000 7fd8d37fe700 1 -- 172.21.15.158:0/1654959441 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8d4005ab0 con 0x7fd8dc0adac0 2019-12-05T03:50:24.907 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.892+0000 7fd8e4747700 1 -- 172.21.15.158:0/1654959441 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8dc1386d0 con 0x7fd8dc0adac0 2019-12-05T03:50:24.907 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.896+0000 7fd8e34e5700 1 --2- 172.21.15.158:0/1654959441 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd8dc0adac0 0x7fd8dc151ea0 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7fd8d40032b0 tx=0x7fd8d4010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.907 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.896+0000 7fd8e34e5700 1 --2- 172.21.15.158:0/1654959441 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd8dc0adac0 0x7fd8dc151ea0 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7fd8d40032b0 tx=0x7fd8d4010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.907 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.896+0000 7fd8d37fe700 1 -- 172.21.15.158:0/1654959441 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fd8d400f280 con 0x7fd8dc0adac0 2019-12-05T03:50:24.907 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.896+0000 7fd8d37fe700 1 --2- 172.21.15.158:0/1654959441 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd8c403abe0 0x7fd8c403d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:24.908 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.896+0000 7fd8d37fe700 1 -- 172.21.15.158:0/1654959441 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fd8d404b540 con 0x7fd8dc0adac0 2019-12-05T03:50:24.908 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.896+0000 7fd8e2ce4700 1 --2- 172.21.15.158:0/1654959441 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd8c403abe0 0x7fd8c403d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:24.908 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.896+0000 7fd8e2ce4700 1 --2- 172.21.15.158:0/1654959441 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd8c403abe0 0x7fd8c403d0f0 crc :-1 s=READY pgs=112 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:24.908 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.900+0000 7fd8e4747700 1 -- 172.21.15.158:0/1654959441 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8dc0554e0 con 0x7fd8dc0adac0 2019-12-05T03:50:24.913 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.904+0000 7fd8e34e5700 1 --2- 172.21.15.158:0/1654959441 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd8dc0adac0 0x7fd8dc151ea0 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7fd8d40032b0 tx=0x7fd8d4010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:24.913 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:24.904+0000 7fd8d37fe700 1 -- 172.21.15.158:0/1654959441 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fd8dc1523f0 con 0x7fd8dc0adac0 2019-12-05T03:50:25.076 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.068+0000 7fd8e4747700 1 -- 172.21.15.158:0/1654959441 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7fd8dc066940 con 0x7fd8dc0adac0 2019-12-05T03:50:25.077 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.068+0000 7fd8e34e5700 1 --2- 172.21.15.158:0/1654959441 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd8dc0adac0 0x7fd8dc151ea0 secure :-1 s=THROTTLE_DONE pgs=236 cs=0 l=1 rx=0x7fd8d40032b0 tx=0x7fd8d4010e80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.077 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.068+0000 7fd8d37fe700 1 -- 172.21.15.158:0/1654959441 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7fd8d4005d90 con 0x7fd8dc0adac0 2019-12-05T03:50:25.078 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:50:25.080 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.072+0000 7fd8e4747700 1 -- 172.21.15.158:0/1654959441 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd8c403abe0 msgr2=0x7fd8c403d0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:25.080 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.072+0000 7fd8e4747700 1 --2- 172.21.15.158:0/1654959441 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd8c403abe0 0x7fd8c403d0f0 crc :-1 s=READY pgs=112 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:25.080 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.072+0000 7fd8e4747700 1 -- 172.21.15.158:0/1654959441 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd8dc0adac0 msgr2=0x7fd8dc151ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:25.080 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.072+0000 7fd8e4747700 1 --2- 172.21.15.158:0/1654959441 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd8dc0adac0 0x7fd8dc151ea0 secure :-1 s=READY pgs=236 cs=0 l=1 rx=0x7fd8d40032b0 tx=0x7fd8d4010e80).stop 2019-12-05T03:50:25.080 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.072+0000 7fd8e4747700 1 -- 172.21.15.158:0/1654959441 shutdown_connections 2019-12-05T03:50:25.081 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.072+0000 7fd8e4747700 1 --2- 172.21.15.158:0/1654959441 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd8dc0adac0 0x7fd8dc151ea0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:25.081 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.072+0000 7fd8e4747700 1 --2- 172.21.15.158:0/1654959441 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd8c403abe0 0x7fd8c403d0f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:25.081 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.072+0000 7fd8e4747700 1 -- 172.21.15.158:0/1654959441 shutdown_connections 2019-12-05T03:50:25.081 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.072+0000 7fd8e4747700 1 -- 172.21.15.158:0/1654959441 wait complete. 2019-12-05T03:50:25.081 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.072+0000 7fd8e4747700 1 -- 172.21.15.158:0/1654959441 >> 172.21.15.158:0/1654959441 conn(0x7fd8dc0b6990 msgr2=0x7fd8dc09a320 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:25.090 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-05T03:50:25.188 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.176+0000 7f5187a18700 1 Processor -- start 2019-12-05T03:50:25.188 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.176+0000 7f5187a18700 1 -- start start 2019-12-05T03:50:25.189 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.176+0000 7f5187a18700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f518009cf60 0x7f518009a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:25.189 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.176+0000 7f5187a18700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51800accb0 con 0x7f51801553b0 2019-12-05T03:50:25.189 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.176+0000 7f5187a18700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51800b6980 con 0x7f518005a740 2019-12-05T03:50:25.189 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.176+0000 7f5187a18700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51800b1730 con 0x7f518009cf60 2019-12-05T03:50:25.189 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.176+0000 7f5185fb5700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f518009cf60 0x7f518009a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:25.189 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.176+0000 7f5185fb5700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f518009cf60 0x7f518009a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54360/0 (socket says 172.21.15.158:54360) 2019-12-05T03:50:25.190 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.176+0000 7f51857b4700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f518005a740 0x7f5180151460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49142/0 (socket says 172.21.15.158:49142) 2019-12-05T03:50:25.190 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.176+0000 7f5185fb5700 1 -- 172.21.15.158:0/4052526069 learned_addr learned my addr 172.21.15.158:0/4052526069 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:25.190 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.180+0000 7f5185fb5700 1 -- 172.21.15.158:0/4052526069 >> v1:172.21.15.158:6789/0 conn(0x7f518005a740 legacy=0x7f5180151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:25.190 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.180+0000 7f5185fb5700 1 -- 172.21.15.158:0/4052526069 >> v1:172.21.15.96:6789/0 conn(0x7f51801553b0 legacy=0x7f51801557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:25.190 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.180+0000 7f5185fb5700 1 -- 172.21.15.158:0/4052526069 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f518005ab70 con 0x7f518009cf60 2019-12-05T03:50:25.190 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.180+0000 7f5185fb5700 1 --2- 172.21.15.158:0/4052526069 >> v2:172.21.15.158:3300/0 conn(0x7f518009cf60 0x7f518009a320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f517c008790 tx=0x7f517c00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.190 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.180+0000 7f5185fb5700 1 --2- 172.21.15.158:0/4052526069 >> v2:172.21.15.158:3300/0 conn(0x7f518009cf60 0x7f518009a320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f517c008790 tx=0x7f517c00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.191 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.180+0000 7f5185fb5700 1 --2- 172.21.15.158:0/4052526069 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f518009cf60 0x7f518009a320 secure :-1 s=READY pgs=238 cs=0 l=1 rx=0x7f517c008790 tx=0x7f517c00fcb0).ready entity=mon.1 client_cookie=891fa76ad5d5432 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:25.191 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.180+0000 7f5185fb5700 1 --2- 172.21.15.158:0/4052526069 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f518009cf60 0x7f518009a320 secure :-1 s=THROTTLE_DONE pgs=238 cs=0 l=1 rx=0x7f517c008790 tx=0x7f517c00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.191 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.180+0000 7f5185fb5700 1 --2- 172.21.15.158:0/4052526069 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f518009cf60 0x7f518009a320 secure :-1 s=THROTTLE_DONE pgs=238 cs=0 l=1 rx=0x7f517c008790 tx=0x7f517c00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.191 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.180+0000 7f5185fb5700 1 --2- 172.21.15.158:0/4052526069 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f518009cf60 0x7f518009a320 secure :-1 s=THROTTLE_DONE pgs=238 cs=0 l=1 rx=0x7f517c008790 tx=0x7f517c00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.191 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.180+0000 7f5184fb3700 1 -- 172.21.15.158:0/4052526069 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f517c0114e0 con 0x7f518009cf60 2019-12-05T03:50:25.191 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.180+0000 7f5184fb3700 1 -- 172.21.15.158:0/4052526069 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517c008ca0 con 0x7f518009cf60 2019-12-05T03:50:25.191 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.180+0000 7f5184fb3700 1 -- 172.21.15.158:0/4052526069 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f517c011ac0 con 0x7f518009cf60 2019-12-05T03:50:25.191 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.180+0000 7f5187a18700 1 -- 172.21.15.158:0/4052526069 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f518009cf60 msgr2=0x7f518009a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:25.192 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.180+0000 7f5187a18700 1 --2- 172.21.15.158:0/4052526069 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f518009cf60 0x7f518009a320 secure :-1 s=READY pgs=238 cs=0 l=1 rx=0x7f517c008790 tx=0x7f517c00fcb0).stop 2019-12-05T03:50:25.192 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.180+0000 7f5187a18700 1 -- 172.21.15.158:0/4052526069 shutdown_connections 2019-12-05T03:50:25.192 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.180+0000 7f5187a18700 1 --2- 172.21.15.158:0/4052526069 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f518009cf60 0x7f518009a320 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:25.192 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.180+0000 7f5187a18700 1 -- 172.21.15.158:0/4052526069 shutdown_connections 2019-12-05T03:50:25.192 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.180+0000 7f5187a18700 1 -- 172.21.15.158:0/4052526069 wait complete. 2019-12-05T03:50:25.192 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.180+0000 7f5187a18700 1 -- 172.21.15.158:0/4052526069 >> 172.21.15.158:0/4052526069 conn(0x7f51800b7e60 msgr2=0x7f51800b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:25.195 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.184+0000 7f5187a18700 1 Processor -- start 2019-12-05T03:50:25.196 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.184+0000 7f5187a18700 1 -- start start 2019-12-05T03:50:25.196 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.184+0000 7f5187a18700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5180154d50 0x7f518009aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:25.196 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.184+0000 7f5187a18700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5180138da0 0x7f51801353b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:25.196 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.184+0000 7f5187a18700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51801397f0 con 0x7f5180138970 2019-12-05T03:50:25.196 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.184+0000 7f5187a18700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5180155d40 con 0x7f5180154d50 2019-12-05T03:50:25.196 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.184+0000 7f5187a18700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51801392b0 con 0x7f5180138da0 2019-12-05T03:50:25.197 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.184+0000 7f5185fb5700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5180154d50 0x7f518009aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:25.197 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.184+0000 7f5185fb5700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5180154d50 0x7f518009aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54366/0 (socket says 172.21.15.158:54366) 2019-12-05T03:50:25.197 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.184+0000 7f5185fb5700 1 -- 172.21.15.158:0/1725933664 learned_addr learned my addr 172.21.15.158:0/1725933664 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:25.197 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.184+0000 7f51867b6700 1 --2- 172.21.15.158:0/1725933664 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5180138da0 0x7f51801353b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:25.197 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.184+0000 7f5185fb5700 1 -- 172.21.15.158:0/1725933664 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5180138da0 msgr2=0x7f51801353b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:25.197 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.184+0000 7f5185fb5700 1 --2- 172.21.15.158:0/1725933664 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5180138da0 0x7f51801353b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:25.197 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.184+0000 7f5185fb5700 1 -- 172.21.15.158:0/1725933664 >> v1:172.21.15.96:6789/0 conn(0x7f5180138970 legacy=0x7f518007c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:25.198 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.184+0000 7f5185fb5700 1 -- 172.21.15.158:0/1725933664 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5180152240 con 0x7f5180154d50 2019-12-05T03:50:25.198 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.184+0000 7f51867b6700 1 --2- 172.21.15.158:0/1725933664 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5180138da0 0x7f51801353b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-12-05T03:50:25.198 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.184+0000 7f5185fb5700 1 --2- 172.21.15.158:0/1725933664 >> v2:172.21.15.158:3300/0 conn(0x7f5180154d50 0x7f518009aae0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5180156170 tx=0x7f517c011630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.198 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.184+0000 7f5185fb5700 1 --2- 172.21.15.158:0/1725933664 >> v2:172.21.15.158:3300/0 conn(0x7f5180154d50 0x7f518009aae0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5180156170 tx=0x7f517c011630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.198 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.184+0000 7f5185fb5700 1 --2- 172.21.15.158:0/1725933664 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5180154d50 0x7f518009aae0 secure :-1 s=READY pgs=239 cs=0 l=1 rx=0x7f5180156170 tx=0x7f517c011630).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:25.198 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.184+0000 7f5185fb5700 1 --2- 172.21.15.158:0/1725933664 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5180154d50 0x7f518009aae0 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7f5180156170 tx=0x7f517c011630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.198 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.184+0000 7f51767fc700 1 -- 172.21.15.158:0/1725933664 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f517c007150 con 0x7f5180154d50 2019-12-05T03:50:25.199 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.184+0000 7f5185fb5700 1 --2- 172.21.15.158:0/1725933664 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5180154d50 0x7f518009aae0 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7f5180156170 tx=0x7f517c011630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.199 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.188+0000 7f51767fc700 1 -- 172.21.15.158:0/1725933664 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517c0116e0 con 0x7f5180154d50 2019-12-05T03:50:25.199 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.188+0000 7f5185fb5700 1 --2- 172.21.15.158:0/1725933664 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5180154d50 0x7f518009aae0 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7f5180156170 tx=0x7f517c011630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.199 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.188+0000 7f5187a18700 1 -- 172.21.15.158:0/1725933664 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f518009b030 con 0x7f5180154d50 2019-12-05T03:50:25.199 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.188+0000 7f51767fc700 1 -- 172.21.15.158:0/1725933664 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f517c005730 con 0x7f5180154d50 2019-12-05T03:50:25.199 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.188+0000 7f5187a18700 1 -- 172.21.15.158:0/1725933664 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f518007cd50 con 0x7f5180154d50 2019-12-05T03:50:25.199 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.188+0000 7f5185fb5700 1 --2- 172.21.15.158:0/1725933664 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5180154d50 0x7f518009aae0 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7f5180156170 tx=0x7f517c011630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.199 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.188+0000 7f51767fc700 1 -- 172.21.15.158:0/1725933664 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f517c0059d0 con 0x7f5180154d50 2019-12-05T03:50:25.200 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.188+0000 7f5185fb5700 1 --2- 172.21.15.158:0/1725933664 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5180154d50 0x7f518009aae0 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7f5180156170 tx=0x7f517c011630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.200 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.188+0000 7f51767fc700 1 --2- 172.21.15.158:0/1725933664 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f516803acd0 0x7f516803d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:25.200 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.188+0000 7f51767fc700 1 -- 172.21.15.158:0/1725933664 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f517c04bb80 con 0x7f5180154d50 2019-12-05T03:50:25.200 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.188+0000 7f51857b4700 1 --2- 172.21.15.158:0/1725933664 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f516803acd0 0x7f516803d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:25.201 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.188+0000 7f51857b4700 1 --2- 172.21.15.158:0/1725933664 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f516803acd0 0x7f516803d1e0 crc :-1 s=READY pgs=113 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:25.201 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.192+0000 7f5187a18700 1 -- 172.21.15.158:0/1725933664 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51800554e0 con 0x7f5180154d50 2019-12-05T03:50:25.201 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.196+0000 7f5185fb5700 1 --2- 172.21.15.158:0/1725933664 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5180154d50 0x7f518009aae0 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7f5180156170 tx=0x7f517c011630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.202 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.196+0000 7f51767fc700 1 -- 172.21.15.158:0/1725933664 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f517c032be0 con 0x7f5180154d50 2019-12-05T03:50:25.366 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.360+0000 7f5187a18700 1 -- 172.21.15.158:0/1725933664 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5180066940 con 0x7f5180154d50 2019-12-05T03:50:25.368 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.360+0000 7f5185fb5700 1 --2- 172.21.15.158:0/1725933664 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5180154d50 0x7f518009aae0 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7f5180156170 tx=0x7f517c011630).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.368 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.360+0000 7f51767fc700 1 -- 172.21.15.158:0/1725933664 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+14933 (secure 0 0 0) 0x7f517c032e40 con 0x7f5180154d50 2019-12-05T03:50:25.371 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:25.371 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":23,"fsid":"a91186ae-f496-4de1-918d-820c55ff1feb","created":"2019-12-05T03:49:39.187523+0000","modified":"2019-12-05T03:50:01.249305+0000","last_up_change":"2019-12-05T03:49:48.551934+0000","last_in_change":"2019-12-05T03:49:48.551934+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-05T03:49:52.900870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-12-05T03:49:55.801462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-12-05T03:49:58.659250+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"782c4258-e28c-4a11-9d54-3c9c7a36fba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":12192},{"type":"v1","addr":"172.21.15.158:6801","nonce":12192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":12192},{"type":"v1","addr":"172.21.15.158:6803","nonce":12192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":12192},{"type":"v1","addr":"172.21.15.158:6807","nonce":12192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":12192},{"type":"v1","addr":"172.21.15.158:6805","nonce":12192}]},"public_addr":"172.21.15.158:6801/12192","cluster_addr":"172.21.15.158:6803/12192","heartbeat_back_addr":"172.21.15.158:6807/12192","heartbeat_front_addr":"172.21.15.158:6805/12192","state":["exists","up"]},{"osd":1,"uuid":"d4426b21-b666-4158-bf34-a24b14572731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":12193},{"type":"v1","addr":"172.21.15.158:6809","nonce":12193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":12193},{"type":"v1","addr":"172.21.15.158:6811","nonce":12193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":12193},{"type":"v1","addr":"172.21.15.158:6815","nonce":12193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":12193},{"type":"v1","addr":"172.21.15.158:6813","nonce":12193}]},"public_addr":"172.21.15.158:6809/12193","cluster_addr":"172.21.15.158:6811/12193","heartbeat_back_addr":"172.21.15.158:6815/12193","heartbeat_front_addr":"172.21.15.158:6813/12193","state":["exists","up"]},{"osd":2,"uuid":"22680edd-6490-4ab0-bb15-0605830e4cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":12195},{"type":"v1","addr":"172.21.15.158:6825","nonce":12195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":12195},{"type":"v1","addr":"172.21.15.158:6827","nonce":12195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":12195},{"type":"v1","addr":"172.21.15.158:6831","nonce":12195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":12195},{"type":"v1","addr":"172.21.15.158:6829","nonce":12195}]},"public_addr":"172.21.15.158:6825/12195","cluster_addr":"172.21.15.158:6827/12195","heartbeat_back_addr":"172.21.15.158:6831/12195","heartbeat_front_addr":"172.21.15.158:6829/12195","state":["exists","up"]},{"osd":3,"uuid":"7ec999ee-ace8-4ccb-a4f9-6f5d313bbbd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":12194},{"type":"v1","addr":"172.21.15.158:6817","nonce":12194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":12194},{"type":"v1","addr":"172.21.15.158:6819","nonce":12194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":12194},{"type":"v1","addr":"172.21.15.158:6823","nonce":12194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":12194},{"type":"v1","addr":"172.21.15.158:6821","nonce":12194}]},"public_addr":"172.21.15.158:6817/12194","cluster_addr":"172.21.15.158:6819/12194","heartbeat_back_addr":"172.21.15.158:6823/12194","heartbeat_front_addr":"172.21.15.158:6821/12194","state":["exists","up"]},{"osd":4,"uuid":"186e69c4-b69f-4dd1-bb8f-faf759c60484","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":12460},{"type":"v1","addr":"172.21.15.96:6803","nonce":12460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":12460},{"type":"v1","addr":"172.21.15.96:6805","nonce":12460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":12460},{"type":"v1","addr":"172.21.15.96:6809","nonce":12460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":12460},{"type":"v1","addr":"172.21.15.96:6807","nonce":12460}]},"public_addr":"172.21.15.96:6803/12460","cluster_addr":"172.21.15.96:6805/12460","heartbeat_back_addr":"172.21.15.96:6809/12460","heartbeat_front_addr":"172.21.15.96:6807/12460","state":["exists","up"]},{"osd":5,"uuid":"86b658b2-8b40-4cea-8163-305a3982758b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":12461},{"type":"v1","addr":"172.21.15.96:6811","nonce":12461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":12461},{"type":"v1","addr":"172.21.15.96:6813","nonce":12461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":12461},{"type":"v1","addr":"172.21.15.96:6817","nonce":12461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":12461},{"type":"v1","addr":"172.21.15.96:6815","nonce":12461}]},"public_addr":"172.21.15.96:6811/12461","cluster_addr":"172.21.15.96:6813/12461","heartbeat_back_addr":"172.21.15.96:6817/12461","heartbeat_front_addr":"172.21.15.96:6815/12461","state":["exists","up"]},{"osd":6,"uuid":"bdadaea8-9296-4788-bc59-d9c9eb8defdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":12463},{"type":"v1","addr":"172.21.15.96:6827","nonce":12463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":12463},{"type":"v1","addr":"172.21.15.96:6829","nonce":12463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":12463},{"type":"v1","addr":"172.21.15.96:6833","nonce":12463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":12463},{"type":"v1","addr":"172.21.15.96:6831","nonce":12463}]},"public_addr":"172.21.15.96:6827/12463","cluster_addr":"172.21.15.96:6829/12463","heartbeat_back_addr":"172.21.15.96:6833/12463","heartbeat_front_addr":"172.21.15.96:6831/12463","state":["exists","up"]},{"osd":7,"uuid":"c6d71846-d68e-430f-ab72-0fb8ea4bf640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":12462},{"type":"v1","addr":"172.21.15.96:6819","nonce":12462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":12462},{"type":"v1","addr":"172.21.15.96:6821","nonce":12462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":12462},{"type":"v1","addr":"172.21.15.96:6825","nonce":12462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":12462},{"type":"v1","addr":"172.21.15.96:6823","nonce":12462}]},"public_addr":"172.21.15.96:6819/12462","cluster_addr":"172.21.15.96:6821/12462","heartbeat_back_addr":"172.21.15.96:6825/12462","heartbeat_front_addr":"172.21.15.96:6823/12462","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.875762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.900817+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.210347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.133973+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.864697+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.131015+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.237225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.154377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-05T03:50:25.372 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.364+0000 7f5187a18700 1 -- 172.21.15.158:0/1725933664 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f516803acd0 msgr2=0x7f516803d1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:25.372 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.364+0000 7f5187a18700 1 --2- 172.21.15.158:0/1725933664 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f516803acd0 0x7f516803d1e0 crc :-1 s=READY pgs=113 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:25.373 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.364+0000 7f5187a18700 1 -- 172.21.15.158:0/1725933664 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5180154d50 msgr2=0x7f518009aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:25.373 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.364+0000 7f5187a18700 1 --2- 172.21.15.158:0/1725933664 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5180154d50 0x7f518009aae0 secure :-1 s=READY pgs=239 cs=0 l=1 rx=0x7f5180156170 tx=0x7f517c011630).stop 2019-12-05T03:50:25.373 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.364+0000 7f5187a18700 1 -- 172.21.15.158:0/1725933664 shutdown_connections 2019-12-05T03:50:25.373 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.364+0000 7f5187a18700 1 --2- 172.21.15.158:0/1725933664 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5180138da0 0x7f51801353b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:25.373 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.364+0000 7f5187a18700 1 --2- 172.21.15.158:0/1725933664 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5180154d50 0x7f518009aae0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:25.373 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.364+0000 7f5187a18700 1 --2- 172.21.15.158:0/1725933664 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f516803acd0 0x7f516803d1e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:25.373 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.364+0000 7f5187a18700 1 -- 172.21.15.158:0/1725933664 shutdown_connections 2019-12-05T03:50:25.374 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.364+0000 7f5187a18700 1 -- 172.21.15.158:0/1725933664 wait complete. 2019-12-05T03:50:25.374 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.364+0000 7f5187a18700 1 -- 172.21.15.158:0/1725933664 >> 172.21.15.158:0/1725933664 conn(0x7f518009cf60 msgr2=0x7f51800ac2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:25.382 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:49:52.900870+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:49:55.801462+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:49:58.659250+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-12-05T03:50:25.383 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-12-05T03:50:25.490 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.476+0000 7fedba2e5700 1 Processor -- start 2019-12-05T03:50:25.490 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.480+0000 7fedba2e5700 1 -- start start 2019-12-05T03:50:25.491 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.480+0000 7fedba2e5700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fedb40b6970 0x7fedb409add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:25.491 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.480+0000 7fedba2e5700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb4099e30 con 0x7fedb40b5370 2019-12-05T03:50:25.491 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.480+0000 7fedba2e5700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb407e960 con 0x7fedb409ba40 2019-12-05T03:50:25.491 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.480+0000 7fedba2e5700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb409d210 con 0x7fedb40b6970 2019-12-05T03:50:25.491 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.480+0000 7fedb3fff700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fedb409ba40 0x7fedb405a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49154/0 (socket says 172.21.15.158:49154) 2019-12-05T03:50:25.491 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.480+0000 7fedb3fff700 1 -- 172.21.15.158:0/171770439 learned_addr learned my addr 172.21.15.158:0/171770439 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:25.491 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.480+0000 7fedb8882700 1 --2- 172.21.15.158:0/171770439 >> v2:172.21.15.96:3300/0 conn(0x7fedb40b6970 0x7fedb409add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:25.492 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.480+0000 7fedb37fe700 1 -- 172.21.15.158:0/171770439 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1092540751 0 0) 0x7fedb407e960 con 0x7fedb409ba40 2019-12-05T03:50:25.492 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.480+0000 7fedb37fe700 1 -- 172.21.15.158:0/171770439 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed940030b0 con 0x7fedb409ba40 2019-12-05T03:50:25.492 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.480+0000 7fedb8882700 1 -- 172.21.15.158:0/171770439 >> v1:172.21.15.158:6789/0 conn(0x7fedb409ba40 legacy=0x7fedb405a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:25.492 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.480+0000 7fedb8882700 1 -- 172.21.15.158:0/171770439 >> v1:172.21.15.96:6789/0 conn(0x7fedb40b5370 legacy=0x7fedb40b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:25.492 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.480+0000 7fedb37fe700 1 -- 172.21.15.158:0/171770439 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3359300803 0 0) 0x7fedb4099e30 con 0x7fedb40b5370 2019-12-05T03:50:25.492 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.480+0000 7fedb8882700 1 -- 172.21.15.158:0/171770439 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb40b5fa0 con 0x7fedb40b6970 2019-12-05T03:50:25.492 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.480+0000 7fedb8882700 1 --2- 172.21.15.158:0/171770439 >> v2:172.21.15.96:3300/0 conn(0x7fedb40b6970 0x7fedb409add0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7feda4001990 tx=0x7feda40014a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.493 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.480+0000 7fedb8882700 1 --2- 172.21.15.158:0/171770439 >> v2:172.21.15.96:3300/0 conn(0x7fedb40b6970 0x7fedb409add0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7feda4001990 tx=0x7feda40014a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.493 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.480+0000 7fedb8882700 1 --2- 172.21.15.158:0/171770439 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fedb40b6970 0x7fedb409add0 secure :-1 s=READY pgs=174 cs=0 l=1 rx=0x7feda4001990 tx=0x7feda40014a0).ready entity=mon.0 client_cookie=91eaba7ccb4a405a server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:25.493 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.480+0000 7fedb8882700 1 --2- 172.21.15.158:0/171770439 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fedb40b6970 0x7fedb409add0 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7feda4001990 tx=0x7feda40014a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.493 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.480+0000 7fedb37fe700 1 -- 172.21.15.158:0/171770439 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feda4001750 con 0x7fedb40b6970 2019-12-05T03:50:25.493 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.480+0000 7fedb8882700 1 --2- 172.21.15.158:0/171770439 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fedb40b6970 0x7fedb409add0 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7feda4001990 tx=0x7feda40014a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.493 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.480+0000 7fedb8882700 1 --2- 172.21.15.158:0/171770439 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fedb40b6970 0x7fedb409add0 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7feda4001990 tx=0x7feda40014a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.493 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.480+0000 7fedb37fe700 1 -- 172.21.15.158:0/171770439 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda4001560 con 0x7fedb40b6970 2019-12-05T03:50:25.494 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.480+0000 7fedb37fe700 1 -- 172.21.15.158:0/171770439 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed9c010a70 con 0x7fedb40b6970 2019-12-05T03:50:25.494 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.480+0000 7fedba2e5700 1 -- 172.21.15.158:0/171770439 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fedb40b6970 msgr2=0x7fedb409add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:25.494 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.480+0000 7fedba2e5700 1 --2- 172.21.15.158:0/171770439 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fedb40b6970 0x7fedb409add0 secure :-1 s=READY pgs=174 cs=0 l=1 rx=0x7feda4001990 tx=0x7feda40014a0).stop 2019-12-05T03:50:25.494 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.484+0000 7fedba2e5700 1 -- 172.21.15.158:0/171770439 shutdown_connections 2019-12-05T03:50:25.494 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.484+0000 7fedba2e5700 1 --2- 172.21.15.158:0/171770439 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fedb40b6970 0x7fedb409add0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:25.494 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.484+0000 7fedba2e5700 1 -- 172.21.15.158:0/171770439 shutdown_connections 2019-12-05T03:50:25.494 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.484+0000 7fedba2e5700 1 -- 172.21.15.158:0/171770439 wait complete. 2019-12-05T03:50:25.495 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.484+0000 7fedba2e5700 1 -- 172.21.15.158:0/171770439 >> 172.21.15.158:0/171770439 conn(0x7fedb40b7ef0 msgr2=0x7fedb40b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:25.498 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.484+0000 7fedba2e5700 1 Processor -- start 2019-12-05T03:50:25.498 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.484+0000 7fedba2e5700 1 -- start start 2019-12-05T03:50:25.498 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.488+0000 7fedba2e5700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fedb4153f90 0x7fedb4137810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:25.498 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.488+0000 7fedba2e5700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fedb4128600 0x7fedb4134050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:25.499 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.488+0000 7fedba2e5700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fedb41345a0 0x7fedb4098cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:25.499 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.488+0000 7fedba2e5700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb41543c0 con 0x7fedb4128600 2019-12-05T03:50:25.499 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.488+0000 7fedba2e5700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb4133870 con 0x7fedb4153f90 2019-12-05T03:50:25.499 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.488+0000 7fedba2e5700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb4133b10 con 0x7fedb41345a0 2019-12-05T03:50:25.499 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.488+0000 7fedb8882700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fedb4153f90 0x7fedb4137810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:25.500 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.488+0000 7fedb8882700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fedb4153f90 0x7fedb4137810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54380/0 (socket says 172.21.15.158:54380) 2019-12-05T03:50:25.500 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.488+0000 7fedb8882700 1 -- 172.21.15.158:0/174607855 learned_addr learned my addr 172.21.15.158:0/174607855 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:25.500 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.488+0000 7fedb3fff700 1 --2- 172.21.15.158:0/174607855 >> v2:172.21.15.96:3300/0 conn(0x7fedb4128600 0x7fedb4134050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:25.500 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.488+0000 7fedb9083700 1 --2- 172.21.15.158:0/174607855 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fedb41345a0 0x7fedb4098cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:25.500 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.488+0000 7fedb8882700 1 -- 172.21.15.158:0/174607855 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fedb41345a0 msgr2=0x7fedb4098cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:25.501 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.488+0000 7fedb8882700 1 --2- 172.21.15.158:0/174607855 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fedb41345a0 0x7fedb4098cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:25.501 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.488+0000 7fedb8882700 1 -- 172.21.15.158:0/174607855 >> v2:172.21.15.96:3300/0 conn(0x7fedb4128600 msgr2=0x7fedb4134050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:25.501 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.488+0000 7fedb8882700 1 --2- 172.21.15.158:0/174607855 >> v2:172.21.15.96:3300/0 conn(0x7fedb4128600 0x7fedb4134050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:25.501 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.488+0000 7fedb8882700 1 -- 172.21.15.158:0/174607855 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb4128a30 con 0x7fedb4153f90 2019-12-05T03:50:25.501 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.488+0000 7fedb8882700 1 --2- 172.21.15.158:0/174607855 >> v2:172.21.15.158:3300/0 conn(0x7fedb4153f90 0x7fedb4137810 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fedb40b4880 tx=0x7fed9c010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.502 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.488+0000 7fedb8882700 1 --2- 172.21.15.158:0/174607855 >> v2:172.21.15.158:3300/0 conn(0x7fedb4153f90 0x7fedb4137810 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fedb40b4880 tx=0x7fed9c010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.502 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.488+0000 7fedb8882700 1 --2- 172.21.15.158:0/174607855 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fedb4153f90 0x7fedb4137810 secure :-1 s=READY pgs=241 cs=0 l=1 rx=0x7fedb40b4880 tx=0x7fed9c010980).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:25.502 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.488+0000 7fedb8882700 1 --2- 172.21.15.158:0/174607855 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fedb4153f90 0x7fedb4137810 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7fedb40b4880 tx=0x7fed9c010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.502 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.488+0000 7fedb8882700 1 --2- 172.21.15.158:0/174607855 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fedb4153f90 0x7fedb4137810 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7fedb40b4880 tx=0x7fed9c010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.503 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.488+0000 7fedb8882700 1 --2- 172.21.15.158:0/174607855 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fedb4153f90 0x7fedb4137810 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7fedb40b4880 tx=0x7fed9c010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.503 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.488+0000 7fedb17fa700 1 -- 172.21.15.158:0/174607855 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed9c0058c0 con 0x7fedb4153f90 2019-12-05T03:50:25.504 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.488+0000 7fedb17fa700 1 -- 172.21.15.158:0/174607855 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9c010690 con 0x7fedb4153f90 2019-12-05T03:50:25.504 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.488+0000 7fedba2e5700 1 -- 172.21.15.158:0/174607855 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb4099200 con 0x7fedb4153f90 2019-12-05T03:50:25.504 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.488+0000 7fedb17fa700 1 -- 172.21.15.158:0/174607855 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed9c007160 con 0x7fedb4153f90 2019-12-05T03:50:25.505 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.488+0000 7fedba2e5700 1 -- 172.21.15.158:0/174607855 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb40acc30 con 0x7fedb4153f90 2019-12-05T03:50:25.505 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.492+0000 7fedb8882700 1 --2- 172.21.15.158:0/174607855 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fedb4153f90 0x7fedb4137810 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7fedb40b4880 tx=0x7fed9c010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.507 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.492+0000 7fedb17fa700 1 -- 172.21.15.158:0/174607855 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fed9c008cf0 con 0x7fedb4153f90 2019-12-05T03:50:25.509 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.492+0000 7fedb8882700 1 --2- 172.21.15.158:0/174607855 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fedb4153f90 0x7fedb4137810 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7fedb40b4880 tx=0x7fed9c010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.509 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.492+0000 7fedb17fa700 1 --2- 172.21.15.158:0/174607855 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fed8c03ad60 0x7fed8c03d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:25.510 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.492+0000 7fedb17fa700 1 -- 172.21.15.158:0/174607855 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fed9c04af60 con 0x7fedb4153f90 2019-12-05T03:50:25.510 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.492+0000 7fedb3fff700 1 --2- 172.21.15.158:0/174607855 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fed8c03ad60 0x7fed8c03d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:25.510 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.492+0000 7fedb3fff700 1 --2- 172.21.15.158:0/174607855 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fed8c03ad60 0x7fed8c03d270 crc :-1 s=READY pgs=114 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:25.510 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.496+0000 7fedba2e5700 1 -- 172.21.15.158:0/174607855 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb40554e0 con 0x7fedb4153f90 2019-12-05T03:50:25.511 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.500+0000 7fedb8882700 1 --2- 172.21.15.158:0/174607855 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fedb4153f90 0x7fedb4137810 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7fedb40b4880 tx=0x7fed9c010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.511 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.500+0000 7fedb17fa700 1 -- 172.21.15.158:0/174607855 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fed9c031fe0 con 0x7fedb4153f90 2019-12-05T03:50:25.663 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.656+0000 7fedba2e5700 1 -- 172.21.15.158:0/174607855 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fedb40998d0 con 0x7fedb4153f90 2019-12-05T03:50:25.664 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.656+0000 7fedb8882700 1 --2- 172.21.15.158:0/174607855 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fedb4153f90 0x7fedb4137810 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7fedb40b4880 tx=0x7fed9c010980).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.664 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.656+0000 7fedb17fa700 1 -- 172.21.15.158:0/174607855 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fed9c032240 con 0x7fedb4153f90 2019-12-05T03:50:25.664 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:50:25.666 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.660+0000 7fedba2e5700 1 -- 172.21.15.158:0/174607855 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fed8c03ad60 msgr2=0x7fed8c03d270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:25.666 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.660+0000 7fedba2e5700 1 --2- 172.21.15.158:0/174607855 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fed8c03ad60 0x7fed8c03d270 crc :-1 s=READY pgs=114 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:25.667 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.660+0000 7fedba2e5700 1 -- 172.21.15.158:0/174607855 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fedb4153f90 msgr2=0x7fedb4137810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:25.667 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.660+0000 7fedba2e5700 1 --2- 172.21.15.158:0/174607855 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fedb4153f90 0x7fedb4137810 secure :-1 s=READY pgs=241 cs=0 l=1 rx=0x7fedb40b4880 tx=0x7fed9c010980).stop 2019-12-05T03:50:25.667 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.660+0000 7fedba2e5700 1 -- 172.21.15.158:0/174607855 shutdown_connections 2019-12-05T03:50:25.667 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.660+0000 7fedba2e5700 1 --2- 172.21.15.158:0/174607855 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fed8c03ad60 0x7fed8c03d270 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:25.667 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.660+0000 7fedba2e5700 1 --2- 172.21.15.158:0/174607855 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fedb41345a0 0x7fedb4098cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:25.667 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.660+0000 7fedba2e5700 1 --2- 172.21.15.158:0/174607855 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fedb4153f90 0x7fedb4137810 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:25.668 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.660+0000 7fedba2e5700 1 --2- 172.21.15.158:0/174607855 >> v2:172.21.15.96:3300/0 conn(0x7fedb4128600 0x7fedb4134050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:25.668 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.660+0000 7fedba2e5700 1 -- 172.21.15.158:0/174607855 shutdown_connections 2019-12-05T03:50:25.668 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.660+0000 7fedba2e5700 1 -- 172.21.15.158:0/174607855 wait complete. 2019-12-05T03:50:25.668 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.660+0000 7fedba2e5700 1 -- 172.21.15.158:0/174607855 >> 172.21.15.158:0/174607855 conn(0x7fedb405a500 msgr2=0x7fedb40b3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:25.676 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-12-05T03:50:25.777 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.764+0000 7f430e181700 1 Processor -- start 2019-12-05T03:50:25.777 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.764+0000 7f430e181700 1 -- start start 2019-12-05T03:50:25.777 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.764+0000 7f430e181700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f430809ba40 0x7f430809add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:25.777 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.764+0000 7f430e181700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4308099e30 con 0x7f43080b5370 2019-12-05T03:50:25.777 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.764+0000 7f430e181700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f430807e960 con 0x7f43080b6970 2019-12-05T03:50:25.778 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.764+0000 7f430e181700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f430809d210 con 0x7f430809ba40 2019-12-05T03:50:25.778 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.764+0000 7f4307fff700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f43080b6970 0x7f430805a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49168/0 (socket says 172.21.15.158:49168) 2019-12-05T03:50:25.778 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.764+0000 7f4307fff700 1 -- 172.21.15.158:0/3473294336 learned_addr learned my addr 172.21.15.158:0/3473294336 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:25.778 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.764+0000 7f43077fe700 1 --2- 172.21.15.158:0/3473294336 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f430809ba40 0x7f430809add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:25.778 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.764+0000 7f4306ffd700 1 -- 172.21.15.158:0/3473294336 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1099120227 0 0) 0x7f430807e960 con 0x7f43080b6970 2019-12-05T03:50:25.778 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.768+0000 7f4306ffd700 1 -- 172.21.15.158:0/3473294336 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42f00030b0 con 0x7f43080b6970 2019-12-05T03:50:25.778 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.768+0000 7f4306ffd700 1 -- 172.21.15.158:0/3473294336 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1776380723 0 0) 0x7f4308099e30 con 0x7f43080b5370 2019-12-05T03:50:25.779 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.768+0000 7f4306ffd700 1 -- 172.21.15.158:0/3473294336 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f430807e960 con 0x7f43080b5370 2019-12-05T03:50:25.779 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.768+0000 7f43077fe700 1 -- 172.21.15.158:0/3473294336 >> v1:172.21.15.158:6789/0 conn(0x7f43080b6970 legacy=0x7f430805a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:25.779 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.768+0000 7f43077fe700 1 -- 172.21.15.158:0/3473294336 >> v1:172.21.15.96:6789/0 conn(0x7f43080b5370 legacy=0x7f43080b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:25.779 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.768+0000 7f43077fe700 1 -- 172.21.15.158:0/3473294336 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43080b5fa0 con 0x7f430809ba40 2019-12-05T03:50:25.779 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.768+0000 7f43077fe700 1 --2- 172.21.15.158:0/3473294336 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f430809ba40 0x7f430809add0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f42fc002f30 tx=0x7f42fc00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.779 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.768+0000 7f43077fe700 1 --2- 172.21.15.158:0/3473294336 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f430809ba40 0x7f430809add0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f42fc002f30 tx=0x7f42fc00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.779 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.768+0000 7f43077fe700 1 --2- 172.21.15.158:0/3473294336 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f430809ba40 0x7f430809add0 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7f42fc002f30 tx=0x7f42fc00fbf0).ready entity=mon.2 client_cookie=36181b6878ff207e server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:25.780 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.768+0000 7f43077fe700 1 --2- 172.21.15.158:0/3473294336 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f430809ba40 0x7f430809add0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f42fc002f30 tx=0x7f42fc00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.780 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.768+0000 7f4306ffd700 1 -- 172.21.15.158:0/3473294336 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42fc008bb0 con 0x7f430809ba40 2019-12-05T03:50:25.780 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.768+0000 7f43077fe700 1 --2- 172.21.15.158:0/3473294336 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f430809ba40 0x7f430809add0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f42fc002f30 tx=0x7f42fc00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.780 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.768+0000 7f4306ffd700 1 -- 172.21.15.158:0/3473294336 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42fc0087d0 con 0x7f430809ba40 2019-12-05T03:50:25.780 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.768+0000 7f43077fe700 1 --2- 172.21.15.158:0/3473294336 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f430809ba40 0x7f430809add0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f42fc002f30 tx=0x7f42fc00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.780 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.768+0000 7f4306ffd700 1 -- 172.21.15.158:0/3473294336 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42fc011910 con 0x7f430809ba40 2019-12-05T03:50:25.780 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.768+0000 7f430e181700 1 -- 172.21.15.158:0/3473294336 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f430809ba40 msgr2=0x7f430809add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:25.781 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.768+0000 7f430e181700 1 --2- 172.21.15.158:0/3473294336 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f430809ba40 0x7f430809add0 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7f42fc002f30 tx=0x7f42fc00fbf0).stop 2019-12-05T03:50:25.781 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.768+0000 7f430e181700 1 -- 172.21.15.158:0/3473294336 shutdown_connections 2019-12-05T03:50:25.781 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.768+0000 7f430e181700 1 --2- 172.21.15.158:0/3473294336 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f430809ba40 0x7f430809add0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:25.781 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.768+0000 7f430e181700 1 -- 172.21.15.158:0/3473294336 shutdown_connections 2019-12-05T03:50:25.781 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.768+0000 7f430e181700 1 -- 172.21.15.158:0/3473294336 wait complete. 2019-12-05T03:50:25.781 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.768+0000 7f430e181700 1 -- 172.21.15.158:0/3473294336 >> 172.21.15.158:0/3473294336 conn(0x7f43080b7ef0 msgr2=0x7f43080b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:25.785 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.772+0000 7f430e181700 1 Processor -- start 2019-12-05T03:50:25.785 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.772+0000 7f430e181700 1 -- start start 2019-12-05T03:50:25.785 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.772+0000 7f430e181700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f430807b950 0x7f43080b3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:25.785 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.772+0000 7f430e181700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f43080ac2d0 0x7f4308137110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:25.785 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.772+0000 7f430e181700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f430807dd50 con 0x7f43080b4490 2019-12-05T03:50:25.786 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.772+0000 7f430e181700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f430812d3d0 con 0x7f43080ac2d0 2019-12-05T03:50:25.786 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.772+0000 7f430e181700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f430812d590 con 0x7f430807b950 2019-12-05T03:50:25.786 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.772+0000 7f430cf1f700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f43080ac2d0 0x7f4308137110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:25.786 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.772+0000 7f430cf1f700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f43080ac2d0 0x7f4308137110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54394/0 (socket says 172.21.15.158:54394) 2019-12-05T03:50:25.786 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.772+0000 7f430cf1f700 1 -- 172.21.15.158:0/2738923782 learned_addr learned my addr 172.21.15.158:0/2738923782 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:25.786 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.772+0000 7f4307fff700 1 --2- 172.21.15.158:0/2738923782 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f430807b950 0x7f43080b3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:25.786 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.772+0000 7f430cf1f700 1 -- 172.21.15.158:0/2738923782 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f430807b950 msgr2=0x7f43080b3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:25.787 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.772+0000 7f430cf1f700 1 --2- 172.21.15.158:0/2738923782 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f430807b950 0x7f43080b3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:25.787 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.772+0000 7f430cf1f700 1 -- 172.21.15.158:0/2738923782 >> v1:172.21.15.96:6789/0 conn(0x7f43080b4490 legacy=0x7f4308136910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:25.787 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.772+0000 7f430cf1f700 1 -- 172.21.15.158:0/2738923782 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4308141110 con 0x7f43080ac2d0 2019-12-05T03:50:25.787 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.772+0000 7f430cf1f700 1 --2- 172.21.15.158:0/2738923782 >> v2:172.21.15.158:3300/0 conn(0x7f43080ac2d0 0x7f4308137110 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4300001210 tx=0x7f4300010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.787 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.772+0000 7f430cf1f700 1 --2- 172.21.15.158:0/2738923782 >> v2:172.21.15.158:3300/0 conn(0x7f43080ac2d0 0x7f4308137110 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4300001210 tx=0x7f4300010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.787 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.772+0000 7f430cf1f700 1 --2- 172.21.15.158:0/2738923782 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f43080ac2d0 0x7f4308137110 secure :-1 s=READY pgs=243 cs=0 l=1 rx=0x7f4300001210 tx=0x7f4300010b20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:25.787 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.772+0000 7f430cf1f700 1 --2- 172.21.15.158:0/2738923782 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f43080ac2d0 0x7f4308137110 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f4300001210 tx=0x7f4300010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.788 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.772+0000 7f430cf1f700 1 --2- 172.21.15.158:0/2738923782 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f43080ac2d0 0x7f4308137110 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f4300001210 tx=0x7f4300010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.788 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.772+0000 7f4304ff9700 1 -- 172.21.15.158:0/2738923782 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4300006bb0 con 0x7f43080ac2d0 2019-12-05T03:50:25.788 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.772+0000 7f430cf1f700 1 --2- 172.21.15.158:0/2738923782 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f43080ac2d0 0x7f4308137110 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f4300001210 tx=0x7f4300010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.788 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.772+0000 7f4304ff9700 1 -- 172.21.15.158:0/2738923782 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43000067d0 con 0x7f43080ac2d0 2019-12-05T03:50:25.789 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.772+0000 7f4304ff9700 1 -- 172.21.15.158:0/2738923782 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43000123d0 con 0x7f43080ac2d0 2019-12-05T03:50:25.789 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.772+0000 7f430e181700 1 -- 172.21.15.158:0/2738923782 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4308139ed0 con 0x7f43080ac2d0 2019-12-05T03:50:25.789 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.772+0000 7f430e181700 1 -- 172.21.15.158:0/2738923782 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f430813a400 con 0x7f43080ac2d0 2019-12-05T03:50:25.794 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.776+0000 7f430cf1f700 1 --2- 172.21.15.158:0/2738923782 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f43080ac2d0 0x7f4308137110 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f4300001210 tx=0x7f4300010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.795 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.776+0000 7f4304ff9700 1 -- 172.21.15.158:0/2738923782 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f43000126e0 con 0x7f43080ac2d0 2019-12-05T03:50:25.795 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.776+0000 7f430cf1f700 1 --2- 172.21.15.158:0/2738923782 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f43080ac2d0 0x7f4308137110 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f4300001210 tx=0x7f4300010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.795 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.776+0000 7f4304ff9700 1 --2- 172.21.15.158:0/2738923782 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f42e803ae10 0x7f42e803d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:25.795 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.776+0000 7f4304ff9700 1 -- 172.21.15.158:0/2738923782 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f430004b390 con 0x7f43080ac2d0 2019-12-05T03:50:25.795 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.776+0000 7f4307fff700 1 --2- 172.21.15.158:0/2738923782 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f42e803ae10 0x7f42e803d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:25.795 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.776+0000 7f4307fff700 1 --2- 172.21.15.158:0/2738923782 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f42e803ae10 0x7f42e803d320 crc :-1 s=READY pgs=115 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:25.796 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.780+0000 7f430e181700 1 -- 172.21.15.158:0/2738923782 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43080554e0 con 0x7f43080ac2d0 2019-12-05T03:50:25.796 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.784+0000 7f430cf1f700 1 --2- 172.21.15.158:0/2738923782 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f43080ac2d0 0x7f4308137110 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f4300001210 tx=0x7f4300010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.797 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.784+0000 7f4304ff9700 1 -- 172.21.15.158:0/2738923782 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f4300032410 con 0x7f43080ac2d0 2019-12-05T03:50:25.946 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.940+0000 7f430e181700 1 -- 172.21.15.158:0/2738923782 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f4308066940 con 0x7f43080ac2d0 2019-12-05T03:50:25.948 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.940+0000 7f430cf1f700 1 --2- 172.21.15.158:0/2738923782 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f43080ac2d0 0x7f4308137110 secure :-1 s=THROTTLE_DONE pgs=243 cs=0 l=1 rx=0x7f4300001210 tx=0x7f4300010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:25.948 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.940+0000 7f4304ff9700 1 -- 172.21.15.158:0/2738923782 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7f4300032670 con 0x7f43080ac2d0 2019-12-05T03:50:25.948 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:50:25.950 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.944+0000 7f430e181700 1 -- 172.21.15.158:0/2738923782 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f42e803ae10 msgr2=0x7f42e803d320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:25.951 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.944+0000 7f430e181700 1 --2- 172.21.15.158:0/2738923782 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f42e803ae10 0x7f42e803d320 crc :-1 s=READY pgs=115 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:25.951 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.944+0000 7f430e181700 1 -- 172.21.15.158:0/2738923782 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f43080ac2d0 msgr2=0x7f4308137110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:25.951 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.944+0000 7f430e181700 1 --2- 172.21.15.158:0/2738923782 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f43080ac2d0 0x7f4308137110 secure :-1 s=READY pgs=243 cs=0 l=1 rx=0x7f4300001210 tx=0x7f4300010b20).stop 2019-12-05T03:50:25.951 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.944+0000 7f430e181700 1 -- 172.21.15.158:0/2738923782 shutdown_connections 2019-12-05T03:50:25.951 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.944+0000 7f430e181700 1 --2- 172.21.15.158:0/2738923782 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f43080ac2d0 0x7f4308137110 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:25.951 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.944+0000 7f430e181700 1 --2- 172.21.15.158:0/2738923782 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f430807b950 0x7f43080b3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:25.952 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.944+0000 7f430e181700 1 --2- 172.21.15.158:0/2738923782 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f42e803ae10 0x7f42e803d320 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:25.952 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.944+0000 7f430e181700 1 -- 172.21.15.158:0/2738923782 shutdown_connections 2019-12-05T03:50:25.952 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.944+0000 7f430e181700 1 -- 172.21.15.158:0/2738923782 wait complete. 2019-12-05T03:50:25.952 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:25.944+0000 7f430e181700 1 -- 172.21.15.158:0/2738923782 >> 172.21.15.158:0/2738923782 conn(0x7f43080b1480 msgr2=0x7f430809a320 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:25.963 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-12-05T03:50:26.057 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.044+0000 7f5b3aea3700 1 Processor -- start 2019-12-05T03:50:26.057 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.044+0000 7f5b3aea3700 1 -- start start 2019-12-05T03:50:26.058 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.048+0000 7f5b3aea3700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5b340b6970 0x7f5b3409add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:26.058 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.048+0000 7f5b3aea3700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b34099e30 con 0x7f5b3409ba40 2019-12-05T03:50:26.058 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.048+0000 7f5b3aea3700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b3407e960 con 0x7f5b340b5370 2019-12-05T03:50:26.058 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.048+0000 7f5b3aea3700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b3409d210 con 0x7f5b340b6970 2019-12-05T03:50:26.058 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.048+0000 7f5b39440700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5b340b6970 0x7f5b3409add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:26.058 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.048+0000 7f5b39440700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5b340b6970 0x7f5b3409add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54402/0 (socket says 172.21.15.158:54402) 2019-12-05T03:50:26.059 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.048+0000 7f5b39440700 1 -- 172.21.15.158:0/1072441067 learned_addr learned my addr 172.21.15.158:0/1072441067 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:26.059 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.048+0000 7f5b39440700 1 -- 172.21.15.158:0/1072441067 >> v1:172.21.15.158:6789/0 conn(0x7f5b340b5370 legacy=0x7f5b340b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:26.059 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.048+0000 7f5b39440700 1 -- 172.21.15.158:0/1072441067 >> v1:172.21.15.96:6789/0 conn(0x7f5b3409ba40 legacy=0x7f5b3405a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:26.059 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.048+0000 7f5b39440700 1 -- 172.21.15.158:0/1072441067 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b340b5fa0 con 0x7f5b340b6970 2019-12-05T03:50:26.059 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.048+0000 7f5b39440700 1 --2- 172.21.15.158:0/1072441067 >> v2:172.21.15.158:3300/0 conn(0x7f5b340b6970 0x7f5b3409add0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5b28002f30 tx=0x7f5b2800fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.059 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.048+0000 7f5b39440700 1 --2- 172.21.15.158:0/1072441067 >> v2:172.21.15.158:3300/0 conn(0x7f5b340b6970 0x7f5b3409add0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5b28002f30 tx=0x7f5b2800fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.060 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.048+0000 7f5b39440700 1 --2- 172.21.15.158:0/1072441067 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5b340b6970 0x7f5b3409add0 secure :-1 s=READY pgs=245 cs=0 l=1 rx=0x7f5b28002f30 tx=0x7f5b2800fcb0).ready entity=mon.1 client_cookie=9813a17981504128 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:26.060 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.048+0000 7f5b39440700 1 --2- 172.21.15.158:0/1072441067 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5b340b6970 0x7f5b3409add0 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f5b28002f30 tx=0x7f5b2800fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.060 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.048+0000 7f5b39440700 1 --2- 172.21.15.158:0/1072441067 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5b340b6970 0x7f5b3409add0 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f5b28002f30 tx=0x7f5b2800fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.060 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.048+0000 7f5b27fff700 1 -- 172.21.15.158:0/1072441067 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b28008c90 con 0x7f5b340b6970 2019-12-05T03:50:26.060 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.048+0000 7f5b39440700 1 --2- 172.21.15.158:0/1072441067 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5b340b6970 0x7f5b3409add0 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f5b28002f30 tx=0x7f5b2800fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.061 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.048+0000 7f5b27fff700 1 -- 172.21.15.158:0/1072441067 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b280088b0 con 0x7f5b340b6970 2019-12-05T03:50:26.061 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.048+0000 7f5b27fff700 1 -- 172.21.15.158:0/1072441067 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b28011b40 con 0x7f5b340b6970 2019-12-05T03:50:26.061 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.048+0000 7f5b3aea3700 1 -- 172.21.15.158:0/1072441067 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5b340b6970 msgr2=0x7f5b3409add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:26.061 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.048+0000 7f5b3aea3700 1 --2- 172.21.15.158:0/1072441067 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5b340b6970 0x7f5b3409add0 secure :-1 s=READY pgs=245 cs=0 l=1 rx=0x7f5b28002f30 tx=0x7f5b2800fcb0).stop 2019-12-05T03:50:26.061 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.048+0000 7f5b3aea3700 1 -- 172.21.15.158:0/1072441067 shutdown_connections 2019-12-05T03:50:26.061 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.048+0000 7f5b3aea3700 1 --2- 172.21.15.158:0/1072441067 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5b340b6970 0x7f5b3409add0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:26.062 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.048+0000 7f5b3aea3700 1 -- 172.21.15.158:0/1072441067 shutdown_connections 2019-12-05T03:50:26.062 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.048+0000 7f5b3aea3700 1 -- 172.21.15.158:0/1072441067 wait complete. 2019-12-05T03:50:26.062 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.048+0000 7f5b3aea3700 1 -- 172.21.15.158:0/1072441067 >> 172.21.15.158:0/1072441067 conn(0x7f5b340b7ef0 msgr2=0x7f5b340b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:26.066 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.052+0000 7f5b3aea3700 1 Processor -- start 2019-12-05T03:50:26.066 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.052+0000 7f5b3aea3700 1 -- start start 2019-12-05T03:50:26.067 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.052+0000 7f5b3aea3700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5b341552d0 0x7f5b34123bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:26.067 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.052+0000 7f5b3aea3700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5b340b0a70 0x7f5b340b0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:26.067 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.052+0000 7f5b3aea3700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b340b13f0 con 0x7f5b340ad820 2019-12-05T03:50:26.067 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.052+0000 7f5b3aea3700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b34124810 con 0x7f5b340b0a70 2019-12-05T03:50:26.067 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.052+0000 7f5b3aea3700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b34124140 con 0x7f5b341552d0 2019-12-05T03:50:26.067 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.052+0000 7f5b39440700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f5b340ad820 0x7f5b340acda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49190/0 (socket says 172.21.15.158:49190) 2019-12-05T03:50:26.068 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.052+0000 7f5b39440700 1 -- 172.21.15.158:0/3123535531 learned_addr learned my addr 172.21.15.158:0/3123535531 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:26.068 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.052+0000 7f5b39c41700 1 --2- 172.21.15.158:0/3123535531 >> v2:172.21.15.96:3300/0 conn(0x7f5b340b0a70 0x7f5b340b0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:26.068 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.052+0000 7f5b38c3f700 1 --2- 172.21.15.158:0/3123535531 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5b341552d0 0x7f5b34123bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:26.068 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.052+0000 7f5b25ffb700 1 -- 172.21.15.158:0/3123535531 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4143687192 0 0) 0x7f5b340b13f0 con 0x7f5b340ad820 2019-12-05T03:50:26.068 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.052+0000 7f5b25ffb700 1 -- 172.21.15.158:0/3123535531 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b140030b0 con 0x7f5b340ad820 2019-12-05T03:50:26.068 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.052+0000 7f5b25ffb700 1 -- 172.21.15.158:0/3123535531 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2781171660 0 0) 0x7f5b140030b0 con 0x7f5b340ad820 2019-12-05T03:50:26.069 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.052+0000 7f5b25ffb700 1 -- 172.21.15.158:0/3123535531 --> v1:172.21.15.158:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5b340b13f0 con 0x7f5b340ad820 2019-12-05T03:50:26.069 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.052+0000 7f5b25ffb700 1 -- 172.21.15.158:0/3123535531 <== mon.1 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 828730332 0 0) 0x7f5b28008470 con 0x7f5b340ad820 2019-12-05T03:50:26.069 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.052+0000 7f5b39c41700 1 -- 172.21.15.158:0/3123535531 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5b341552d0 msgr2=0x7f5b34123bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:26.069 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.052+0000 7f5b39c41700 1 --2- 172.21.15.158:0/3123535531 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5b341552d0 0x7f5b34123bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:26.069 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.052+0000 7f5b39c41700 1 -- 172.21.15.158:0/3123535531 >> v1:172.21.15.158:6789/0 conn(0x7f5b340ad820 legacy=0x7f5b340acda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:26.070 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.052+0000 7f5b39c41700 1 -- 172.21.15.158:0/3123535531 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b34155700 con 0x7f5b340b0a70 2019-12-05T03:50:26.070 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.052+0000 7f5b38c3f700 1 --2- 172.21.15.158:0/3123535531 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5b341552d0 0x7f5b34123bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:50:26.070 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.052+0000 7f5b39c41700 1 --2- 172.21.15.158:0/3123535531 >> v2:172.21.15.96:3300/0 conn(0x7f5b340b0a70 0x7f5b340b0ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5b2c001210 tx=0x7f5b280082d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.070 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.052+0000 7f5b39c41700 1 --2- 172.21.15.158:0/3123535531 >> v2:172.21.15.96:3300/0 conn(0x7f5b340b0a70 0x7f5b340b0ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5b2c001210 tx=0x7f5b280082d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.070 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.052+0000 7f5b39c41700 1 --2- 172.21.15.158:0/3123535531 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b340b0a70 0x7f5b340b0ea0 secure :-1 s=READY pgs=178 cs=0 l=1 rx=0x7f5b2c001210 tx=0x7f5b280082d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:26.071 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.052+0000 7f5b39c41700 1 --2- 172.21.15.158:0/3123535531 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b340b0a70 0x7f5b340b0ea0 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7f5b2c001210 tx=0x7f5b280082d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.071 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.052+0000 7f5b25ffb700 1 -- 172.21.15.158:0/3123535531 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b2c006bb0 con 0x7f5b340b0a70 2019-12-05T03:50:26.071 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.052+0000 7f5b3aea3700 1 -- 172.21.15.158:0/3123535531 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b340ae4f0 con 0x7f5b340b0a70 2019-12-05T03:50:26.071 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.052+0000 7f5b39c41700 1 --2- 172.21.15.158:0/3123535531 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b340b0a70 0x7f5b340b0ea0 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7f5b2c001210 tx=0x7f5b280082d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.071 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.052+0000 7f5b25ffb700 1 -- 172.21.15.158:0/3123535531 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2c0067d0 con 0x7f5b340b0a70 2019-12-05T03:50:26.071 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.052+0000 7f5b39c41700 1 --2- 172.21.15.158:0/3123535531 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b340b0a70 0x7f5b340b0ea0 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7f5b2c001210 tx=0x7f5b280082d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.072 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.052+0000 7f5b25ffb700 1 -- 172.21.15.158:0/3123535531 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b2c002410 con 0x7f5b340b0a70 2019-12-05T03:50:26.072 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.052+0000 7f5b3aea3700 1 -- 172.21.15.158:0/3123535531 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b341383c0 con 0x7f5b340b0a70 2019-12-05T03:50:26.072 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.056+0000 7f5b39c41700 1 --2- 172.21.15.158:0/3123535531 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b340b0a70 0x7f5b340b0ea0 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7f5b2c001210 tx=0x7f5b280082d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.072 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.056+0000 7f5b25ffb700 1 -- 172.21.15.158:0/3123535531 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f5b2c002730 con 0x7f5b340b0a70 2019-12-05T03:50:26.072 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.056+0000 7f5b39c41700 1 --2- 172.21.15.158:0/3123535531 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b340b0a70 0x7f5b340b0ea0 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7f5b2c001210 tx=0x7f5b280082d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.073 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.056+0000 7f5b25ffb700 1 --2- 172.21.15.158:0/3123535531 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f5b1403b5d0 0x7f5b1403dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:26.073 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.056+0000 7f5b25ffb700 1 -- 172.21.15.158:0/3123535531 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f5b2c04b0e0 con 0x7f5b340b0a70 2019-12-05T03:50:26.073 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.056+0000 7f5b39440700 1 --2- 172.21.15.158:0/3123535531 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f5b1403b5d0 0x7f5b1403dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:26.073 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.056+0000 7f5b39440700 1 --2- 172.21.15.158:0/3123535531 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f5b1403b5d0 0x7f5b1403dae0 crc :-1 s=READY pgs=116 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:26.074 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.060+0000 7f5b3aea3700 1 -- 172.21.15.158:0/3123535531 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b340554e0 con 0x7f5b340b0a70 2019-12-05T03:50:26.077 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.068+0000 7f5b39c41700 1 --2- 172.21.15.158:0/3123535531 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b340b0a70 0x7f5b340b0ea0 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7f5b2c001210 tx=0x7f5b280082d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.077 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.068+0000 7f5b25ffb700 1 -- 172.21.15.158:0/3123535531 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f5b2c032140 con 0x7f5b340b0a70 2019-12-05T03:50:26.239 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.232+0000 7f5b3aea3700 1 -- 172.21.15.158:0/3123535531 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f5b34066940 con 0x7f5b340b0a70 2019-12-05T03:50:26.240 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.232+0000 7f5b39c41700 1 --2- 172.21.15.158:0/3123535531 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b340b0a70 0x7f5b340b0ea0 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7f5b2c001210 tx=0x7f5b280082d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.240 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.232+0000 7f5b25ffb700 1 -- 172.21.15.158:0/3123535531 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7f5b2c0323a0 con 0x7f5b340b0a70 2019-12-05T03:50:26.240 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:50:26.243 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.236+0000 7f5b3aea3700 1 -- 172.21.15.158:0/3123535531 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f5b1403b5d0 msgr2=0x7f5b1403dae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:26.243 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.236+0000 7f5b3aea3700 1 --2- 172.21.15.158:0/3123535531 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f5b1403b5d0 0x7f5b1403dae0 crc :-1 s=READY pgs=116 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:26.243 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.236+0000 7f5b3aea3700 1 -- 172.21.15.158:0/3123535531 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b340b0a70 msgr2=0x7f5b340b0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:26.243 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.236+0000 7f5b3aea3700 1 --2- 172.21.15.158:0/3123535531 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b340b0a70 0x7f5b340b0ea0 secure :-1 s=READY pgs=178 cs=0 l=1 rx=0x7f5b2c001210 tx=0x7f5b280082d0).stop 2019-12-05T03:50:26.243 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.236+0000 7f5b3aea3700 1 -- 172.21.15.158:0/3123535531 shutdown_connections 2019-12-05T03:50:26.244 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.236+0000 7f5b3aea3700 1 --2- 172.21.15.158:0/3123535531 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f5b1403b5d0 0x7f5b1403dae0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:26.244 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.236+0000 7f5b3aea3700 1 --2- 172.21.15.158:0/3123535531 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5b340b0a70 0x7f5b340b0ea0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:26.244 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.236+0000 7f5b3aea3700 1 --2- 172.21.15.158:0/3123535531 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5b341552d0 0x7f5b34123bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:26.244 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.236+0000 7f5b3aea3700 1 -- 172.21.15.158:0/3123535531 shutdown_connections 2019-12-05T03:50:26.244 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.236+0000 7f5b3aea3700 1 -- 172.21.15.158:0/3123535531 wait complete. 2019-12-05T03:50:26.244 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.236+0000 7f5b3aea3700 1 -- 172.21.15.158:0/3123535531 >> 172.21.15.158:0/3123535531 conn(0x7f5b3405a910 msgr2=0x7f5b3409a320 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:26.252 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-05T03:50:26.351 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.336+0000 7ff318dbb700 1 Processor -- start 2019-12-05T03:50:26.351 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.336+0000 7ff318dbb700 1 -- start start 2019-12-05T03:50:26.352 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.340+0000 7ff318dbb700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff31409cf50 0x7ff31409a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:26.352 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.340+0000 7ff318dbb700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff31405a730 0x7ff314151450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:26.352 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.340+0000 7ff318dbb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff3141519a0 0x7ff3140b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:26.352 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.340+0000 7ff318dbb700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3140b1720 con 0x7ff31409cf50 2019-12-05T03:50:26.352 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.340+0000 7ff318dbb700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3140b19c0 con 0x7ff3141519a0 2019-12-05T03:50:26.353 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.340+0000 7ff318dbb700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff31405ab60 con 0x7ff31405a730 2019-12-05T03:50:26.353 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.340+0000 7ff31359e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff3141519a0 0x7ff3140b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:26.353 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.340+0000 7ff31359e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff3141519a0 0x7ff3140b52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54420/0 (socket says 172.21.15.158:54420) 2019-12-05T03:50:26.353 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.340+0000 7ff31359e700 1 -- 172.21.15.158:0/353594350 learned_addr learned my addr 172.21.15.158:0/353594350 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:26.353 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.340+0000 7ff312d9d700 1 --2- 172.21.15.158:0/353594350 >> v2:172.21.15.96:3300/0 conn(0x7ff31409cf50 0x7ff31409a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:26.354 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.340+0000 7ff31259c700 1 --2- 172.21.15.158:0/353594350 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff31405a730 0x7ff314151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:26.354 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.340+0000 7ff31359e700 1 -- 172.21.15.158:0/353594350 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff31405a730 msgr2=0x7ff314151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:26.354 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.340+0000 7ff31359e700 1 --2- 172.21.15.158:0/353594350 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff31405a730 0x7ff314151450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:26.354 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.340+0000 7ff31359e700 1 -- 172.21.15.158:0/353594350 >> v2:172.21.15.96:3300/0 conn(0x7ff31409cf50 msgr2=0x7ff31409a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:26.354 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.340+0000 7ff31359e700 1 --2- 172.21.15.158:0/353594350 >> v2:172.21.15.96:3300/0 conn(0x7ff31409cf50 0x7ff31409a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:26.354 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.340+0000 7ff31359e700 1 -- 172.21.15.158:0/353594350 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3140acca0 con 0x7ff3141519a0 2019-12-05T03:50:26.355 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.340+0000 7ff31359e700 1 --2- 172.21.15.158:0/353594350 >> v2:172.21.15.158:3300/0 conn(0x7ff3141519a0 0x7ff3140b52d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff3140b1b80 tx=0x7ff30c010130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.355 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.340+0000 7ff31359e700 1 --2- 172.21.15.158:0/353594350 >> v2:172.21.15.158:3300/0 conn(0x7ff3141519a0 0x7ff3140b52d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff3140b1b80 tx=0x7ff30c010130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.355 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.340+0000 7ff31359e700 1 --2- 172.21.15.158:0/353594350 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff3141519a0 0x7ff3140b52d0 secure :-1 s=READY pgs=247 cs=0 l=1 rx=0x7ff3140b1b80 tx=0x7ff30c010130).ready entity=mon.1 client_cookie=1622d9553b49eb93 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:26.355 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.340+0000 7ff31359e700 1 --2- 172.21.15.158:0/353594350 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff3141519a0 0x7ff3140b52d0 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7ff3140b1b80 tx=0x7ff30c010130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.355 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.340+0000 7ff311d9b700 1 -- 172.21.15.158:0/353594350 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff30c00a160 con 0x7ff3141519a0 2019-12-05T03:50:26.355 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.340+0000 7ff31359e700 1 --2- 172.21.15.158:0/353594350 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff3141519a0 0x7ff3140b52d0 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7ff3140b1b80 tx=0x7ff30c010130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.356 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.340+0000 7ff311d9b700 1 -- 172.21.15.158:0/353594350 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff30c011a70 con 0x7ff3141519a0 2019-12-05T03:50:26.356 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.340+0000 7ff31359e700 1 --2- 172.21.15.158:0/353594350 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff3141519a0 0x7ff3140b52d0 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7ff3140b1b80 tx=0x7ff30c010130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.356 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.340+0000 7ff311d9b700 1 -- 172.21.15.158:0/353594350 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff30c00a740 con 0x7ff3141519a0 2019-12-05T03:50:26.356 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.340+0000 7ff318dbb700 1 -- 172.21.15.158:0/353594350 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff3141519a0 msgr2=0x7ff3140b52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:26.356 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.340+0000 7ff318dbb700 1 --2- 172.21.15.158:0/353594350 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff3141519a0 0x7ff3140b52d0 secure :-1 s=READY pgs=247 cs=0 l=1 rx=0x7ff3140b1b80 tx=0x7ff30c010130).stop 2019-12-05T03:50:26.356 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.340+0000 7ff318dbb700 1 -- 172.21.15.158:0/353594350 shutdown_connections 2019-12-05T03:50:26.357 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.340+0000 7ff318dbb700 1 --2- 172.21.15.158:0/353594350 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff3141519a0 0x7ff3140b52d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:26.357 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.340+0000 7ff318dbb700 1 --2- 172.21.15.158:0/353594350 >> v2:172.21.15.96:3300/0 conn(0x7ff31409cf50 0x7ff31409a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:26.357 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.340+0000 7ff318dbb700 1 --2- 172.21.15.158:0/353594350 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff31405a730 0x7ff314151450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:26.357 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.340+0000 7ff318dbb700 1 -- 172.21.15.158:0/353594350 shutdown_connections 2019-12-05T03:50:26.357 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.340+0000 7ff318dbb700 1 -- 172.21.15.158:0/353594350 wait complete. 2019-12-05T03:50:26.357 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.340+0000 7ff318dbb700 1 -- 172.21.15.158:0/353594350 >> 172.21.15.158:0/353594350 conn(0x7ff3140b7e50 msgr2=0x7ff3140b3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:26.357 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.344+0000 7ff318dbb700 1 Processor -- start 2019-12-05T03:50:26.358 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.344+0000 7ff318dbb700 1 -- start start 2019-12-05T03:50:26.362 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.344+0000 7ff318dbb700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff31412ca50 0x7ff31413d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:26.363 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.344+0000 7ff318dbb700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3140ad230 con 0x7ff31413d560 2019-12-05T03:50:26.363 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.344+0000 7ff318dbb700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff31407b550 con 0x7ff314152fa0 2019-12-05T03:50:26.363 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.344+0000 7ff318dbb700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3141533d0 con 0x7ff31412ca50 2019-12-05T03:50:26.363 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.344+0000 7ff312d9d700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7ff314152fa0 0x7ff31407ad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49202/0 (socket says 172.21.15.158:49202) 2019-12-05T03:50:26.363 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.344+0000 7ff312d9d700 1 -- 172.21.15.158:0/2533212172 learned_addr learned my addr 172.21.15.158:0/2533212172 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:26.363 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.344+0000 7ff31259c700 1 --2- 172.21.15.158:0/2533212172 >> v2:172.21.15.96:3300/0 conn(0x7ff31412ca50 0x7ff31413d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:26.363 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.344+0000 7ff30b7fe700 1 -- 172.21.15.158:0/2533212172 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3567359643 0 0) 0x7ff31407b550 con 0x7ff314152fa0 2019-12-05T03:50:26.364 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.344+0000 7ff30b7fe700 1 -- 172.21.15.158:0/2533212172 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2f80030b0 con 0x7ff314152fa0 2019-12-05T03:50:26.364 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.348+0000 7ff30b7fe700 1 -- 172.21.15.158:0/2533212172 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1255334739 0 0) 0x7ff3140ad230 con 0x7ff31413d560 2019-12-05T03:50:26.364 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.348+0000 7ff31259c700 1 -- 172.21.15.158:0/2533212172 >> v1:172.21.15.158:6789/0 conn(0x7ff314152fa0 legacy=0x7ff31407ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:26.364 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.348+0000 7ff31259c700 1 -- 172.21.15.158:0/2533212172 >> v1:172.21.15.96:6789/0 conn(0x7ff31413d560 legacy=0x7ff3141441b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:26.364 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.348+0000 7ff31259c700 1 -- 172.21.15.158:0/2533212172 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff31412ce80 con 0x7ff31412ca50 2019-12-05T03:50:26.365 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.348+0000 7ff31259c700 1 --2- 172.21.15.158:0/2533212172 >> v2:172.21.15.96:3300/0 conn(0x7ff31412ca50 0x7ff31413d010 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff31409bf10 tx=0x7ff2fc010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.365 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.348+0000 7ff31259c700 1 --2- 172.21.15.158:0/2533212172 >> v2:172.21.15.96:3300/0 conn(0x7ff31412ca50 0x7ff31413d010 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff31409bf10 tx=0x7ff2fc010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.365 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.348+0000 7ff31259c700 1 --2- 172.21.15.158:0/2533212172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff31412ca50 0x7ff31413d010 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7ff31409bf10 tx=0x7ff2fc010b60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:26.365 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.348+0000 7ff31259c700 1 --2- 172.21.15.158:0/2533212172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff31412ca50 0x7ff31413d010 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7ff31409bf10 tx=0x7ff2fc010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.365 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.348+0000 7ff31259c700 1 --2- 172.21.15.158:0/2533212172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff31412ca50 0x7ff31413d010 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7ff31409bf10 tx=0x7ff2fc010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.366 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.348+0000 7ff30b7fe700 1 -- 172.21.15.158:0/2533212172 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2fc005540 con 0x7ff31412ca50 2019-12-05T03:50:26.366 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.348+0000 7ff31259c700 1 --2- 172.21.15.158:0/2533212172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff31412ca50 0x7ff31413d010 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7ff31409bf10 tx=0x7ff2fc010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.366 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.348+0000 7ff30b7fe700 1 -- 172.21.15.158:0/2533212172 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2fc007150 con 0x7ff31412ca50 2019-12-05T03:50:26.366 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.348+0000 7ff30b7fe700 1 -- 172.21.15.158:0/2533212172 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2fc005b20 con 0x7ff31412ca50 2019-12-05T03:50:26.366 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.348+0000 7ff318dbb700 1 -- 172.21.15.158:0/2533212172 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3141512b0 con 0x7ff31412ca50 2019-12-05T03:50:26.366 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.348+0000 7ff318dbb700 1 -- 172.21.15.158:0/2533212172 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff314154ec0 con 0x7ff31412ca50 2019-12-05T03:50:26.367 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.348+0000 7ff31259c700 1 --2- 172.21.15.158:0/2533212172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff31412ca50 0x7ff31413d010 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7ff31409bf10 tx=0x7ff2fc010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.367 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.348+0000 7ff30b7fe700 1 -- 172.21.15.158:0/2533212172 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7ff2fc012410 con 0x7ff31412ca50 2019-12-05T03:50:26.367 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.348+0000 7ff31259c700 1 --2- 172.21.15.158:0/2533212172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff31412ca50 0x7ff31413d010 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7ff31409bf10 tx=0x7ff2fc010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.367 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.348+0000 7ff30b7fe700 1 --2- 172.21.15.158:0/2533212172 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7ff2f803b210 0x7ff2f803d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:26.367 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.348+0000 7ff30b7fe700 1 -- 172.21.15.158:0/2533212172 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7ff2fc04aef0 con 0x7ff31412ca50 2019-12-05T03:50:26.367 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.352+0000 7ff312d9d700 1 --2- 172.21.15.158:0/2533212172 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7ff2f803b210 0x7ff2f803d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:26.368 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.352+0000 7ff312d9d700 1 --2- 172.21.15.158:0/2533212172 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7ff2f803b210 0x7ff2f803d720 crc :-1 s=READY pgs=117 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:26.368 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.352+0000 7ff318dbb700 1 -- 172.21.15.158:0/2533212172 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3140554d0 con 0x7ff31412ca50 2019-12-05T03:50:26.369 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.360+0000 7ff31259c700 1 --2- 172.21.15.158:0/2533212172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff31412ca50 0x7ff31413d010 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7ff31409bf10 tx=0x7ff2fc010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.369 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.360+0000 7ff30b7fe700 1 -- 172.21.15.158:0/2533212172 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7ff3141512b0 con 0x7ff31412ca50 2019-12-05T03:50:26.539 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.528+0000 7ff318dbb700 1 -- 172.21.15.158:0/2533212172 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff314066930 con 0x7ff31412ca50 2019-12-05T03:50:26.539 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.532+0000 7ff31259c700 1 --2- 172.21.15.158:0/2533212172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff31412ca50 0x7ff31413d010 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7ff31409bf10 tx=0x7ff2fc010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.539 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.532+0000 7ff30b7fe700 1 -- 172.21.15.158:0/2533212172 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+14933 (secure 0 0 0) 0x7ff2fc031f70 con 0x7ff31412ca50 2019-12-05T03:50:26.540 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:26.540 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":23,"fsid":"a91186ae-f496-4de1-918d-820c55ff1feb","created":"2019-12-05T03:49:39.187523+0000","modified":"2019-12-05T03:50:01.249305+0000","last_up_change":"2019-12-05T03:49:48.551934+0000","last_in_change":"2019-12-05T03:49:48.551934+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-05T03:49:52.900870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-12-05T03:49:55.801462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-12-05T03:49:58.659250+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"782c4258-e28c-4a11-9d54-3c9c7a36fba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":12192},{"type":"v1","addr":"172.21.15.158:6801","nonce":12192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":12192},{"type":"v1","addr":"172.21.15.158:6803","nonce":12192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":12192},{"type":"v1","addr":"172.21.15.158:6807","nonce":12192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":12192},{"type":"v1","addr":"172.21.15.158:6805","nonce":12192}]},"public_addr":"172.21.15.158:6801/12192","cluster_addr":"172.21.15.158:6803/12192","heartbeat_back_addr":"172.21.15.158:6807/12192","heartbeat_front_addr":"172.21.15.158:6805/12192","state":["exists","up"]},{"osd":1,"uuid":"d4426b21-b666-4158-bf34-a24b14572731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":12193},{"type":"v1","addr":"172.21.15.158:6809","nonce":12193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":12193},{"type":"v1","addr":"172.21.15.158:6811","nonce":12193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":12193},{"type":"v1","addr":"172.21.15.158:6815","nonce":12193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":12193},{"type":"v1","addr":"172.21.15.158:6813","nonce":12193}]},"public_addr":"172.21.15.158:6809/12193","cluster_addr":"172.21.15.158:6811/12193","heartbeat_back_addr":"172.21.15.158:6815/12193","heartbeat_front_addr":"172.21.15.158:6813/12193","state":["exists","up"]},{"osd":2,"uuid":"22680edd-6490-4ab0-bb15-0605830e4cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":12195},{"type":"v1","addr":"172.21.15.158:6825","nonce":12195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":12195},{"type":"v1","addr":"172.21.15.158:6827","nonce":12195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":12195},{"type":"v1","addr":"172.21.15.158:6831","nonce":12195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":12195},{"type":"v1","addr":"172.21.15.158:6829","nonce":12195}]},"public_addr":"172.21.15.158:6825/12195","cluster_addr":"172.21.15.158:6827/12195","heartbeat_back_addr":"172.21.15.158:6831/12195","heartbeat_front_addr":"172.21.15.158:6829/12195","state":["exists","up"]},{"osd":3,"uuid":"7ec999ee-ace8-4ccb-a4f9-6f5d313bbbd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":12194},{"type":"v1","addr":"172.21.15.158:6817","nonce":12194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":12194},{"type":"v1","addr":"172.21.15.158:6819","nonce":12194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":12194},{"type":"v1","addr":"172.21.15.158:6823","nonce":12194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":12194},{"type":"v1","addr":"172.21.15.158:6821","nonce":12194}]},"public_addr":"172.21.15.158:6817/12194","cluster_addr":"172.21.15.158:6819/12194","heartbeat_back_addr":"172.21.15.158:6823/12194","heartbeat_front_addr":"172.21.15.158:6821/12194","state":["exists","up"]},{"osd":4,"uuid":"186e69c4-b69f-4dd1-bb8f-faf759c60484","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":12460},{"type":"v1","addr":"172.21.15.96:6803","nonce":12460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":12460},{"type":"v1","addr":"172.21.15.96:6805","nonce":12460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":12460},{"type":"v1","addr":"172.21.15.96:6809","nonce":12460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":12460},{"type":"v1","addr":"172.21.15.96:6807","nonce":12460}]},"public_addr":"172.21.15.96:6803/12460","cluster_addr":"172.21.15.96:6805/12460","heartbeat_back_addr":"172.21.15.96:6809/12460","heartbeat_front_addr":"172.21.15.96:6807/12460","state":["exists","up"]},{"osd":5,"uuid":"86b658b2-8b40-4cea-8163-305a3982758b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":12461},{"type":"v1","addr":"172.21.15.96:6811","nonce":12461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":12461},{"type":"v1","addr":"172.21.15.96:6813","nonce":12461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":12461},{"type":"v1","addr":"172.21.15.96:6817","nonce":12461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":12461},{"type":"v1","addr":"172.21.15.96:6815","nonce":12461}]},"public_addr":"172.21.15.96:6811/12461","cluster_addr":"172.21.15.96:6813/12461","heartbeat_back_addr":"172.21.15.96:6817/12461","heartbeat_front_addr":"172.21.15.96:6815/12461","state":["exists","up"]},{"osd":6,"uuid":"bdadaea8-9296-4788-bc59-d9c9eb8defdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":12463},{"type":"v1","addr":"172.21.15.96:6827","nonce":12463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":12463},{"type":"v1","addr":"172.21.15.96:6829","nonce":12463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":12463},{"type":"v1","addr":"172.21.15.96:6833","nonce":12463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":12463},{"type":"v1","addr":"172.21.15.96:6831","nonce":12463}]},"public_addr":"172.21.15.96:6827/12463","cluster_addr":"172.21.15.96:6829/12463","heartbeat_back_addr":"172.21.15.96:6833/12463","heartbeat_front_addr":"172.21.15.96:6831/12463","state":["exists","up"]},{"osd":7,"uuid":"c6d71846-d68e-430f-ab72-0fb8ea4bf640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":12462},{"type":"v1","addr":"172.21.15.96:6819","nonce":12462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":12462},{"type":"v1","addr":"172.21.15.96:6821","nonce":12462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":12462},{"type":"v1","addr":"172.21.15.96:6825","nonce":12462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":12462},{"type":"v1","addr":"172.21.15.96:6823","nonce":12462}]},"public_addr":"172.21.15.96:6819/12462","cluster_addr":"172.21.15.96:6821/12462","heartbeat_back_addr":"172.21.15.96:6825/12462","heartbeat_front_addr":"172.21.15.96:6823/12462","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.875762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.900817+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.210347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.133973+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.864697+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.131015+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.237225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.154377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-05T03:50:26.542 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.532+0000 7ff318dbb700 1 -- 172.21.15.158:0/2533212172 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7ff2f803b210 msgr2=0x7ff2f803d720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:26.542 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.532+0000 7ff318dbb700 1 --2- 172.21.15.158:0/2533212172 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7ff2f803b210 0x7ff2f803d720 crc :-1 s=READY pgs=117 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:26.542 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.532+0000 7ff318dbb700 1 -- 172.21.15.158:0/2533212172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff31412ca50 msgr2=0x7ff31413d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:26.542 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.532+0000 7ff318dbb700 1 --2- 172.21.15.158:0/2533212172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff31412ca50 0x7ff31413d010 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7ff31409bf10 tx=0x7ff2fc010b60).stop 2019-12-05T03:50:26.542 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.532+0000 7ff318dbb700 1 -- 172.21.15.158:0/2533212172 shutdown_connections 2019-12-05T03:50:26.542 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.532+0000 7ff318dbb700 1 --2- 172.21.15.158:0/2533212172 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7ff2f803b210 0x7ff2f803d720 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:26.543 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.532+0000 7ff318dbb700 1 --2- 172.21.15.158:0/2533212172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff31412ca50 0x7ff31413d010 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:26.543 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.536+0000 7ff318dbb700 1 -- 172.21.15.158:0/2533212172 shutdown_connections 2019-12-05T03:50:26.543 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.536+0000 7ff318dbb700 1 -- 172.21.15.158:0/2533212172 wait complete. 2019-12-05T03:50:26.543 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.536+0000 7ff318dbb700 1 -- 172.21.15.158:0/2533212172 >> 172.21.15.158:0/2533212172 conn(0x7ff314059e70 msgr2=0x7ff31412f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:26.552 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:49:52.900870+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:49:55.801462+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:49:58.659250+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-12-05T03:50:26.553 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-12-05T03:50:26.654 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.640+0000 7fd550b99700 1 Processor -- start 2019-12-05T03:50:26.654 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.640+0000 7fd550b99700 1 -- start start 2019-12-05T03:50:26.655 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.644+0000 7fd550b99700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd54c09add0 0x7fd54c0b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:26.655 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.644+0000 7fd550b99700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd54c099e30 con 0x7fd54c0b6970 2019-12-05T03:50:26.655 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.644+0000 7fd550b99700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd54c0b60c0 con 0x7fd54c09ba40 2019-12-05T03:50:26.655 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.644+0000 7fd550b99700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd54c09d210 con 0x7fd54c09add0 2019-12-05T03:50:26.656 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.644+0000 7fd54a59c700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fd54c09ba40 0x7fd54c0b5370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49210/0 (socket says 172.21.15.158:49210) 2019-12-05T03:50:26.656 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.644+0000 7fd54a59c700 1 -- 172.21.15.158:0/2890062655 learned_addr learned my addr 172.21.15.158:0/2890062655 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:26.656 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.644+0000 7fd54b59e700 1 --2- 172.21.15.158:0/2890062655 >> v2:172.21.15.96:3300/0 conn(0x7fd54c09add0 0x7fd54c0b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:26.656 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.644+0000 7fd549d9b700 1 -- 172.21.15.158:0/2890062655 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2938448881 0 0) 0x7fd54c0b60c0 con 0x7fd54c09ba40 2019-12-05T03:50:26.657 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.644+0000 7fd549d9b700 1 -- 172.21.15.158:0/2890062655 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5380030b0 con 0x7fd54c09ba40 2019-12-05T03:50:26.657 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.644+0000 7fd54b59e700 1 -- 172.21.15.158:0/2890062655 >> v1:172.21.15.158:6789/0 conn(0x7fd54c09ba40 legacy=0x7fd54c0b5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:26.657 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.644+0000 7fd549d9b700 1 -- 172.21.15.158:0/2890062655 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 945951267 0 0) 0x7fd54c099e30 con 0x7fd54c0b6970 2019-12-05T03:50:26.658 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.644+0000 7fd54b59e700 1 -- 172.21.15.158:0/2890062655 >> v1:172.21.15.96:6789/0 conn(0x7fd54c0b6970 legacy=0x7fd54c05a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:26.658 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.644+0000 7fd54b59e700 1 -- 172.21.15.158:0/2890062655 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54c07e960 con 0x7fd54c09add0 2019-12-05T03:50:26.659 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.644+0000 7fd54b59e700 1 --2- 172.21.15.158:0/2890062655 >> v2:172.21.15.96:3300/0 conn(0x7fd54c09add0 0x7fd54c0b5b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd544002f30 tx=0x7fd54400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.659 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.644+0000 7fd54b59e700 1 --2- 172.21.15.158:0/2890062655 >> v2:172.21.15.96:3300/0 conn(0x7fd54c09add0 0x7fd54c0b5b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd544002f30 tx=0x7fd54400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.659 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.644+0000 7fd54b59e700 1 --2- 172.21.15.158:0/2890062655 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd54c09add0 0x7fd54c0b5b70 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7fd544002f30 tx=0x7fd54400fbf0).ready entity=mon.0 client_cookie=b4ff5b6efd9d01ef server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:26.660 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.644+0000 7fd54b59e700 1 --2- 172.21.15.158:0/2890062655 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd54c09add0 0x7fd54c0b5b70 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7fd544002f30 tx=0x7fd54400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.660 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.644+0000 7fd549d9b700 1 -- 172.21.15.158:0/2890062655 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd544012060 con 0x7fd54c09add0 2019-12-05T03:50:26.660 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.644+0000 7fd54b59e700 1 --2- 172.21.15.158:0/2890062655 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd54c09add0 0x7fd54c0b5b70 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7fd544002f30 tx=0x7fd54400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.661 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.644+0000 7fd54b59e700 1 --2- 172.21.15.158:0/2890062655 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd54c09add0 0x7fd54c0b5b70 secure :-1 s=THROTTLE_DONE pgs=182 cs=0 l=1 rx=0x7fd544002f30 tx=0x7fd54400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.661 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.644+0000 7fd549d9b700 1 -- 172.21.15.158:0/2890062655 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5440110c0 con 0x7fd54c09add0 2019-12-05T03:50:26.661 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.644+0000 7fd549d9b700 1 -- 172.21.15.158:0/2890062655 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd544008d60 con 0x7fd54c09add0 2019-12-05T03:50:26.661 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.644+0000 7fd550b99700 1 -- 172.21.15.158:0/2890062655 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd54c09add0 msgr2=0x7fd54c0b5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:26.662 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.644+0000 7fd550b99700 1 --2- 172.21.15.158:0/2890062655 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd54c09add0 0x7fd54c0b5b70 secure :-1 s=READY pgs=182 cs=0 l=1 rx=0x7fd544002f30 tx=0x7fd54400fbf0).stop 2019-12-05T03:50:26.662 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.648+0000 7fd550b99700 1 -- 172.21.15.158:0/2890062655 shutdown_connections 2019-12-05T03:50:26.662 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.648+0000 7fd550b99700 1 --2- 172.21.15.158:0/2890062655 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd54c09add0 0x7fd54c0b5b70 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:26.662 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.648+0000 7fd550b99700 1 -- 172.21.15.158:0/2890062655 shutdown_connections 2019-12-05T03:50:26.662 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.648+0000 7fd550b99700 1 -- 172.21.15.158:0/2890062655 wait complete. 2019-12-05T03:50:26.662 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.648+0000 7fd550b99700 1 -- 172.21.15.158:0/2890062655 >> 172.21.15.158:0/2890062655 conn(0x7fd54c0b7ef0 msgr2=0x7fd54c0b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:26.667 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.648+0000 7fd550b99700 1 Processor -- start 2019-12-05T03:50:26.667 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.648+0000 7fd550b99700 1 -- start start 2019-12-05T03:50:26.667 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.652+0000 7fd550b99700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd54c0654e0 0x7fd54c12cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:26.668 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.652+0000 7fd550b99700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd54c13fda0 0x7fd54c13d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:26.668 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.652+0000 7fd550b99700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd54c13d620 con 0x7fd54c0b06e0 2019-12-05T03:50:26.668 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.652+0000 7fd550b99700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd54c12f4e0 con 0x7fd54c13fda0 2019-12-05T03:50:26.669 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.652+0000 7fd550b99700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd54c153d90 con 0x7fd54c0654e0 2019-12-05T03:50:26.669 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.652+0000 7fd54b59e700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fd54c0b06e0 0x7fd54c151cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49218/0 (socket says 172.21.15.158:49218) 2019-12-05T03:50:26.669 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.652+0000 7fd54a59c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd54c13fda0 0x7fd54c13d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:26.670 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.652+0000 7fd54b59e700 1 -- 172.21.15.158:0/2082732001 learned_addr learned my addr 172.21.15.158:0/2082732001 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:26.670 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.652+0000 7fd54ad9d700 1 --2- 172.21.15.158:0/2082732001 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd54c0654e0 0x7fd54c12cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:26.670 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.652+0000 7fd54a59c700 1 -- 172.21.15.158:0/2082732001 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd54c0654e0 msgr2=0x7fd54c12cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:26.670 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.652+0000 7fd54a59c700 1 --2- 172.21.15.158:0/2082732001 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd54c0654e0 0x7fd54c12cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:26.670 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.652+0000 7fd5437fe700 1 -- 172.21.15.158:0/2082732001 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1828221257 0 0) 0x7fd54c13d620 con 0x7fd54c0b06e0 2019-12-05T03:50:26.670 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.652+0000 7fd54a59c700 1 -- 172.21.15.158:0/2082732001 >> v1:172.21.15.158:6789/0 conn(0x7fd54c0b06e0 legacy=0x7fd54c151cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:26.671 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.652+0000 7fd54a59c700 1 -- 172.21.15.158:0/2082732001 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54c0b0b10 con 0x7fd54c13fda0 2019-12-05T03:50:26.671 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.652+0000 7fd54a59c700 1 --2- 172.21.15.158:0/2082732001 >> v2:172.21.15.158:3300/0 conn(0x7fd54c13fda0 0x7fd54c13d0d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd534000f00 tx=0x7fd534010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.671 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.652+0000 7fd54a59c700 1 --2- 172.21.15.158:0/2082732001 >> v2:172.21.15.158:3300/0 conn(0x7fd54c13fda0 0x7fd54c13d0d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd534000f00 tx=0x7fd534010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.671 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.652+0000 7fd54a59c700 1 --2- 172.21.15.158:0/2082732001 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd54c13fda0 0x7fd54c13d0d0 secure :-1 s=READY pgs=251 cs=0 l=1 rx=0x7fd534000f00 tx=0x7fd534010c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:26.671 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.652+0000 7fd54a59c700 1 --2- 172.21.15.158:0/2082732001 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd54c13fda0 0x7fd54c13d0d0 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7fd534000f00 tx=0x7fd534010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.671 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.652+0000 7fd5437fe700 1 -- 172.21.15.158:0/2082732001 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd534005bc0 con 0x7fd54c13fda0 2019-12-05T03:50:26.671 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.652+0000 7fd54a59c700 1 --2- 172.21.15.158:0/2082732001 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd54c13fda0 0x7fd54c13d0d0 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7fd534000f00 tx=0x7fd534010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.672 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.652+0000 7fd550b99700 1 -- 172.21.15.158:0/2082732001 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd54c0b0d20 con 0x7fd54c13fda0 2019-12-05T03:50:26.672 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.652+0000 7fd54a59c700 1 --2- 172.21.15.158:0/2082732001 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd54c13fda0 0x7fd54c13d0d0 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7fd534000f00 tx=0x7fd534010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.672 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.652+0000 7fd5437fe700 1 -- 172.21.15.158:0/2082732001 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5340057e0 con 0x7fd54c13fda0 2019-12-05T03:50:26.672 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.652+0000 7fd5437fe700 1 -- 172.21.15.158:0/2082732001 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd534012840 con 0x7fd54c13fda0 2019-12-05T03:50:26.672 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.652+0000 7fd550b99700 1 -- 172.21.15.158:0/2082732001 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd54c1524f0 con 0x7fd54c13fda0 2019-12-05T03:50:26.672 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.652+0000 7fd54a59c700 1 --2- 172.21.15.158:0/2082732001 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd54c13fda0 0x7fd54c13d0d0 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7fd534000f00 tx=0x7fd534010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.673 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.656+0000 7fd5437fe700 1 -- 172.21.15.158:0/2082732001 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fd534012ad0 con 0x7fd54c13fda0 2019-12-05T03:50:26.673 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.656+0000 7fd54a59c700 1 --2- 172.21.15.158:0/2082732001 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd54c13fda0 0x7fd54c13d0d0 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7fd534000f00 tx=0x7fd534010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.673 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.656+0000 7fd5437fe700 1 --2- 172.21.15.158:0/2082732001 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd53003ab90 0x7fd53003d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:26.673 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.656+0000 7fd5437fe700 1 -- 172.21.15.158:0/2082732001 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fd53404b450 con 0x7fd54c13fda0 2019-12-05T03:50:26.673 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.656+0000 7fd54ad9d700 1 --2- 172.21.15.158:0/2082732001 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd53003ab90 0x7fd53003d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:26.673 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.656+0000 7fd54ad9d700 1 --2- 172.21.15.158:0/2082732001 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd53003ab90 0x7fd53003d0a0 crc :-1 s=READY pgs=118 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:26.674 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.656+0000 7fd550b99700 1 -- 172.21.15.158:0/2082732001 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd54c0554e0 con 0x7fd54c13fda0 2019-12-05T03:50:26.684 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.664+0000 7fd54a59c700 1 --2- 172.21.15.158:0/2082732001 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd54c13fda0 0x7fd54c13d0d0 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7fd534000f00 tx=0x7fd534010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.685 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.664+0000 7fd5437fe700 1 -- 172.21.15.158:0/2082732001 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fd534012de0 con 0x7fd54c13fda0 2019-12-05T03:50:26.833 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.824+0000 7fd550b99700 1 -- 172.21.15.158:0/2082732001 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fd54c066940 con 0x7fd54c13fda0 2019-12-05T03:50:26.834 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.828+0000 7fd54a59c700 1 --2- 172.21.15.158:0/2082732001 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd54c13fda0 0x7fd54c13d0d0 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7fd534000f00 tx=0x7fd534010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.834 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.828+0000 7fd5437fe700 1 -- 172.21.15.158:0/2082732001 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd5340324b0 con 0x7fd54c13fda0 2019-12-05T03:50:26.834 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:50:26.836 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.828+0000 7fd550b99700 1 -- 172.21.15.158:0/2082732001 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd53003ab90 msgr2=0x7fd53003d0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:26.837 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.828+0000 7fd550b99700 1 --2- 172.21.15.158:0/2082732001 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd53003ab90 0x7fd53003d0a0 crc :-1 s=READY pgs=118 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:26.837 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.828+0000 7fd550b99700 1 -- 172.21.15.158:0/2082732001 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd54c13fda0 msgr2=0x7fd54c13d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:26.837 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.828+0000 7fd550b99700 1 --2- 172.21.15.158:0/2082732001 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd54c13fda0 0x7fd54c13d0d0 secure :-1 s=READY pgs=251 cs=0 l=1 rx=0x7fd534000f00 tx=0x7fd534010c10).stop 2019-12-05T03:50:26.837 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.828+0000 7fd550b99700 1 -- 172.21.15.158:0/2082732001 shutdown_connections 2019-12-05T03:50:26.837 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.828+0000 7fd550b99700 1 --2- 172.21.15.158:0/2082732001 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd53003ab90 0x7fd53003d0a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:26.837 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.828+0000 7fd550b99700 1 --2- 172.21.15.158:0/2082732001 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd54c0654e0 0x7fd54c12cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:26.838 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.828+0000 7fd550b99700 1 --2- 172.21.15.158:0/2082732001 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd54c13fda0 0x7fd54c13d0d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:26.838 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.828+0000 7fd550b99700 1 -- 172.21.15.158:0/2082732001 shutdown_connections 2019-12-05T03:50:26.838 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.828+0000 7fd550b99700 1 -- 172.21.15.158:0/2082732001 wait complete. 2019-12-05T03:50:26.838 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.828+0000 7fd550b99700 1 -- 172.21.15.158:0/2082732001 >> 172.21.15.158:0/2082732001 conn(0x7fd54c0b1760 msgr2=0x7fd54c12faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:26.846 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-12-05T03:50:26.949 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.936+0000 7f85e5e3c700 1 Processor -- start 2019-12-05T03:50:26.949 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.936+0000 7f85e5e3c700 1 -- start start 2019-12-05T03:50:26.949 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.936+0000 7f85e5e3c700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85e009ba40 0x7f85e009add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:26.949 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.936+0000 7f85e5e3c700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f85e00b5370 0x7f85e00b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:26.949 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.936+0000 7f85e5e3c700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e0099e30 con 0x7f85e00b6970 2019-12-05T03:50:26.950 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.936+0000 7f85e5e3c700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e009d210 con 0x7f85e00b5370 2019-12-05T03:50:26.950 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.936+0000 7f85e5e3c700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e0099b90 con 0x7f85e009ba40 2019-12-05T03:50:26.950 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.936+0000 7f85dffff700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f85e00b6970 0x7f85e005a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49224/0 (socket says 172.21.15.158:49224) 2019-12-05T03:50:26.950 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.936+0000 7f85dffff700 1 -- 172.21.15.158:0/216986810 learned_addr learned my addr 172.21.15.158:0/216986810 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:26.950 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.936+0000 7f85df7fe700 1 --2- 172.21.15.158:0/216986810 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85e009ba40 0x7f85e009add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:26.950 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.936+0000 7f85e4bda700 1 --2- 172.21.15.158:0/216986810 >> v2:172.21.15.96:3300/0 conn(0x7f85e00b5370 0x7f85e00b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:26.951 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.940+0000 7f85deffd700 1 -- 172.21.15.158:0/216986810 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3707812613 0 0) 0x7f85e0099e30 con 0x7f85e00b6970 2019-12-05T03:50:26.951 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.940+0000 7f85deffd700 1 -- 172.21.15.158:0/216986810 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85c80030b0 con 0x7f85e00b6970 2019-12-05T03:50:26.951 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.940+0000 7f85df7fe700 1 -- 172.21.15.158:0/216986810 >> v2:172.21.15.96:3300/0 conn(0x7f85e00b5370 msgr2=0x7f85e00b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:26.951 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.940+0000 7f85df7fe700 1 --2- 172.21.15.158:0/216986810 >> v2:172.21.15.96:3300/0 conn(0x7f85e00b5370 0x7f85e00b57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:26.951 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.940+0000 7f85df7fe700 1 -- 172.21.15.158:0/216986810 >> v1:172.21.15.158:6789/0 conn(0x7f85e00b6970 legacy=0x7f85e005a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:26.951 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.940+0000 7f85df7fe700 1 -- 172.21.15.158:0/216986810 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e007e960 con 0x7f85e009ba40 2019-12-05T03:50:26.952 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.940+0000 7f85df7fe700 1 --2- 172.21.15.158:0/216986810 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85e009ba40 0x7f85e009add0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f85d4008790 tx=0x7f85d400fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.952 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.940+0000 7f85df7fe700 1 --2- 172.21.15.158:0/216986810 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85e009ba40 0x7f85e009add0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f85d4008790 tx=0x7f85d400fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.952 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.940+0000 7f85df7fe700 1 --2- 172.21.15.158:0/216986810 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85e009ba40 0x7f85e009add0 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7f85d4008790 tx=0x7f85d400fc70).ready entity=mon.2 client_cookie=61964e0c1f6524d server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:26.952 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.940+0000 7f85df7fe700 1 --2- 172.21.15.158:0/216986810 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85e009ba40 0x7f85e009add0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f85d4008790 tx=0x7f85d400fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.952 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.940+0000 7f85deffd700 1 -- 172.21.15.158:0/216986810 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85d4008bb0 con 0x7f85e009ba40 2019-12-05T03:50:26.952 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.940+0000 7f85df7fe700 1 --2- 172.21.15.158:0/216986810 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85e009ba40 0x7f85e009add0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f85d4008790 tx=0x7f85d400fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.953 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.940+0000 7f85df7fe700 1 --2- 172.21.15.158:0/216986810 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85e009ba40 0x7f85e009add0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f85d4008790 tx=0x7f85d400fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.953 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.940+0000 7f85deffd700 1 -- 172.21.15.158:0/216986810 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d40087d0 con 0x7f85e009ba40 2019-12-05T03:50:26.953 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.940+0000 7f85deffd700 1 -- 172.21.15.158:0/216986810 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85d4011860 con 0x7f85e009ba40 2019-12-05T03:50:26.953 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.940+0000 7f85e5e3c700 1 -- 172.21.15.158:0/216986810 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85e009ba40 msgr2=0x7f85e009add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:26.953 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.940+0000 7f85e5e3c700 1 --2- 172.21.15.158:0/216986810 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85e009ba40 0x7f85e009add0 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7f85d4008790 tx=0x7f85d400fc70).stop 2019-12-05T03:50:26.953 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.940+0000 7f85e5e3c700 1 -- 172.21.15.158:0/216986810 shutdown_connections 2019-12-05T03:50:26.953 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.940+0000 7f85e5e3c700 1 --2- 172.21.15.158:0/216986810 >> v2:172.21.15.96:3300/0 conn(0x7f85e00b5370 0x7f85e00b57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:26.954 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.940+0000 7f85e5e3c700 1 --2- 172.21.15.158:0/216986810 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85e009ba40 0x7f85e009add0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:26.954 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.940+0000 7f85e5e3c700 1 -- 172.21.15.158:0/216986810 shutdown_connections 2019-12-05T03:50:26.954 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.940+0000 7f85e5e3c700 1 -- 172.21.15.158:0/216986810 wait complete. 2019-12-05T03:50:26.954 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.940+0000 7f85e5e3c700 1 -- 172.21.15.158:0/216986810 >> 172.21.15.158:0/216986810 conn(0x7f85e00b7ef0 msgr2=0x7f85e00b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:26.956 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.944+0000 7f85e5e3c700 1 Processor -- start 2019-12-05T03:50:26.956 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.944+0000 7f85e5e3c700 1 -- start start 2019-12-05T03:50:26.956 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.944+0000 7f85e5e3c700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f85e00b2610 0x7f85e0154040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:26.957 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.944+0000 7f85e5e3c700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85e00b39b0 0x7f85e007b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:26.957 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.944+0000 7f85e5e3c700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e00ad0b0 con 0x7f85e007b9d0 2019-12-05T03:50:26.957 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.944+0000 7f85e5e3c700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e01546f0 con 0x7f85e00b2610 2019-12-05T03:50:26.957 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.944+0000 7f85e5e3c700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e00ad3f0 con 0x7f85e00b39b0 2019-12-05T03:50:26.957 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.944+0000 7f85e4bda700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f85e007b9d0 0x7f85e0154f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49234/0 (socket says 172.21.15.158:49234) 2019-12-05T03:50:26.958 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.944+0000 7f85e4bda700 1 -- 172.21.15.158:0/1940569199 learned_addr learned my addr 172.21.15.158:0/1940569199 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:26.958 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.944+0000 7f85df7fe700 1 --2- 172.21.15.158:0/1940569199 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85e00b39b0 0x7f85e007b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:26.958 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.944+0000 7f85dffff700 1 --2- 172.21.15.158:0/1940569199 >> v2:172.21.15.96:3300/0 conn(0x7f85e00b2610 0x7f85e0154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:26.958 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.944+0000 7f85df7fe700 1 -- 172.21.15.158:0/1940569199 >> v2:172.21.15.96:3300/0 conn(0x7f85e00b2610 msgr2=0x7f85e0154040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:26.958 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.944+0000 7f85df7fe700 1 --2- 172.21.15.158:0/1940569199 >> v2:172.21.15.96:3300/0 conn(0x7f85e00b2610 0x7f85e0154040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:26.958 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.944+0000 7f85df7fe700 1 -- 172.21.15.158:0/1940569199 >> v1:172.21.15.158:6789/0 conn(0x7f85e007b9d0 legacy=0x7f85e0154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:26.959 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.948+0000 7f85df7fe700 1 -- 172.21.15.158:0/1940569199 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e013a810 con 0x7f85e00b39b0 2019-12-05T03:50:26.959 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.948+0000 7f85df7fe700 1 --2- 172.21.15.158:0/1940569199 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85e00b39b0 0x7f85e007b480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f85d4008790 tx=0x7f85d4011920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.959 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.948+0000 7f85df7fe700 1 --2- 172.21.15.158:0/1940569199 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85e00b39b0 0x7f85e007b480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f85d4008790 tx=0x7f85d4011920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.959 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.948+0000 7f85df7fe700 1 --2- 172.21.15.158:0/1940569199 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85e00b39b0 0x7f85e007b480 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7f85d4008790 tx=0x7f85d4011920).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:26.960 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.952+0000 7f85df7fe700 1 --2- 172.21.15.158:0/1940569199 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85e00b39b0 0x7f85e007b480 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f85d4008790 tx=0x7f85d4011920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.960 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.952+0000 7f85df7fe700 1 --2- 172.21.15.158:0/1940569199 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85e00b39b0 0x7f85e007b480 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f85d4008790 tx=0x7f85d4011920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.961 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.952+0000 7f85df7fe700 1 --2- 172.21.15.158:0/1940569199 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85e00b39b0 0x7f85e007b480 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f85d4008790 tx=0x7f85d4011920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.961 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.952+0000 7f85dcff9700 1 -- 172.21.15.158:0/1940569199 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85d400f280 con 0x7f85e00b39b0 2019-12-05T03:50:26.961 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.952+0000 7f85dcff9700 1 -- 172.21.15.158:0/1940569199 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d4008db0 con 0x7f85e00b39b0 2019-12-05T03:50:26.961 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.952+0000 7f85e5e3c700 1 -- 172.21.15.158:0/1940569199 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e00ad690 con 0x7f85e00b39b0 2019-12-05T03:50:26.961 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.952+0000 7f85dcff9700 1 -- 172.21.15.158:0/1940569199 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85d4005540 con 0x7f85e00b39b0 2019-12-05T03:50:26.961 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.952+0000 7f85e5e3c700 1 -- 172.21.15.158:0/1940569199 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e00b1140 con 0x7f85e00b39b0 2019-12-05T03:50:26.962 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.952+0000 7f85df7fe700 1 --2- 172.21.15.158:0/1940569199 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85e00b39b0 0x7f85e007b480 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f85d4008790 tx=0x7f85d4011920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.962 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.952+0000 7f85dcff9700 1 -- 172.21.15.158:0/1940569199 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f85d4005740 con 0x7f85e00b39b0 2019-12-05T03:50:26.962 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.952+0000 7f85df7fe700 1 --2- 172.21.15.158:0/1940569199 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85e00b39b0 0x7f85e007b480 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f85d4008790 tx=0x7f85d4011920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.962 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.952+0000 7f85dcff9700 1 --2- 172.21.15.158:0/1940569199 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f85c003ad30 0x7f85c003d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:26.962 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.952+0000 7f85dcff9700 1 -- 172.21.15.158:0/1940569199 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f85d404b5d0 con 0x7f85e00b39b0 2019-12-05T03:50:26.962 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.952+0000 7f85dffff700 1 --2- 172.21.15.158:0/1940569199 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f85c003ad30 0x7f85c003d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:26.962 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.952+0000 7f85dffff700 1 --2- 172.21.15.158:0/1940569199 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f85c003ad30 0x7f85c003d240 crc :-1 s=READY pgs=119 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:26.975 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.968+0000 7f85e5e3c700 1 -- 172.21.15.158:0/1940569199 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85e00554e0 con 0x7f85e00b39b0 2019-12-05T03:50:26.983 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.976+0000 7f85df7fe700 1 --2- 172.21.15.158:0/1940569199 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85e00b39b0 0x7f85e007b480 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f85d4008790 tx=0x7f85d4011920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:26.983 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:26.976+0000 7f85dcff9700 1 -- 172.21.15.158:0/1940569199 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f85d4032650 con 0x7f85e00b39b0 2019-12-05T03:50:27.143 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.136+0000 7f85e5e3c700 1 -- 172.21.15.158:0/1940569199 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f85e0066940 con 0x7f85e00b39b0 2019-12-05T03:50:27.144 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.136+0000 7f85df7fe700 1 --2- 172.21.15.158:0/1940569199 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85e00b39b0 0x7f85e007b480 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f85d4008790 tx=0x7f85d4011920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.144 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.136+0000 7f85dcff9700 1 -- 172.21.15.158:0/1940569199 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7f85d40328b0 con 0x7f85e00b39b0 2019-12-05T03:50:27.145 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:50:27.147 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.140+0000 7f85e5e3c700 1 -- 172.21.15.158:0/1940569199 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f85c003ad30 msgr2=0x7f85c003d240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:27.147 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.140+0000 7f85e5e3c700 1 --2- 172.21.15.158:0/1940569199 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f85c003ad30 0x7f85c003d240 crc :-1 s=READY pgs=119 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:27.147 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.140+0000 7f85e5e3c700 1 -- 172.21.15.158:0/1940569199 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85e00b39b0 msgr2=0x7f85e007b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:27.148 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.140+0000 7f85e5e3c700 1 --2- 172.21.15.158:0/1940569199 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85e00b39b0 0x7f85e007b480 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7f85d4008790 tx=0x7f85d4011920).stop 2019-12-05T03:50:27.148 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.140+0000 7f85e5e3c700 1 -- 172.21.15.158:0/1940569199 shutdown_connections 2019-12-05T03:50:27.148 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.140+0000 7f85e5e3c700 1 --2- 172.21.15.158:0/1940569199 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f85c003ad30 0x7f85c003d240 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:27.148 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.140+0000 7f85e5e3c700 1 --2- 172.21.15.158:0/1940569199 >> v2:172.21.15.96:3300/0 conn(0x7f85e00b2610 0x7f85e0154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:27.148 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.140+0000 7f85e5e3c700 1 --2- 172.21.15.158:0/1940569199 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f85e00b39b0 0x7f85e007b480 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:27.148 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.140+0000 7f85e5e3c700 1 -- 172.21.15.158:0/1940569199 shutdown_connections 2019-12-05T03:50:27.148 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.140+0000 7f85e5e3c700 1 -- 172.21.15.158:0/1940569199 wait complete. 2019-12-05T03:50:27.149 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.140+0000 7f85e5e3c700 1 -- 172.21.15.158:0/1940569199 >> 172.21.15.158:0/1940569199 conn(0x7f85e0068e70 msgr2=0x7f85e0059f80 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:27.157 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-12-05T03:50:27.260 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.248+0000 7f0f81b25700 1 Processor -- start 2019-12-05T03:50:27.260 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.248+0000 7f0f81b25700 1 -- start start 2019-12-05T03:50:27.260 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.248+0000 7f0f81b25700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0f7c09ba40 0x7f0f7c09add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:27.260 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.248+0000 7f0f81b25700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0f7c0b5370 0x7f0f7c0b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:27.261 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.248+0000 7f0f81b25700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f7c099e30 con 0x7f0f7c0b6970 2019-12-05T03:50:27.261 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.248+0000 7f0f81b25700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f7c09d210 con 0x7f0f7c09ba40 2019-12-05T03:50:27.261 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.248+0000 7f0f81b25700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c099b90 con 0x7f0f7c0b5370 2019-12-05T03:50:27.262 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.248+0000 7f0f7bfff700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f0f7c0b6970 0x7f0f7c05a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49238/0 (socket says 172.21.15.158:49238) 2019-12-05T03:50:27.262 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.248+0000 7f0f7bfff700 1 -- 172.21.15.158:0/2752659634 learned_addr learned my addr 172.21.15.158:0/2752659634 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:27.262 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.248+0000 7f0f737fe700 1 --2- 172.21.15.158:0/2752659634 >> v2:172.21.15.96:3300/0 conn(0x7f0f7c09ba40 0x7f0f7c09add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:27.263 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.248+0000 7f0f808c3700 1 --2- 172.21.15.158:0/2752659634 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0f7c0b5370 0x7f0f7c0b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:27.263 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.248+0000 7f0f7b7fe700 1 -- 172.21.15.158:0/2752659634 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4077192165 0 0) 0x7f0f7c099e30 con 0x7f0f7c0b6970 2019-12-05T03:50:27.263 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.248+0000 7f0f7b7fe700 1 -- 172.21.15.158:0/2752659634 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f680030b0 con 0x7f0f7c0b6970 2019-12-05T03:50:27.263 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.248+0000 7f0f737fe700 1 -- 172.21.15.158:0/2752659634 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0f7c0b5370 msgr2=0x7f0f7c0b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:27.264 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.248+0000 7f0f737fe700 1 --2- 172.21.15.158:0/2752659634 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0f7c0b5370 0x7f0f7c0b57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:27.264 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.248+0000 7f0f737fe700 1 -- 172.21.15.158:0/2752659634 >> v1:172.21.15.158:6789/0 conn(0x7f0f7c0b6970 legacy=0x7f0f7c05a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:27.264 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.248+0000 7f0f737fe700 1 -- 172.21.15.158:0/2752659634 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f7c07e960 con 0x7f0f7c09ba40 2019-12-05T03:50:27.264 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.248+0000 7f0f737fe700 1 --2- 172.21.15.158:0/2752659634 >> v2:172.21.15.96:3300/0 conn(0x7f0f7c09ba40 0x7f0f7c09add0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0f64008790 tx=0x7f0f6400fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.265 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.248+0000 7f0f737fe700 1 --2- 172.21.15.158:0/2752659634 >> v2:172.21.15.96:3300/0 conn(0x7f0f7c09ba40 0x7f0f7c09add0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0f64008790 tx=0x7f0f6400fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.265 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.248+0000 7f0f737fe700 1 --2- 172.21.15.158:0/2752659634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f7c09ba40 0x7f0f7c09add0 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7f0f64008790 tx=0x7f0f6400fc70).ready entity=mon.0 client_cookie=2f80f18836df1d56 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:27.265 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.248+0000 7f0f737fe700 1 --2- 172.21.15.158:0/2752659634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f7c09ba40 0x7f0f7c09add0 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f0f64008790 tx=0x7f0f6400fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.265 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.248+0000 7f0f7b7fe700 1 -- 172.21.15.158:0/2752659634 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f64008bb0 con 0x7f0f7c09ba40 2019-12-05T03:50:27.265 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.248+0000 7f0f737fe700 1 --2- 172.21.15.158:0/2752659634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f7c09ba40 0x7f0f7c09add0 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f0f64008790 tx=0x7f0f6400fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.266 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.248+0000 7f0f737fe700 1 --2- 172.21.15.158:0/2752659634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f7c09ba40 0x7f0f7c09add0 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f0f64008790 tx=0x7f0f6400fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.266 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.252+0000 7f0f7b7fe700 1 -- 172.21.15.158:0/2752659634 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f640087d0 con 0x7f0f7c09ba40 2019-12-05T03:50:27.266 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.252+0000 7f0f7b7fe700 1 -- 172.21.15.158:0/2752659634 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f64011860 con 0x7f0f7c09ba40 2019-12-05T03:50:27.266 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.252+0000 7f0f81b25700 1 -- 172.21.15.158:0/2752659634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f7c09ba40 msgr2=0x7f0f7c09add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:27.267 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.252+0000 7f0f81b25700 1 --2- 172.21.15.158:0/2752659634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f7c09ba40 0x7f0f7c09add0 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7f0f64008790 tx=0x7f0f6400fc70).stop 2019-12-05T03:50:27.267 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.252+0000 7f0f81b25700 1 -- 172.21.15.158:0/2752659634 shutdown_connections 2019-12-05T03:50:27.267 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.252+0000 7f0f81b25700 1 --2- 172.21.15.158:0/2752659634 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0f7c0b5370 0x7f0f7c0b57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:27.267 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.252+0000 7f0f81b25700 1 --2- 172.21.15.158:0/2752659634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f7c09ba40 0x7f0f7c09add0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:27.268 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.252+0000 7f0f81b25700 1 -- 172.21.15.158:0/2752659634 shutdown_connections 2019-12-05T03:50:27.268 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.252+0000 7f0f81b25700 1 -- 172.21.15.158:0/2752659634 wait complete. 2019-12-05T03:50:27.268 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.252+0000 7f0f81b25700 1 -- 172.21.15.158:0/2752659634 >> 172.21.15.158:0/2752659634 conn(0x7f0f7c0b7ef0 msgr2=0x7f0f7c0b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:27.274 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.256+0000 7f0f81b25700 1 Processor -- start 2019-12-05T03:50:27.274 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.256+0000 7f0f81b25700 1 -- start start 2019-12-05T03:50:27.274 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.256+0000 7f0f81b25700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f0f7c1395f0 0x7f0f7c13d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:27.274 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.256+0000 7f0f81b25700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0f7c0b31a0 0x7f0f7c139f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:27.275 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.256+0000 7f0f81b25700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0f7c138bd0 0x7f0f7c139000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:27.275 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.256+0000 7f0f81b25700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f7c139a20 con 0x7f0f7c138bd0 2019-12-05T03:50:27.275 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.256+0000 7f0f81b25700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f7c139cb0 con 0x7f0f7c1395f0 2019-12-05T03:50:27.275 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.256+0000 7f0f81b25700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c13a4a0 con 0x7f0f7c0b31a0 2019-12-05T03:50:27.275 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.256+0000 7f0f7bfff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f0f7c1395f0 0x7f0f7c13d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:27.276 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.256+0000 7f0f737fe700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0f7c0b31a0 0x7f0f7c139f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:27.276 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.256+0000 7f0f7bfff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f0f7c1395f0 0x7f0f7c13d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54464/0 (socket says 172.21.15.158:54464) 2019-12-05T03:50:27.276 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.256+0000 7f0f7bfff700 1 -- 172.21.15.158:0/2904675625 learned_addr learned my addr 172.21.15.158:0/2904675625 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:27.276 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.256+0000 7f0f808c3700 1 --2- 172.21.15.158:0/2904675625 >> v2:172.21.15.96:3300/0 conn(0x7f0f7c138bd0 0x7f0f7c139000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:27.277 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.256+0000 7f0f808c3700 1 -- 172.21.15.158:0/2904675625 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0f7c0b31a0 msgr2=0x7f0f7c139f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:27.277 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.256+0000 7f0f808c3700 1 --2- 172.21.15.158:0/2904675625 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0f7c0b31a0 0x7f0f7c139f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:27.277 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.256+0000 7f0f808c3700 1 -- 172.21.15.158:0/2904675625 >> v2:172.21.15.158:3300/0 conn(0x7f0f7c1395f0 msgr2=0x7f0f7c13d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:27.277 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.256+0000 7f0f808c3700 1 --2- 172.21.15.158:0/2904675625 >> v2:172.21.15.158:3300/0 conn(0x7f0f7c1395f0 0x7f0f7c13d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:27.278 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.256+0000 7f0f808c3700 1 -- 172.21.15.158:0/2904675625 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f7c0b35d0 con 0x7f0f7c138bd0 2019-12-05T03:50:27.278 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.256+0000 7f0f737fe700 1 --2- 172.21.15.158:0/2904675625 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0f7c0b31a0 0x7f0f7c139f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:50:27.278 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.256+0000 7f0f808c3700 1 --2- 172.21.15.158:0/2904675625 >> v2:172.21.15.96:3300/0 conn(0x7f0f7c138bd0 0x7f0f7c139000 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0f740032b0 tx=0x7f0f74010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.278 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.256+0000 7f0f808c3700 1 --2- 172.21.15.158:0/2904675625 >> v2:172.21.15.96:3300/0 conn(0x7f0f7c138bd0 0x7f0f7c139000 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0f740032b0 tx=0x7f0f74010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.278 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.256+0000 7f0f808c3700 1 --2- 172.21.15.158:0/2904675625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f7c138bd0 0x7f0f7c139000 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7f0f740032b0 tx=0x7f0f74010db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:27.279 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.256+0000 7f0f808c3700 1 --2- 172.21.15.158:0/2904675625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f7c138bd0 0x7f0f7c139000 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f0f740032b0 tx=0x7f0f74010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.279 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.256+0000 7f0f797fa700 1 -- 172.21.15.158:0/2904675625 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f74007350 con 0x7f0f7c138bd0 2019-12-05T03:50:27.279 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.256+0000 7f0f808c3700 1 --2- 172.21.15.158:0/2904675625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f7c138bd0 0x7f0f7c139000 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f0f740032b0 tx=0x7f0f74010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.279 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.256+0000 7f0f808c3700 1 --2- 172.21.15.158:0/2904675625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f7c138bd0 0x7f0f7c139000 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f0f740032b0 tx=0x7f0f74010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.280 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.256+0000 7f0f797fa700 1 -- 172.21.15.158:0/2904675625 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f74005cb0 con 0x7f0f7c138bd0 2019-12-05T03:50:27.280 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.256+0000 7f0f797fa700 1 -- 172.21.15.158:0/2904675625 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f74012470 con 0x7f0f7c138bd0 2019-12-05T03:50:27.280 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.256+0000 7f0f81b25700 1 -- 172.21.15.158:0/2904675625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f7c153dc0 con 0x7f0f7c138bd0 2019-12-05T03:50:27.280 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.256+0000 7f0f81b25700 1 -- 172.21.15.158:0/2904675625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f7c0acdf0 con 0x7f0f7c138bd0 2019-12-05T03:50:27.280 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.260+0000 7f0f808c3700 1 --2- 172.21.15.158:0/2904675625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f7c138bd0 0x7f0f7c139000 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f0f740032b0 tx=0x7f0f74010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.281 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.260+0000 7f0f797fa700 1 -- 172.21.15.158:0/2904675625 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f0f74012740 con 0x7f0f7c138bd0 2019-12-05T03:50:27.281 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.260+0000 7f0f808c3700 1 --2- 172.21.15.158:0/2904675625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f7c138bd0 0x7f0f7c139000 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f0f740032b0 tx=0x7f0f74010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.281 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.260+0000 7f0f797fa700 1 --2- 172.21.15.158:0/2904675625 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f0f6003ad40 0x7f0f6003d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:27.281 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.260+0000 7f0f797fa700 1 -- 172.21.15.158:0/2904675625 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f0f7404b4f0 con 0x7f0f7c138bd0 2019-12-05T03:50:27.282 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.260+0000 7f0f7bfff700 1 --2- 172.21.15.158:0/2904675625 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f0f6003ad40 0x7f0f6003d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:27.282 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.260+0000 7f0f7bfff700 1 --2- 172.21.15.158:0/2904675625 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f0f6003ad40 0x7f0f6003d250 crc :-1 s=READY pgs=120 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:27.282 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.260+0000 7f0f81b25700 1 -- 172.21.15.158:0/2904675625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f7c0554e0 con 0x7f0f7c138bd0 2019-12-05T03:50:27.284 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.268+0000 7f0f808c3700 1 --2- 172.21.15.158:0/2904675625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f7c138bd0 0x7f0f7c139000 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f0f740032b0 tx=0x7f0f74010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.284 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.268+0000 7f0f797fa700 1 -- 172.21.15.158:0/2904675625 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f0f74032570 con 0x7f0f7c138bd0 2019-12-05T03:50:27.429 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.420+0000 7f0f81b25700 1 -- 172.21.15.158:0/2904675625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f0f7c066940 con 0x7f0f7c138bd0 2019-12-05T03:50:27.430 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.424+0000 7f0f808c3700 1 --2- 172.21.15.158:0/2904675625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f7c138bd0 0x7f0f7c139000 secure :-1 s=THROTTLE_DONE pgs=184 cs=0 l=1 rx=0x7f0f740032b0 tx=0x7f0f74010db0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.430 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.424+0000 7f0f797fa700 1 -- 172.21.15.158:0/2904675625 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7f0f74010210 con 0x7f0f7c138bd0 2019-12-05T03:50:27.432 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:50:27.435 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.428+0000 7f0f81b25700 1 -- 172.21.15.158:0/2904675625 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f0f6003ad40 msgr2=0x7f0f6003d250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:27.435 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.428+0000 7f0f81b25700 1 --2- 172.21.15.158:0/2904675625 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f0f6003ad40 0x7f0f6003d250 crc :-1 s=READY pgs=120 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:27.435 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.428+0000 7f0f81b25700 1 -- 172.21.15.158:0/2904675625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f7c138bd0 msgr2=0x7f0f7c139000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:27.435 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.428+0000 7f0f81b25700 1 --2- 172.21.15.158:0/2904675625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f7c138bd0 0x7f0f7c139000 secure :-1 s=READY pgs=184 cs=0 l=1 rx=0x7f0f740032b0 tx=0x7f0f74010db0).stop 2019-12-05T03:50:27.435 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.428+0000 7f0f81b25700 1 -- 172.21.15.158:0/2904675625 shutdown_connections 2019-12-05T03:50:27.435 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.428+0000 7f0f81b25700 1 --2- 172.21.15.158:0/2904675625 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f0f6003ad40 0x7f0f6003d250 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:27.436 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.428+0000 7f0f81b25700 1 --2- 172.21.15.158:0/2904675625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f7c138bd0 0x7f0f7c139000 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:27.436 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.428+0000 7f0f81b25700 1 --2- 172.21.15.158:0/2904675625 >> v2:172.21.15.158:3300/0 conn(0x7f0f7c1395f0 0x7f0f7c13d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:27.436 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.428+0000 7f0f81b25700 1 --2- 172.21.15.158:0/2904675625 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0f7c0b31a0 0x7f0f7c139f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:27.436 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.428+0000 7f0f81b25700 1 -- 172.21.15.158:0/2904675625 shutdown_connections 2019-12-05T03:50:27.436 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.428+0000 7f0f81b25700 1 -- 172.21.15.158:0/2904675625 wait complete. 2019-12-05T03:50:27.436 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.428+0000 7f0f81b25700 1 -- 172.21.15.158:0/2904675625 >> 172.21.15.158:0/2904675625 conn(0x7f0f7c0b1e30 msgr2=0x7f0f7c07b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:27.445 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-05T03:50:27.543 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.528+0000 7f7a3b6bf700 1 Processor -- start 2019-12-05T03:50:27.543 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.528+0000 7f7a3b6bf700 1 -- start start 2019-12-05T03:50:27.543 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.532+0000 7f7a3b6bf700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7a3405a740 0x7f7a34155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:27.543 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.532+0000 7f7a3b6bf700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a340accb0 con 0x7f7a3409a320 2019-12-05T03:50:27.544 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.532+0000 7f7a3b6bf700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a34156100 con 0x7f7a3409cf60 2019-12-05T03:50:27.544 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.532+0000 7f7a3b6bf700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a3409a750 con 0x7f7a3405a740 2019-12-05T03:50:27.544 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.532+0000 7f7a3a45d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7a3405a740 0x7f7a34155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:27.544 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.532+0000 7f7a39c5c700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f7a3409cf60 0x7f7a34151460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49252/0 (socket says 172.21.15.158:49252) 2019-12-05T03:50:27.544 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.532+0000 7f7a39c5c700 1 -- 172.21.15.158:0/4214548036 learned_addr learned my addr 172.21.15.158:0/4214548036 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:27.544 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.532+0000 7f7a3a45d700 1 -- 172.21.15.158:0/4214548036 >> v1:172.21.15.158:6789/0 conn(0x7f7a3409cf60 legacy=0x7f7a34151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:27.545 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.532+0000 7f7a3a45d700 1 -- 172.21.15.158:0/4214548036 >> v1:172.21.15.96:6789/0 conn(0x7f7a3409a320 legacy=0x7f7a341553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:27.545 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.532+0000 7f7a38c5a700 1 -- 172.21.15.158:0/4214548036 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3441693571 0 0) 0x7f7a34156100 con 0x7f7a3409cf60 2019-12-05T03:50:27.545 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.532+0000 7f7a3a45d700 1 -- 172.21.15.158:0/4214548036 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a3405ab70 con 0x7f7a3405a740 2019-12-05T03:50:27.545 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.532+0000 7f7a3a45d700 1 --2- 172.21.15.158:0/4214548036 >> v2:172.21.15.158:3300/0 conn(0x7f7a3405a740 0x7f7a34155bb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7a3409c740 tx=0x7f7a2c00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.545 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.532+0000 7f7a3a45d700 1 --2- 172.21.15.158:0/4214548036 >> v2:172.21.15.158:3300/0 conn(0x7f7a3405a740 0x7f7a34155bb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7a3409c740 tx=0x7f7a2c00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.545 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.532+0000 7f7a3a45d700 1 --2- 172.21.15.158:0/4214548036 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7a3405a740 0x7f7a34155bb0 secure :-1 s=READY pgs=256 cs=0 l=1 rx=0x7f7a3409c740 tx=0x7f7a2c00fbf0).ready entity=mon.1 client_cookie=74ca187cacf4cb2d server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:27.545 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.532+0000 7f7a3a45d700 1 --2- 172.21.15.158:0/4214548036 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7a3405a740 0x7f7a34155bb0 secure :-1 s=THROTTLE_DONE pgs=256 cs=0 l=1 rx=0x7f7a3409c740 tx=0x7f7a2c00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.546 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.532+0000 7f7a38c5a700 1 -- 172.21.15.158:0/4214548036 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a2c008bb0 con 0x7f7a3405a740 2019-12-05T03:50:27.546 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.532+0000 7f7a3a45d700 1 --2- 172.21.15.158:0/4214548036 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7a3405a740 0x7f7a34155bb0 secure :-1 s=THROTTLE_DONE pgs=256 cs=0 l=1 rx=0x7f7a3409c740 tx=0x7f7a2c00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.546 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.532+0000 7f7a38c5a700 1 -- 172.21.15.158:0/4214548036 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2c0087d0 con 0x7f7a3405a740 2019-12-05T03:50:27.546 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.532+0000 7f7a3a45d700 1 --2- 172.21.15.158:0/4214548036 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7a3405a740 0x7f7a34155bb0 secure :-1 s=THROTTLE_DONE pgs=256 cs=0 l=1 rx=0x7f7a3409c740 tx=0x7f7a2c00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.546 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.532+0000 7f7a3b6bf700 1 -- 172.21.15.158:0/4214548036 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7a3405a740 msgr2=0x7f7a34155bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:27.546 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.532+0000 7f7a38c5a700 1 -- 172.21.15.158:0/4214548036 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a2c0118d0 con 0x7f7a3405a740 2019-12-05T03:50:27.546 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.532+0000 7f7a3b6bf700 1 --2- 172.21.15.158:0/4214548036 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7a3405a740 0x7f7a34155bb0 secure :-1 s=READY pgs=256 cs=0 l=1 rx=0x7f7a3409c740 tx=0x7f7a2c00fbf0).stop 2019-12-05T03:50:27.547 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.536+0000 7f7a3b6bf700 1 -- 172.21.15.158:0/4214548036 shutdown_connections 2019-12-05T03:50:27.547 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.536+0000 7f7a3b6bf700 1 --2- 172.21.15.158:0/4214548036 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7a3405a740 0x7f7a34155bb0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:27.547 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.536+0000 7f7a3b6bf700 1 -- 172.21.15.158:0/4214548036 shutdown_connections 2019-12-05T03:50:27.547 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.536+0000 7f7a3b6bf700 1 -- 172.21.15.158:0/4214548036 wait complete. 2019-12-05T03:50:27.547 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.536+0000 7f7a3b6bf700 1 -- 172.21.15.158:0/4214548036 >> 172.21.15.158:0/4214548036 conn(0x7f7a340b7e60 msgr2=0x7f7a340b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:27.551 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.536+0000 7f7a3b6bf700 1 Processor -- start 2019-12-05T03:50:27.551 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.536+0000 7f7a3b6bf700 1 -- start start 2019-12-05T03:50:27.551 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.540+0000 7f7a3b6bf700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7a3407cb50 0x7f7a3413df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:27.551 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.540+0000 7f7a3b6bf700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7a34153660 0x7f7a34153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:27.552 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.540+0000 7f7a3b6bf700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a3409b080 con 0x7f7a3409ac50 2019-12-05T03:50:27.552 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.540+0000 7f7a3b6bf700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a3407d380 con 0x7f7a34153660 2019-12-05T03:50:27.552 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.540+0000 7f7a3b6bf700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3407d620 con 0x7f7a3407cb50 2019-12-05T03:50:27.552 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.540+0000 7f7a3a45d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7a34153660 0x7f7a34153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:27.552 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.540+0000 7f7a3a45d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7a34153660 0x7f7a34153a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54482/0 (socket says 172.21.15.158:54482) 2019-12-05T03:50:27.552 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.540+0000 7f7a3a45d700 1 -- 172.21.15.158:0/2870253541 learned_addr learned my addr 172.21.15.158:0/2870253541 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:27.552 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.540+0000 7f7a3945b700 1 --2- 172.21.15.158:0/2870253541 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7a3407cb50 0x7f7a3413df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:27.553 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.540+0000 7f7a3a45d700 1 -- 172.21.15.158:0/2870253541 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7a3407cb50 msgr2=0x7f7a3413df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:27.553 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.540+0000 7f7a3a45d700 1 --2- 172.21.15.158:0/2870253541 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7a3407cb50 0x7f7a3413df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:27.553 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.540+0000 7f7a3a45d700 1 -- 172.21.15.158:0/2870253541 >> v1:172.21.15.96:6789/0 conn(0x7f7a3409ac50 legacy=0x7f7a3413d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:27.553 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.540+0000 7f7a3a45d700 1 -- 172.21.15.158:0/2870253541 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a3413e480 con 0x7f7a34153660 2019-12-05T03:50:27.553 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.540+0000 7f7a3a45d700 1 --2- 172.21.15.158:0/2870253541 >> v2:172.21.15.158:3300/0 conn(0x7f7a34153660 0x7f7a34153a90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7a3407d540 tx=0x7f7a2c008a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.553 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.540+0000 7f7a3a45d700 1 --2- 172.21.15.158:0/2870253541 >> v2:172.21.15.158:3300/0 conn(0x7f7a34153660 0x7f7a34153a90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7a3407d540 tx=0x7f7a2c008a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.554 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.540+0000 7f7a3a45d700 1 --2- 172.21.15.158:0/2870253541 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7a34153660 0x7f7a34153a90 secure :-1 s=READY pgs=257 cs=0 l=1 rx=0x7f7a3407d540 tx=0x7f7a2c008a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:27.554 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.540+0000 7f7a3a45d700 1 --2- 172.21.15.158:0/2870253541 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7a34153660 0x7f7a34153a90 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7f7a3407d540 tx=0x7f7a2c008a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.554 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.540+0000 7f7a267fc700 1 -- 172.21.15.158:0/2870253541 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a2c005540 con 0x7f7a34153660 2019-12-05T03:50:27.554 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.540+0000 7f7a3a45d700 1 --2- 172.21.15.158:0/2870253541 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7a34153660 0x7f7a34153a90 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7f7a3407d540 tx=0x7f7a2c008a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.554 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.540+0000 7f7a3a45d700 1 --2- 172.21.15.158:0/2870253541 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7a34153660 0x7f7a34153a90 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7f7a3407d540 tx=0x7f7a2c008a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.554 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.540+0000 7f7a267fc700 1 -- 172.21.15.158:0/2870253541 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2c008db0 con 0x7f7a34153660 2019-12-05T03:50:27.554 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.540+0000 7f7a3b6bf700 1 -- 172.21.15.158:0/2870253541 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a3407cf80 con 0x7f7a34153660 2019-12-05T03:50:27.554 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.540+0000 7f7a267fc700 1 -- 172.21.15.158:0/2870253541 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a2c005b20 con 0x7f7a34153660 2019-12-05T03:50:27.555 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.540+0000 7f7a3b6bf700 1 -- 172.21.15.158:0/2870253541 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a340b0b60 con 0x7f7a34153660 2019-12-05T03:50:27.555 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.540+0000 7f7a3a45d700 1 --2- 172.21.15.158:0/2870253541 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7a34153660 0x7f7a34153a90 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7f7a3407d540 tx=0x7f7a2c008a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.555 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.544+0000 7f7a267fc700 1 -- 172.21.15.158:0/2870253541 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f7a2c014450 con 0x7f7a34153660 2019-12-05T03:50:27.555 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.544+0000 7f7a3a45d700 1 --2- 172.21.15.158:0/2870253541 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7a34153660 0x7f7a34153a90 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7f7a3407d540 tx=0x7f7a2c008a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.555 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.544+0000 7f7a267fc700 1 --2- 172.21.15.158:0/2870253541 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f7a1c03ace0 0x7f7a1c03d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:27.555 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.544+0000 7f7a267fc700 1 -- 172.21.15.158:0/2870253541 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f7a2c012060 con 0x7f7a34153660 2019-12-05T03:50:27.555 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.544+0000 7f7a39c5c700 1 --2- 172.21.15.158:0/2870253541 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f7a1c03ace0 0x7f7a1c03d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:27.556 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.544+0000 7f7a39c5c700 1 --2- 172.21.15.158:0/2870253541 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f7a1c03ace0 0x7f7a1c03d1f0 crc :-1 s=READY pgs=121 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:27.556 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.544+0000 7f7a3b6bf700 1 -- 172.21.15.158:0/2870253541 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a340554e0 con 0x7f7a34153660 2019-12-05T03:50:27.560 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.552+0000 7f7a3a45d700 1 --2- 172.21.15.158:0/2870253541 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7a34153660 0x7f7a34153a90 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7f7a3407d540 tx=0x7f7a2c008a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.560 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.552+0000 7f7a267fc700 1 -- 172.21.15.158:0/2870253541 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f7a2c014d50 con 0x7f7a34153660 2019-12-05T03:50:27.720 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.712+0000 7f7a3b6bf700 1 -- 172.21.15.158:0/2870253541 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a3409a530 con 0x7f7a34153660 2019-12-05T03:50:27.722 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.716+0000 7f7a3a45d700 1 --2- 172.21.15.158:0/2870253541 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7a34153660 0x7f7a34153a90 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7f7a3407d540 tx=0x7f7a2c008a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.722 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.716+0000 7f7a267fc700 1 -- 172.21.15.158:0/2870253541 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+14933 (secure 0 0 0) 0x7f7a2c00ebf0 con 0x7f7a34153660 2019-12-05T03:50:27.723 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:27.724 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":23,"fsid":"a91186ae-f496-4de1-918d-820c55ff1feb","created":"2019-12-05T03:49:39.187523+0000","modified":"2019-12-05T03:50:01.249305+0000","last_up_change":"2019-12-05T03:49:48.551934+0000","last_in_change":"2019-12-05T03:49:48.551934+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-05T03:49:52.900870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-12-05T03:49:55.801462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-12-05T03:49:58.659250+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"782c4258-e28c-4a11-9d54-3c9c7a36fba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":12192},{"type":"v1","addr":"172.21.15.158:6801","nonce":12192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":12192},{"type":"v1","addr":"172.21.15.158:6803","nonce":12192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":12192},{"type":"v1","addr":"172.21.15.158:6807","nonce":12192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":12192},{"type":"v1","addr":"172.21.15.158:6805","nonce":12192}]},"public_addr":"172.21.15.158:6801/12192","cluster_addr":"172.21.15.158:6803/12192","heartbeat_back_addr":"172.21.15.158:6807/12192","heartbeat_front_addr":"172.21.15.158:6805/12192","state":["exists","up"]},{"osd":1,"uuid":"d4426b21-b666-4158-bf34-a24b14572731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":12193},{"type":"v1","addr":"172.21.15.158:6809","nonce":12193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":12193},{"type":"v1","addr":"172.21.15.158:6811","nonce":12193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":12193},{"type":"v1","addr":"172.21.15.158:6815","nonce":12193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":12193},{"type":"v1","addr":"172.21.15.158:6813","nonce":12193}]},"public_addr":"172.21.15.158:6809/12193","cluster_addr":"172.21.15.158:6811/12193","heartbeat_back_addr":"172.21.15.158:6815/12193","heartbeat_front_addr":"172.21.15.158:6813/12193","state":["exists","up"]},{"osd":2,"uuid":"22680edd-6490-4ab0-bb15-0605830e4cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":12195},{"type":"v1","addr":"172.21.15.158:6825","nonce":12195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":12195},{"type":"v1","addr":"172.21.15.158:6827","nonce":12195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":12195},{"type":"v1","addr":"172.21.15.158:6831","nonce":12195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":12195},{"type":"v1","addr":"172.21.15.158:6829","nonce":12195}]},"public_addr":"172.21.15.158:6825/12195","cluster_addr":"172.21.15.158:6827/12195","heartbeat_back_addr":"172.21.15.158:6831/12195","heartbeat_front_addr":"172.21.15.158:6829/12195","state":["exists","up"]},{"osd":3,"uuid":"7ec999ee-ace8-4ccb-a4f9-6f5d313bbbd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":12194},{"type":"v1","addr":"172.21.15.158:6817","nonce":12194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":12194},{"type":"v1","addr":"172.21.15.158:6819","nonce":12194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":12194},{"type":"v1","addr":"172.21.15.158:6823","nonce":12194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":12194},{"type":"v1","addr":"172.21.15.158:6821","nonce":12194}]},"public_addr":"172.21.15.158:6817/12194","cluster_addr":"172.21.15.158:6819/12194","heartbeat_back_addr":"172.21.15.158:6823/12194","heartbeat_front_addr":"172.21.15.158:6821/12194","state":["exists","up"]},{"osd":4,"uuid":"186e69c4-b69f-4dd1-bb8f-faf759c60484","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":12460},{"type":"v1","addr":"172.21.15.96:6803","nonce":12460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":12460},{"type":"v1","addr":"172.21.15.96:6805","nonce":12460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":12460},{"type":"v1","addr":"172.21.15.96:6809","nonce":12460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":12460},{"type":"v1","addr":"172.21.15.96:6807","nonce":12460}]},"public_addr":"172.21.15.96:6803/12460","cluster_addr":"172.21.15.96:6805/12460","heartbeat_back_addr":"172.21.15.96:6809/12460","heartbeat_front_addr":"172.21.15.96:6807/12460","state":["exists","up"]},{"osd":5,"uuid":"86b658b2-8b40-4cea-8163-305a3982758b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":12461},{"type":"v1","addr":"172.21.15.96:6811","nonce":12461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":12461},{"type":"v1","addr":"172.21.15.96:6813","nonce":12461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":12461},{"type":"v1","addr":"172.21.15.96:6817","nonce":12461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":12461},{"type":"v1","addr":"172.21.15.96:6815","nonce":12461}]},"public_addr":"172.21.15.96:6811/12461","cluster_addr":"172.21.15.96:6813/12461","heartbeat_back_addr":"172.21.15.96:6817/12461","heartbeat_front_addr":"172.21.15.96:6815/12461","state":["exists","up"]},{"osd":6,"uuid":"bdadaea8-9296-4788-bc59-d9c9eb8defdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":12463},{"type":"v1","addr":"172.21.15.96:6827","nonce":12463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":12463},{"type":"v1","addr":"172.21.15.96:6829","nonce":12463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":12463},{"type":"v1","addr":"172.21.15.96:6833","nonce":12463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":12463},{"type":"v1","addr":"172.21.15.96:6831","nonce":12463}]},"public_addr":"172.21.15.96:6827/12463","cluster_addr":"172.21.15.96:6829/12463","heartbeat_back_addr":"172.21.15.96:6833/12463","heartbeat_front_addr":"172.21.15.96:6831/12463","state":["exists","up"]},{"osd":7,"uuid":"c6d71846-d68e-430f-ab72-0fb8ea4bf640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":12462},{"type":"v1","addr":"172.21.15.96:6819","nonce":12462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":12462},{"type":"v1","addr":"172.21.15.96:6821","nonce":12462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":12462},{"type":"v1","addr":"172.21.15.96:6825","nonce":12462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":12462},{"type":"v1","addr":"172.21.15.96:6823","nonce":12462}]},"public_addr":"172.21.15.96:6819/12462","cluster_addr":"172.21.15.96:6821/12462","heartbeat_back_addr":"172.21.15.96:6825/12462","heartbeat_front_addr":"172.21.15.96:6823/12462","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.875762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.900817+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.210347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.133973+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.864697+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.131015+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.237225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.154377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-05T03:50:27.726 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.720+0000 7f7a3b6bf700 1 -- 172.21.15.158:0/2870253541 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f7a1c03ace0 msgr2=0x7f7a1c03d1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:27.726 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.720+0000 7f7a3b6bf700 1 --2- 172.21.15.158:0/2870253541 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f7a1c03ace0 0x7f7a1c03d1f0 crc :-1 s=READY pgs=121 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:27.726 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.720+0000 7f7a3b6bf700 1 -- 172.21.15.158:0/2870253541 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7a34153660 msgr2=0x7f7a34153a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:27.726 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.720+0000 7f7a3b6bf700 1 --2- 172.21.15.158:0/2870253541 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7a34153660 0x7f7a34153a90 secure :-1 s=READY pgs=257 cs=0 l=1 rx=0x7f7a3407d540 tx=0x7f7a2c008a40).stop 2019-12-05T03:50:27.727 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.720+0000 7f7a3b6bf700 1 -- 172.21.15.158:0/2870253541 shutdown_connections 2019-12-05T03:50:27.727 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.720+0000 7f7a3b6bf700 1 --2- 172.21.15.158:0/2870253541 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7a34153660 0x7f7a34153a90 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:27.727 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.720+0000 7f7a3b6bf700 1 --2- 172.21.15.158:0/2870253541 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f7a1c03ace0 0x7f7a1c03d1f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:27.727 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.720+0000 7f7a3b6bf700 1 --2- 172.21.15.158:0/2870253541 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7a3407cb50 0x7f7a3413df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:27.727 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.720+0000 7f7a3b6bf700 1 -- 172.21.15.158:0/2870253541 shutdown_connections 2019-12-05T03:50:27.727 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.720+0000 7f7a3b6bf700 1 -- 172.21.15.158:0/2870253541 wait complete. 2019-12-05T03:50:27.727 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.720+0000 7f7a3b6bf700 1 -- 172.21.15.158:0/2870253541 >> 172.21.15.158:0/2870253541 conn(0x7f7a340b7e60 msgr2=0x7f7a3412e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:27.736 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:49:52.900870+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:49:55.801462+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:49:58.659250+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-12-05T03:50:27.736 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-12-05T03:50:27.769 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:50:27.773 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:50:27.841 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.828+0000 7f1d4ba0e700 1 Processor -- start 2019-12-05T03:50:27.841 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.828+0000 7f1d4ba0e700 1 -- start start 2019-12-05T03:50:27.841 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.828+0000 7f1d4ba0e700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1d440b6970 0x7f1d4409add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:27.841 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.828+0000 7f1d4ba0e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f1d4409ba40 0x7f1d4405a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:27.842 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.828+0000 7f1d4ba0e700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d44099e30 con 0x7f1d4405a950 2019-12-05T03:50:27.842 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.828+0000 7f1d4ba0e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d4409d210 con 0x7f1d4409ba40 2019-12-05T03:50:27.842 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.828+0000 7f1d4ba0e700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d44099b90 con 0x7f1d440b6970 2019-12-05T03:50:27.842 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.832+0000 7f1d497aa700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f1d4409ba40 0x7f1d4405a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:27.843 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.832+0000 7f1d497aa700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f1d4409ba40 0x7f1d4405a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54488/0 (socket says 172.21.15.158:54488) 2019-12-05T03:50:27.843 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.832+0000 7f1d497aa700 1 -- 172.21.15.158:0/2644069407 learned_addr learned my addr 172.21.15.158:0/2644069407 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:27.843 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.832+0000 7f1d49fab700 1 --2- 172.21.15.158:0/2644069407 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1d440b6970 0x7f1d4409add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:27.843 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.832+0000 7f1d497aa700 1 -- 172.21.15.158:0/2644069407 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1d440b6970 msgr2=0x7f1d4409add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:27.843 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.832+0000 7f1d497aa700 1 --2- 172.21.15.158:0/2644069407 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1d440b6970 0x7f1d4409add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:27.843 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.832+0000 7f1d497aa700 1 -- 172.21.15.158:0/2644069407 >> v1:172.21.15.96:6789/0 conn(0x7f1d4405a950 legacy=0x7f1d44155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:27.843 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.832+0000 7f1d497aa700 1 -- 172.21.15.158:0/2644069407 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d4407e960 con 0x7f1d4409ba40 2019-12-05T03:50:27.844 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.832+0000 7f1d497aa700 1 --2- 172.21.15.158:0/2644069407 >> v2:172.21.15.158:3300/0 conn(0x7f1d4409ba40 0x7f1d4405a400 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1d38008790 tx=0x7f1d3800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.844 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.832+0000 7f1d497aa700 1 --2- 172.21.15.158:0/2644069407 >> v2:172.21.15.158:3300/0 conn(0x7f1d4409ba40 0x7f1d4405a400 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1d38008790 tx=0x7f1d3800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.844 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.832+0000 7f1d497aa700 1 --2- 172.21.15.158:0/2644069407 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1d4409ba40 0x7f1d4405a400 secure :-1 s=READY pgs=258 cs=0 l=1 rx=0x7f1d38008790 tx=0x7f1d3800fd30).ready entity=mon.1 client_cookie=5526fa5f8f649c0c server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:27.844 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.832+0000 7f1d497aa700 1 --2- 172.21.15.158:0/2644069407 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1d4409ba40 0x7f1d4405a400 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7f1d38008790 tx=0x7f1d3800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.844 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.832+0000 7f1d497aa700 1 --2- 172.21.15.158:0/2644069407 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1d4409ba40 0x7f1d4405a400 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7f1d38008790 tx=0x7f1d3800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.844 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.832+0000 7f1d48fa9700 1 -- 172.21.15.158:0/2644069407 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d38008c90 con 0x7f1d4409ba40 2019-12-05T03:50:27.844 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.832+0000 7f1d497aa700 1 --2- 172.21.15.158:0/2644069407 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1d4409ba40 0x7f1d4405a400 secure :-1 s=THROTTLE_DONE pgs=258 cs=0 l=1 rx=0x7f1d38008790 tx=0x7f1d3800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.845 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.832+0000 7f1d48fa9700 1 -- 172.21.15.158:0/2644069407 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d380088b0 con 0x7f1d4409ba40 2019-12-05T03:50:27.845 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.832+0000 7f1d48fa9700 1 -- 172.21.15.158:0/2644069407 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d38011b10 con 0x7f1d4409ba40 2019-12-05T03:50:27.845 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.832+0000 7f1d4ba0e700 1 -- 172.21.15.158:0/2644069407 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1d4409ba40 msgr2=0x7f1d4405a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:27.845 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.832+0000 7f1d4ba0e700 1 --2- 172.21.15.158:0/2644069407 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1d4409ba40 0x7f1d4405a400 secure :-1 s=READY pgs=258 cs=0 l=1 rx=0x7f1d38008790 tx=0x7f1d3800fd30).stop 2019-12-05T03:50:27.845 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.832+0000 7f1d4ba0e700 1 -- 172.21.15.158:0/2644069407 shutdown_connections 2019-12-05T03:50:27.845 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.832+0000 7f1d4ba0e700 1 --2- 172.21.15.158:0/2644069407 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1d440b6970 0x7f1d4409add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:27.845 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.832+0000 7f1d4ba0e700 1 --2- 172.21.15.158:0/2644069407 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f1d4409ba40 0x7f1d4405a400 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:27.846 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.832+0000 7f1d4ba0e700 1 -- 172.21.15.158:0/2644069407 shutdown_connections 2019-12-05T03:50:27.846 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.832+0000 7f1d4ba0e700 1 -- 172.21.15.158:0/2644069407 wait complete. 2019-12-05T03:50:27.846 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.832+0000 7f1d4ba0e700 1 -- 172.21.15.158:0/2644069407 >> 172.21.15.158:0/2644069407 conn(0x7f1d440b7ef0 msgr2=0x7f1d440b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:27.849 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.836+0000 7f1d4ba0e700 1 Processor -- start 2019-12-05T03:50:27.849 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.836+0000 7f1d4ba0e700 1 -- start start 2019-12-05T03:50:27.849 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.836+0000 7f1d4ba0e700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1d440b5bc0 0x7f1d440ad760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:27.849 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.836+0000 7f1d4ba0e700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1d44137ce0 0x7f1d440ae390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:27.849 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.836+0000 7f1d4ba0e700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d440b1890 con 0x7f1d440ae8e0 2019-12-05T03:50:27.849 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.836+0000 7f1d4ba0e700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d44153d00 con 0x7f1d44137ce0 2019-12-05T03:50:27.850 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.836+0000 7f1d4ba0e700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d441386d0 con 0x7f1d440b5bc0 2019-12-05T03:50:27.850 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.836+0000 7f1d497aa700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1d44137ce0 0x7f1d440ae390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:27.850 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.836+0000 7f1d49fab700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1d440b5bc0 0x7f1d440ad760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:27.850 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.836+0000 7f1d497aa700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1d44137ce0 0x7f1d440ae390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.158:41082/0 (socket says 172.21.15.158:41082) 2019-12-05T03:50:27.850 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.836+0000 7f1d49fab700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1d440b5bc0 0x7f1d440ad760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.158:37232/0 (socket says 172.21.15.158:37232) 2019-12-05T03:50:27.850 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.836+0000 7f1d497aa700 1 -- 172.21.15.158:0/3540413505 learned_addr learned my addr 172.21.15.158:0/3540413505 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:27.850 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.836+0000 7f1d497aa700 1 -- 172.21.15.158:0/3540413505 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1d440b5bc0 msgr2=0x7f1d440ad760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:27.851 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.836+0000 7f1d497aa700 1 --2- 172.21.15.158:0/3540413505 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1d440b5bc0 0x7f1d440ad760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:27.851 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.836+0000 7f1d497aa700 1 -- 172.21.15.158:0/3540413505 >> v1:172.21.15.96:6789/0 conn(0x7f1d440ae8e0 legacy=0x7f1d440593f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:27.851 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.836+0000 7f1d497aa700 1 -- 172.21.15.158:0/3540413505 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d440b5ff0 con 0x7f1d44137ce0 2019-12-05T03:50:27.851 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.836+0000 7f1d49fab700 1 --2- 172.21.15.158:0/3540413505 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1d440b5bc0 0x7f1d440ad760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:50:27.851 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.836+0000 7f1d497aa700 1 --2- 172.21.15.158:0/3540413505 >> v2:172.21.15.96:3300/0 conn(0x7f1d44137ce0 0x7f1d440ae390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1d44138890 tx=0x7f1d38008b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.851 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.836+0000 7f1d497aa700 1 --2- 172.21.15.158:0/3540413505 >> v2:172.21.15.96:3300/0 conn(0x7f1d44137ce0 0x7f1d440ae390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1d44138890 tx=0x7f1d38008b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.851 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.836+0000 7f1d497aa700 1 --2- 172.21.15.158:0/3540413505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d44137ce0 0x7f1d440ae390 secure :-1 s=READY pgs=189 cs=0 l=1 rx=0x7f1d44138890 tx=0x7f1d38008b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:27.852 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.840+0000 7f1d497aa700 1 --2- 172.21.15.158:0/3540413505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d44137ce0 0x7f1d440ae390 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f1d44138890 tx=0x7f1d38008b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.852 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.840+0000 7f1d427fc700 1 -- 172.21.15.158:0/3540413505 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d3800f490 con 0x7f1d44137ce0 2019-12-05T03:50:27.852 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.840+0000 7f1d497aa700 1 --2- 172.21.15.158:0/3540413505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d44137ce0 0x7f1d440ae390 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f1d44138890 tx=0x7f1d38008b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.852 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.840+0000 7f1d497aa700 1 --2- 172.21.15.158:0/3540413505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d44137ce0 0x7f1d440ae390 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f1d44138890 tx=0x7f1d38008b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.852 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.840+0000 7f1d427fc700 1 -- 172.21.15.158:0/3540413505 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d38011730 con 0x7f1d44137ce0 2019-12-05T03:50:27.853 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.840+0000 7f1d427fc700 1 -- 172.21.15.158:0/3540413505 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d38005730 con 0x7f1d44137ce0 2019-12-05T03:50:27.853 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.840+0000 7f1d4ba0e700 1 -- 172.21.15.158:0/3540413505 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d44138110 con 0x7f1d44137ce0 2019-12-05T03:50:27.853 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.840+0000 7f1d4ba0e700 1 -- 172.21.15.158:0/3540413505 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d44059bf0 con 0x7f1d44137ce0 2019-12-05T03:50:27.853 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.840+0000 7f1d497aa700 1 --2- 172.21.15.158:0/3540413505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d44137ce0 0x7f1d440ae390 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f1d44138890 tx=0x7f1d38008b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.854 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.840+0000 7f1d497aa700 1 --2- 172.21.15.158:0/3540413505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d44137ce0 0x7f1d440ae390 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f1d44138890 tx=0x7f1d38008b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.854 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.840+0000 7f1d427fc700 1 -- 172.21.15.158:0/3540413505 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f1d38005a10 con 0x7f1d44137ce0 2019-12-05T03:50:27.854 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.840+0000 7f1d427fc700 1 --2- 172.21.15.158:0/3540413505 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f1d2403aca0 0x7f1d2403d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:27.854 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.840+0000 7f1d427fc700 1 -- 172.21.15.158:0/3540413505 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f1d3804b890 con 0x7f1d44137ce0 2019-12-05T03:50:27.854 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.840+0000 7f1d49fab700 1 --2- 172.21.15.158:0/3540413505 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f1d2403aca0 0x7f1d2403d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:27.854 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.840+0000 7f1d49fab700 1 --2- 172.21.15.158:0/3540413505 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f1d2403aca0 0x7f1d2403d1b0 crc :-1 s=READY pgs=122 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:27.855 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.844+0000 7f1d4ba0e700 1 -- 172.21.15.158:0/3540413505 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d440554e0 con 0x7f1d44137ce0 2019-12-05T03:50:27.860 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.852+0000 7f1d497aa700 1 --2- 172.21.15.158:0/3540413505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d44137ce0 0x7f1d440ae390 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f1d44138890 tx=0x7f1d38008b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:27.860 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:27.852+0000 7f1d427fc700 1 -- 172.21.15.158:0/3540413505 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f1d38005d20 con 0x7f1d44137ce0 2019-12-05T03:50:28.022 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.016+0000 7f1d4ba0e700 1 -- 172.21.15.158:0/3540413505 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f1d44066940 con 0x7f1d44137ce0 2019-12-05T03:50:28.023 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.016+0000 7f1d497aa700 1 --2- 172.21.15.158:0/3540413505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d44137ce0 0x7f1d440ae390 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f1d44138890 tx=0x7f1d38008b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.023 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.016+0000 7f1d427fc700 1 -- 172.21.15.158:0/3540413505 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1d38032ab0 con 0x7f1d44137ce0 2019-12-05T03:50:28.025 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:50:28.028 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.020+0000 7f1d4ba0e700 1 -- 172.21.15.158:0/3540413505 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f1d2403aca0 msgr2=0x7f1d2403d1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:28.028 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.020+0000 7f1d4ba0e700 1 --2- 172.21.15.158:0/3540413505 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f1d2403aca0 0x7f1d2403d1b0 crc :-1 s=READY pgs=122 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:28.028 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.020+0000 7f1d4ba0e700 1 -- 172.21.15.158:0/3540413505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d44137ce0 msgr2=0x7f1d440ae390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:28.029 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.020+0000 7f1d4ba0e700 1 --2- 172.21.15.158:0/3540413505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d44137ce0 0x7f1d440ae390 secure :-1 s=READY pgs=189 cs=0 l=1 rx=0x7f1d44138890 tx=0x7f1d38008b90).stop 2019-12-05T03:50:28.029 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.020+0000 7f1d4ba0e700 1 -- 172.21.15.158:0/3540413505 shutdown_connections 2019-12-05T03:50:28.029 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.020+0000 7f1d4ba0e700 1 --2- 172.21.15.158:0/3540413505 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f1d2403aca0 0x7f1d2403d1b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:28.029 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.020+0000 7f1d4ba0e700 1 --2- 172.21.15.158:0/3540413505 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f1d440b5bc0 0x7f1d440ad760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:28.029 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.020+0000 7f1d4ba0e700 1 --2- 172.21.15.158:0/3540413505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d44137ce0 0x7f1d440ae390 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:28.029 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.020+0000 7f1d4ba0e700 1 -- 172.21.15.158:0/3540413505 shutdown_connections 2019-12-05T03:50:28.029 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.020+0000 7f1d4ba0e700 1 -- 172.21.15.158:0/3540413505 wait complete. 2019-12-05T03:50:28.030 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.020+0000 7f1d4ba0e700 1 -- 172.21.15.158:0/3540413505 >> 172.21.15.158:0/3540413505 conn(0x7f1d4409c990 msgr2=0x7f1d4405a500 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:28.038 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-12-05T03:50:28.205 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.192+0000 7faea81de700 1 Processor -- start 2019-12-05T03:50:28.206 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.192+0000 7faea81de700 1 -- start start 2019-12-05T03:50:28.206 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.192+0000 7faea81de700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7faea009add0 0x7faea00b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:28.206 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.192+0000 7faea81de700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faea0099e30 con 0x7faea00b6970 2019-12-05T03:50:28.206 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.196+0000 7faea81de700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faea00b60c0 con 0x7faea009ba40 2019-12-05T03:50:28.206 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.196+0000 7faea81de700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faea009d210 con 0x7faea009add0 2019-12-05T03:50:28.206 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.196+0000 7faea5f7a700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7faea009ba40 0x7faea00b5370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49282/0 (socket says 172.21.15.158:49282) 2019-12-05T03:50:28.206 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.196+0000 7faea5f7a700 1 -- 172.21.15.158:0/2083678533 learned_addr learned my addr 172.21.15.158:0/2083678533 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:28.207 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.196+0000 7faea6f7c700 1 --2- 172.21.15.158:0/2083678533 >> v2:172.21.15.96:3300/0 conn(0x7faea009add0 0x7faea00b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:28.207 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.196+0000 7faea5779700 1 -- 172.21.15.158:0/2083678533 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2428557267 0 0) 0x7faea00b60c0 con 0x7faea009ba40 2019-12-05T03:50:28.207 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.196+0000 7faea5779700 1 -- 172.21.15.158:0/2083678533 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae8c0030b0 con 0x7faea009ba40 2019-12-05T03:50:28.207 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.196+0000 7faea6f7c700 1 -- 172.21.15.158:0/2083678533 >> v1:172.21.15.158:6789/0 conn(0x7faea009ba40 legacy=0x7faea00b5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:28.207 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.196+0000 7faea5779700 1 -- 172.21.15.158:0/2083678533 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376560676 0 0) 0x7faea0099e30 con 0x7faea00b6970 2019-12-05T03:50:28.207 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.196+0000 7faea6f7c700 1 -- 172.21.15.158:0/2083678533 >> v1:172.21.15.96:6789/0 conn(0x7faea00b6970 legacy=0x7faea005a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:28.207 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.196+0000 7faea6f7c700 1 -- 172.21.15.158:0/2083678533 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea007e960 con 0x7faea009add0 2019-12-05T03:50:28.208 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.196+0000 7faea6f7c700 1 --2- 172.21.15.158:0/2083678533 >> v2:172.21.15.96:3300/0 conn(0x7faea009add0 0x7faea00b5b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fae980032b0 tx=0x7fae9800ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.208 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.196+0000 7faea6f7c700 1 --2- 172.21.15.158:0/2083678533 >> v2:172.21.15.96:3300/0 conn(0x7faea009add0 0x7faea00b5b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fae980032b0 tx=0x7fae9800ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.208 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.196+0000 7faea6f7c700 1 --2- 172.21.15.158:0/2083678533 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faea009add0 0x7faea00b5b70 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7fae980032b0 tx=0x7fae9800ff70).ready entity=mon.0 client_cookie=f1fe03aeef5367f2 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:28.208 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.196+0000 7faea6f7c700 1 --2- 172.21.15.158:0/2083678533 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faea009add0 0x7faea00b5b70 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7fae980032b0 tx=0x7fae9800ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.208 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.196+0000 7faea5779700 1 -- 172.21.15.158:0/2083678533 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae98010930 con 0x7faea009add0 2019-12-05T03:50:28.208 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.196+0000 7faea6f7c700 1 --2- 172.21.15.158:0/2083678533 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faea009add0 0x7faea00b5b70 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7fae980032b0 tx=0x7fae9800ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.208 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.196+0000 7faea5779700 1 -- 172.21.15.158:0/2083678533 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae98008b10 con 0x7faea009add0 2019-12-05T03:50:28.209 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.196+0000 7faea6f7c700 1 --2- 172.21.15.158:0/2083678533 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faea009add0 0x7faea00b5b70 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7fae980032b0 tx=0x7fae9800ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.209 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.196+0000 7faea5779700 1 -- 172.21.15.158:0/2083678533 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae980110c0 con 0x7faea009add0 2019-12-05T03:50:28.209 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.196+0000 7faea81de700 1 -- 172.21.15.158:0/2083678533 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faea009add0 msgr2=0x7faea00b5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:28.209 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.196+0000 7faea81de700 1 --2- 172.21.15.158:0/2083678533 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faea009add0 0x7faea00b5b70 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7fae980032b0 tx=0x7fae9800ff70).stop 2019-12-05T03:50:28.209 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.196+0000 7faea81de700 1 -- 172.21.15.158:0/2083678533 shutdown_connections 2019-12-05T03:50:28.209 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.196+0000 7faea81de700 1 --2- 172.21.15.158:0/2083678533 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faea009add0 0x7faea00b5b70 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:28.209 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.196+0000 7faea81de700 1 -- 172.21.15.158:0/2083678533 shutdown_connections 2019-12-05T03:50:28.210 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.196+0000 7faea81de700 1 -- 172.21.15.158:0/2083678533 wait complete. 2019-12-05T03:50:28.210 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.196+0000 7faea81de700 1 -- 172.21.15.158:0/2083678533 >> 172.21.15.158:0/2083678533 conn(0x7faea00b7ef0 msgr2=0x7faea00b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:28.215 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.200+0000 7faea81de700 1 Processor -- start 2019-12-05T03:50:28.215 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.200+0000 7faea81de700 1 -- start start 2019-12-05T03:50:28.215 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.200+0000 7faea81de700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faea00b3fd0 0x7faea007d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:28.215 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.200+0000 7faea81de700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faea01544c0 con 0x7faea0154090 2019-12-05T03:50:28.216 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.200+0000 7faea81de700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faea013eee0 con 0x7faea0133350 2019-12-05T03:50:28.216 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.200+0000 7faea81de700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea0136a90 con 0x7faea00b3fd0 2019-12-05T03:50:28.216 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.200+0000 7faea6f7c700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7faea0133350 0x7faea0133780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49288/0 (socket says 172.21.15.158:49288) 2019-12-05T03:50:28.216 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.200+0000 7faea6f7c700 1 -- 172.21.15.158:0/1502947932 learned_addr learned my addr 172.21.15.158:0/1502947932 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:28.216 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.200+0000 7faea677b700 1 --2- 172.21.15.158:0/1502947932 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faea00b3fd0 0x7faea007d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:28.216 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7fae96ffd700 1 -- 172.21.15.158:0/1502947932 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494873931 0 0) 0x7faea013eee0 con 0x7faea0133350 2019-12-05T03:50:28.216 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7fae96ffd700 1 -- 172.21.15.158:0/1502947932 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae880030b0 con 0x7faea0133350 2019-12-05T03:50:28.217 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7fae96ffd700 1 -- 172.21.15.158:0/1502947932 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 653298166 0 0) 0x7fae8c0030b0 con 0x7faea0154090 2019-12-05T03:50:28.217 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7fae96ffd700 1 -- 172.21.15.158:0/1502947932 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faea013eee0 con 0x7faea0154090 2019-12-05T03:50:28.217 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7fae96ffd700 1 -- 172.21.15.158:0/1502947932 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2547224866 0 0) 0x7fae880030b0 con 0x7faea0133350 2019-12-05T03:50:28.217 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7fae96ffd700 1 -- 172.21.15.158:0/1502947932 --> v1:172.21.15.158:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fae8c0030b0 con 0x7faea0133350 2019-12-05T03:50:28.217 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7fae96ffd700 1 -- 172.21.15.158:0/1502947932 <== mon.1 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 828730332 0 0) 0x7fae98010930 con 0x7faea0133350 2019-12-05T03:50:28.217 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7fae96ffd700 1 -- 172.21.15.158:0/1502947932 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faea00b3fd0 msgr2=0x7faea007d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:28.217 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7fae96ffd700 1 --2- 172.21.15.158:0/1502947932 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faea00b3fd0 0x7faea007d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:28.218 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7fae96ffd700 1 -- 172.21.15.158:0/1502947932 >> v1:172.21.15.158:6789/0 conn(0x7faea0133350 legacy=0x7faea0133780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:28.218 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7fae96ffd700 1 -- 172.21.15.158:0/1502947932 >> v1:172.21.15.96:6789/0 conn(0x7faea0154090 legacy=0x7faea0136f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:28.218 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7fae96ffd700 1 --2- 172.21.15.158:0/1502947932 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fae88003ab0 0x7fae88004420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:28.218 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7fae96ffd700 1 --2- 172.21.15.158:0/1502947932 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fae88003fc0 0x7fae88004a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:28.218 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7fae96ffd700 1 --2- 172.21.15.158:0/1502947932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae880095d0 0x7fae8800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:28.218 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7fae96ffd700 1 -- 172.21.15.158:0/1502947932 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea0136a90 con 0x7fae880095d0 2019-12-05T03:50:28.218 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7fae96ffd700 1 -- 172.21.15.158:0/1502947932 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae88005270 con 0x7fae88003ab0 2019-12-05T03:50:28.219 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7fae96ffd700 1 -- 172.21.15.158:0/1502947932 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae8800bfe0 con 0x7fae88003fc0 2019-12-05T03:50:28.219 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7faea677b700 1 --2- 172.21.15.158:0/1502947932 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7faea00b3fd0 0x7faea007d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:50:28.219 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7faea677b700 1 --2- 172.21.15.158:0/1502947932 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fae88003ab0 0x7fae88004420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:28.219 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7faea6f7c700 1 --2- 172.21.15.158:0/1502947932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae880095d0 0x7fae8800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:28.219 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7faea5f7a700 1 --2- 172.21.15.158:0/1502947932 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fae88003fc0 0x7fae88004a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:28.219 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7faea677b700 1 -- 172.21.15.158:0/1502947932 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fae88003fc0 msgr2=0x7fae88004a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:28.219 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7faea677b700 1 --2- 172.21.15.158:0/1502947932 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fae88003fc0 0x7fae88004a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:28.220 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7faea677b700 1 -- 172.21.15.158:0/1502947932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae880095d0 msgr2=0x7fae8800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:28.220 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7faea677b700 1 --2- 172.21.15.158:0/1502947932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae880095d0 0x7fae8800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:28.220 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7faea677b700 1 -- 172.21.15.158:0/1502947932 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea0137790 con 0x7fae88003ab0 2019-12-05T03:50:28.220 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7faea81de700 1 -- 172.21.15.158:0/1502947932 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faea00b3fd0 con 0x7fae88003ab0 2019-12-05T03:50:28.220 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7faea677b700 1 --2- 172.21.15.158:0/1502947932 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fae88003ab0 0x7fae88004420 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fae9c000e90 tx=0x7fae9c010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.220 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7faea5f7a700 1 --2- 172.21.15.158:0/1502947932 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fae88003fc0 0x7fae88004a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-12-05T03:50:28.220 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7faea81de700 1 -- 172.21.15.158:0/1502947932 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faea007d680 con 0x7fae88003ab0 2019-12-05T03:50:28.221 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7faea677b700 1 --2- 172.21.15.158:0/1502947932 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fae88003ab0 0x7fae88004420 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fae9c000e90 tx=0x7fae9c010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.221 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7faea677b700 1 --2- 172.21.15.158:0/1502947932 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fae88003ab0 0x7fae88004420 secure :-1 s=READY pgs=261 cs=0 l=1 rx=0x7fae9c000e90 tx=0x7fae9c010a20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:28.221 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7faea677b700 1 --2- 172.21.15.158:0/1502947932 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fae88003ab0 0x7fae88004420 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7fae9c000e90 tx=0x7fae9c010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.221 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7faea677b700 1 --2- 172.21.15.158:0/1502947932 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fae88003ab0 0x7fae88004420 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7fae9c000e90 tx=0x7fae9c010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.221 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7fae96ffd700 1 -- 172.21.15.158:0/1502947932 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae9c006360 con 0x7fae88003ab0 2019-12-05T03:50:28.221 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7faea677b700 1 --2- 172.21.15.158:0/1502947932 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fae88003ab0 0x7fae88004420 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7fae9c000e90 tx=0x7fae9c010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.221 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7fae96ffd700 1 -- 172.21.15.158:0/1502947932 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae9c0024b0 con 0x7fae88003ab0 2019-12-05T03:50:28.222 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7fae96ffd700 1 -- 172.21.15.158:0/1502947932 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae9c006940 con 0x7fae88003ab0 2019-12-05T03:50:28.222 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7faea677b700 1 --2- 172.21.15.158:0/1502947932 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fae88003ab0 0x7fae88004420 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7fae9c000e90 tx=0x7fae9c010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.222 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7fae96ffd700 1 -- 172.21.15.158:0/1502947932 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fae9c006b40 con 0x7fae88003ab0 2019-12-05T03:50:28.222 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7faea677b700 1 --2- 172.21.15.158:0/1502947932 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fae88003ab0 0x7fae88004420 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7fae9c000e90 tx=0x7fae9c010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.222 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7fae96ffd700 1 --2- 172.21.15.158:0/1502947932 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fae88043ec0 0x7fae880463d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:28.222 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7fae96ffd700 1 -- 172.21.15.158:0/1502947932 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fae9c04acf0 con 0x7fae88003ab0 2019-12-05T03:50:28.222 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.204+0000 7faea5f7a700 1 --2- 172.21.15.158:0/1502947932 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fae88043ec0 0x7fae880463d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:28.222 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.208+0000 7faea5f7a700 1 --2- 172.21.15.158:0/1502947932 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fae88043ec0 0x7fae880463d0 crc :-1 s=READY pgs=123 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:28.223 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.208+0000 7faea81de700 1 -- 172.21.15.158:0/1502947932 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae7c003200 con 0x7fae88003ab0 2019-12-05T03:50:28.223 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.212+0000 7faea677b700 1 --2- 172.21.15.158:0/1502947932 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fae88003ab0 0x7fae88004420 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7fae9c000e90 tx=0x7fae9c010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.223 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.212+0000 7fae96ffd700 1 -- 172.21.15.158:0/1502947932 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fae9c031d70 con 0x7fae88003ab0 2019-12-05T03:50:28.377 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.368+0000 7faea81de700 1 -- 172.21.15.158:0/1502947932 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7fae7c003650 con 0x7fae88003ab0 2019-12-05T03:50:28.377 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.372+0000 7faea677b700 1 --2- 172.21.15.158:0/1502947932 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fae88003ab0 0x7fae88004420 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7fae9c000e90 tx=0x7fae9c010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.377 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.372+0000 7fae96ffd700 1 -- 172.21.15.158:0/1502947932 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7fae9c031fd0 con 0x7fae88003ab0 2019-12-05T03:50:28.378 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:50:28.380 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.372+0000 7faea81de700 1 -- 172.21.15.158:0/1502947932 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fae88043ec0 msgr2=0x7fae880463d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:28.381 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.372+0000 7faea81de700 1 --2- 172.21.15.158:0/1502947932 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fae88043ec0 0x7fae880463d0 crc :-1 s=READY pgs=123 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:28.381 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.372+0000 7faea81de700 1 -- 172.21.15.158:0/1502947932 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fae88003ab0 msgr2=0x7fae88004420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:28.381 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.372+0000 7faea6f7c700 1 -- 172.21.15.158:0/1502947932 reap_dead start 2019-12-05T03:50:28.381 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.372+0000 7faea81de700 1 --2- 172.21.15.158:0/1502947932 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fae88003ab0 0x7fae88004420 secure :-1 s=READY pgs=261 cs=0 l=1 rx=0x7fae9c000e90 tx=0x7fae9c010a20).stop 2019-12-05T03:50:28.381 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.372+0000 7faea81de700 1 -- 172.21.15.158:0/1502947932 shutdown_connections 2019-12-05T03:50:28.381 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.372+0000 7faea81de700 1 --2- 172.21.15.158:0/1502947932 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fae88003ab0 0x7fae88004420 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:28.382 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.372+0000 7faea81de700 1 -- 172.21.15.158:0/1502947932 shutdown_connections 2019-12-05T03:50:28.382 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.372+0000 7faea81de700 1 -- 172.21.15.158:0/1502947932 wait complete. 2019-12-05T03:50:28.382 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.372+0000 7faea81de700 1 -- 172.21.15.158:0/1502947932 >> 172.21.15.158:0/1502947932 conn(0x7faea0128f10 msgr2=0x7faea01282f0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:28.389 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-12-05T03:50:28.493 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.480+0000 7f9690d6d700 1 Processor -- start 2019-12-05T03:50:28.493 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.480+0000 7f9690d6d700 1 -- start start 2019-12-05T03:50:28.494 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.480+0000 7f9690d6d700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f968c09add0 0x7f968c0b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:28.494 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.480+0000 7f9690d6d700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f968c099e30 con 0x7f968c09ba40 2019-12-05T03:50:28.494 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.480+0000 7f9690d6d700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f968c0b60c0 con 0x7f968c0b6970 2019-12-05T03:50:28.494 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.480+0000 7f9690d6d700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f968c09d210 con 0x7f968c09add0 2019-12-05T03:50:28.495 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.480+0000 7f968ad9d700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f968c0b6970 0x7f968c05a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49300/0 (socket says 172.21.15.158:49300) 2019-12-05T03:50:28.495 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.480+0000 7f968ad9d700 1 -- 172.21.15.158:0/3069961408 learned_addr learned my addr 172.21.15.158:0/3069961408 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:28.495 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f968b59e700 1 --2- 172.21.15.158:0/3069961408 >> v2:172.21.15.96:3300/0 conn(0x7f968c09add0 0x7f968c0b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:28.495 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f9689d9b700 1 -- 172.21.15.158:0/3069961408 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3570988630 0 0) 0x7f968c0b60c0 con 0x7f968c0b6970 2019-12-05T03:50:28.495 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f9689d9b700 1 -- 172.21.15.158:0/3069961408 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96740030b0 con 0x7f968c0b6970 2019-12-05T03:50:28.495 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f9689d9b700 1 -- 172.21.15.158:0/3069961408 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 226995138 0 0) 0x7f968c099e30 con 0x7f968c09ba40 2019-12-05T03:50:28.495 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f9689d9b700 1 -- 172.21.15.158:0/3069961408 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f968c0b60c0 con 0x7f968c09ba40 2019-12-05T03:50:28.496 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f9689d9b700 1 -- 172.21.15.158:0/3069961408 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3586361642 0 0) 0x7f96740030b0 con 0x7f968c0b6970 2019-12-05T03:50:28.496 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f9689d9b700 1 -- 172.21.15.158:0/3069961408 >> v2:172.21.15.96:3300/0 conn(0x7f968c09add0 msgr2=0x7f968c0b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:28.496 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f9689d9b700 1 --2- 172.21.15.158:0/3069961408 >> v2:172.21.15.96:3300/0 conn(0x7f968c09add0 0x7f968c0b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:28.496 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f9689d9b700 1 -- 172.21.15.158:0/3069961408 >> v1:172.21.15.96:6789/0 conn(0x7f968c09ba40 legacy=0x7f968c0b5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:28.496 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f9689d9b700 1 -- 172.21.15.158:0/3069961408 --> v1:172.21.15.158:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f968c07e960 con 0x7f968c0b6970 2019-12-05T03:50:28.496 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f9689d9b700 1 -- 172.21.15.158:0/3069961408 <== mon.1 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 828730332 0 0) 0x7f967c001750 con 0x7f968c0b6970 2019-12-05T03:50:28.497 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f9689d9b700 1 -- 172.21.15.158:0/3069961408 >> v1:172.21.15.158:6789/0 conn(0x7f968c0b6970 legacy=0x7f968c05a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:28.497 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f9689d9b700 1 --2- 172.21.15.158:0/3069961408 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9674003910 0x7f9674003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:28.497 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f9689d9b700 1 --2- 172.21.15.158:0/3069961408 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9674004470 0x7f9674004900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:28.497 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f9689d9b700 1 --2- 172.21.15.158:0/3069961408 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9674004f60 0x7f967400b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:28.497 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f9689d9b700 1 -- 172.21.15.158:0/3069961408 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968c09d210 con 0x7f9674003910 2019-12-05T03:50:28.497 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f9689d9b700 1 -- 172.21.15.158:0/3069961408 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967404fe80 con 0x7f9674004470 2019-12-05T03:50:28.497 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f9689d9b700 1 -- 172.21.15.158:0/3069961408 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96740500c0 con 0x7f9674004f60 2019-12-05T03:50:28.497 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f968a59c700 1 --2- 172.21.15.158:0/3069961408 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9674004470 0x7f9674004900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:28.498 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f968ad9d700 1 --2- 172.21.15.158:0/3069961408 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9674003910 0x7f9674003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:28.498 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f968b59e700 1 --2- 172.21.15.158:0/3069961408 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9674004f60 0x7f967400b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:28.498 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f968a59c700 1 -- 172.21.15.158:0/3069961408 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9674004f60 msgr2=0x7f967400b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:28.498 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f968a59c700 1 --2- 172.21.15.158:0/3069961408 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9674004f60 0x7f967400b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:28.498 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f968a59c700 1 -- 172.21.15.158:0/3069961408 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9674003910 msgr2=0x7f9674003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:28.498 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f968a59c700 1 --2- 172.21.15.158:0/3069961408 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9674003910 0x7f9674003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:28.498 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f968a59c700 1 -- 172.21.15.158:0/3069961408 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96740503c0 con 0x7f9674004470 2019-12-05T03:50:28.499 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f968b59e700 1 --2- 172.21.15.158:0/3069961408 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9674004f60 0x7f967400b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2019-12-05T03:50:28.499 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f968ad9d700 1 --2- 172.21.15.158:0/3069961408 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9674003910 0x7f9674003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-12-05T03:50:28.499 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f968b59e700 1 -- 172.21.15.158:0/3069961408 reap_dead start 2019-12-05T03:50:28.499 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f968a59c700 1 --2- 172.21.15.158:0/3069961408 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9674004470 0x7f9674004900 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9680000fe0 tx=0x7f968000be40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.499 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f968a59c700 1 --2- 172.21.15.158:0/3069961408 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9674004470 0x7f9674004900 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9680000fe0 tx=0x7f968000be40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.499 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f968a59c700 1 --2- 172.21.15.158:0/3069961408 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9674004470 0x7f9674004900 secure :-1 s=READY pgs=263 cs=0 l=1 rx=0x7f9680000fe0 tx=0x7f968000be40).ready entity=mon.1 client_cookie=4f16e4d993bacb18 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:28.499 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f968a59c700 1 --2- 172.21.15.158:0/3069961408 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9674004470 0x7f9674004900 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7f9680000fe0 tx=0x7f968000be40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.500 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f9689d9b700 1 -- 172.21.15.158:0/3069961408 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9680010af0 con 0x7f9674004470 2019-12-05T03:50:28.500 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f968a59c700 1 --2- 172.21.15.158:0/3069961408 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9674004470 0x7f9674004900 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7f9680000fe0 tx=0x7f968000be40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.500 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f968a59c700 1 --2- 172.21.15.158:0/3069961408 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9674004470 0x7f9674004900 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7f9680000fe0 tx=0x7f968000be40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.500 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f9689d9b700 1 -- 172.21.15.158:0/3069961408 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9680010710 con 0x7f9674004470 2019-12-05T03:50:28.500 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f9689d9b700 1 -- 172.21.15.158:0/3069961408 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f968000c760 con 0x7f9674004470 2019-12-05T03:50:28.500 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f9690d6d700 1 -- 172.21.15.158:0/3069961408 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9674004470 msgr2=0x7f9674004900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:28.500 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f9690d6d700 1 --2- 172.21.15.158:0/3069961408 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9674004470 0x7f9674004900 secure :-1 s=READY pgs=263 cs=0 l=1 rx=0x7f9680000fe0 tx=0x7f968000be40).stop 2019-12-05T03:50:28.501 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f9690d6d700 1 -- 172.21.15.158:0/3069961408 shutdown_connections 2019-12-05T03:50:28.501 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f9690d6d700 1 --2- 172.21.15.158:0/3069961408 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9674004470 0x7f9674004900 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:28.501 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f9690d6d700 1 -- 172.21.15.158:0/3069961408 shutdown_connections 2019-12-05T03:50:28.501 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f9690d6d700 1 -- 172.21.15.158:0/3069961408 wait complete. 2019-12-05T03:50:28.501 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.484+0000 7f9690d6d700 1 -- 172.21.15.158:0/3069961408 >> 172.21.15.158:0/3069961408 conn(0x7f968c0b7ef0 msgr2=0x7f968c0b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:28.506 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.488+0000 7f9690d6d700 1 Processor -- start 2019-12-05T03:50:28.506 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.488+0000 7f9690d6d700 1 -- start start 2019-12-05T03:50:28.506 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.488+0000 7f9690d6d700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f968c1523a0 0x7f968c13f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:28.507 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.488+0000 7f9690d6d700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f968c13db40 con 0x7f968c05f690 2019-12-05T03:50:28.507 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.488+0000 7f9690d6d700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f968c13d130 con 0x7f968c13f820 2019-12-05T03:50:28.507 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.488+0000 7f9690d6d700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f968c07d140 con 0x7f968c1523a0 2019-12-05T03:50:28.507 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.488+0000 7f968b59e700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f968c13f820 0x7f968c13c930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49314/0 (socket says 172.21.15.158:49314) 2019-12-05T03:50:28.507 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.488+0000 7f968b59e700 1 -- 172.21.15.158:0/3235182645 learned_addr learned my addr 172.21.15.158:0/3235182645 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:28.507 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.488+0000 7f968a59c700 1 --2- 172.21.15.158:0/3235182645 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f968c1523a0 0x7f968c13f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:28.507 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.488+0000 7f967b7fe700 1 -- 172.21.15.158:0/3235182645 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2877093265 0 0) 0x7f968c13d130 con 0x7f968c13f820 2019-12-05T03:50:28.508 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.488+0000 7f967b7fe700 1 -- 172.21.15.158:0/3235182645 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96700030b0 con 0x7f968c13f820 2019-12-05T03:50:28.508 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.492+0000 7f967b7fe700 1 -- 172.21.15.158:0/3235182645 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 575418070 0 0) 0x7f968c13db40 con 0x7f968c05f690 2019-12-05T03:50:28.508 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.492+0000 7f967b7fe700 1 -- 172.21.15.158:0/3235182645 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f968c13d130 con 0x7f968c05f690 2019-12-05T03:50:28.508 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.492+0000 7f967b7fe700 1 -- 172.21.15.158:0/3235182645 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 672049147 0 0) 0x7f96700030b0 con 0x7f968c13f820 2019-12-05T03:50:28.508 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.492+0000 7f968a59c700 1 -- 172.21.15.158:0/3235182645 >> v1:172.21.15.158:6789/0 conn(0x7f968c13f820 legacy=0x7f968c13c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:28.508 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.492+0000 7f968a59c700 1 -- 172.21.15.158:0/3235182645 >> v1:172.21.15.96:6789/0 conn(0x7f968c05f690 legacy=0x7f968c13fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:28.508 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.492+0000 7f968a59c700 1 -- 172.21.15.158:0/3235182645 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f968c1527d0 con 0x7f968c1523a0 2019-12-05T03:50:28.509 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.492+0000 7f968a59c700 1 --2- 172.21.15.158:0/3235182645 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f968c1523a0 0x7f968c13f2d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9684001860 tx=0x7f967c001c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.509 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.492+0000 7f968a59c700 1 --2- 172.21.15.158:0/3235182645 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f968c1523a0 0x7f968c13f2d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9684001860 tx=0x7f967c001c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.509 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.492+0000 7f968a59c700 1 --2- 172.21.15.158:0/3235182645 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f968c1523a0 0x7f968c13f2d0 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f9684001860 tx=0x7f967c001c00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:28.509 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.492+0000 7f968a59c700 1 --2- 172.21.15.158:0/3235182645 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f968c1523a0 0x7f968c13f2d0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f9684001860 tx=0x7f967c001c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.509 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.492+0000 7f967b7fe700 1 -- 172.21.15.158:0/3235182645 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9684001620 con 0x7f968c1523a0 2019-12-05T03:50:28.509 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.492+0000 7f968a59c700 1 --2- 172.21.15.158:0/3235182645 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f968c1523a0 0x7f968c13f2d0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f9684001860 tx=0x7f967c001c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.509 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.492+0000 7f967b7fe700 1 -- 172.21.15.158:0/3235182645 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9684007b20 con 0x7f968c1523a0 2019-12-05T03:50:28.510 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.492+0000 7f968a59c700 1 --2- 172.21.15.158:0/3235182645 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f968c1523a0 0x7f968c13f2d0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f9684001860 tx=0x7f967c001c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.510 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.492+0000 7f967b7fe700 1 -- 172.21.15.158:0/3235182645 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f968000cce0 con 0x7f968c1523a0 2019-12-05T03:50:28.510 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.492+0000 7f9690d6d700 1 -- 172.21.15.158:0/3235182645 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f968c13fc50 con 0x7f968c1523a0 2019-12-05T03:50:28.510 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.492+0000 7f9690d6d700 1 -- 172.21.15.158:0/3235182645 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f968c13d360 con 0x7f968c1523a0 2019-12-05T03:50:28.510 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.492+0000 7f968a59c700 1 --2- 172.21.15.158:0/3235182645 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f968c1523a0 0x7f968c13f2d0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f9684001860 tx=0x7f967c001c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.510 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.492+0000 7f967b7fe700 1 -- 172.21.15.158:0/3235182645 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f9680006360 con 0x7f968c1523a0 2019-12-05T03:50:28.510 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.492+0000 7f968a59c700 1 --2- 172.21.15.158:0/3235182645 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f968c1523a0 0x7f968c13f2d0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f9684001860 tx=0x7f967c001c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.511 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.492+0000 7f967b7fe700 1 --2- 172.21.15.158:0/3235182645 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f967003b450 0x7f967003d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:28.511 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.492+0000 7f967b7fe700 1 -- 172.21.15.158:0/3235182645 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f968004ad70 con 0x7f968c1523a0 2019-12-05T03:50:28.511 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.492+0000 7f968ad9d700 1 --2- 172.21.15.158:0/3235182645 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f967003b450 0x7f967003d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:28.511 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.496+0000 7f968ad9d700 1 --2- 172.21.15.158:0/3235182645 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f967003b450 0x7f967003d960 crc :-1 s=READY pgs=124 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:28.511 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.496+0000 7f9690d6d700 1 -- 172.21.15.158:0/3235182645 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f968c0554e0 con 0x7f968c1523a0 2019-12-05T03:50:28.512 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.504+0000 7f968a59c700 1 --2- 172.21.15.158:0/3235182645 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f968c1523a0 0x7f968c13f2d0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f9684001860 tx=0x7f967c001c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.512 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.504+0000 7f967b7fe700 1 -- 172.21.15.158:0/3235182645 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f9680032c00 con 0x7f968c1523a0 2019-12-05T03:50:28.668 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.660+0000 7f9690d6d700 1 -- 172.21.15.158:0/3235182645 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f968c0655c0 con 0x7f968c1523a0 2019-12-05T03:50:28.668 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.660+0000 7f968a59c700 1 --2- 172.21.15.158:0/3235182645 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f968c1523a0 0x7f968c13f2d0 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f9684001860 tx=0x7f967c001c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.669 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.660+0000 7f967b7fe700 1 -- 172.21.15.158:0/3235182645 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7f9680006c60 con 0x7f968c1523a0 2019-12-05T03:50:28.669 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:50:28.671 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.664+0000 7f9690d6d700 1 -- 172.21.15.158:0/3235182645 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f967003b450 msgr2=0x7f967003d960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:28.671 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.664+0000 7f9690d6d700 1 --2- 172.21.15.158:0/3235182645 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f967003b450 0x7f967003d960 crc :-1 s=READY pgs=124 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:28.672 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.664+0000 7f9690d6d700 1 -- 172.21.15.158:0/3235182645 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f968c1523a0 msgr2=0x7f968c13f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:28.672 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.664+0000 7f9690d6d700 1 --2- 172.21.15.158:0/3235182645 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f968c1523a0 0x7f968c13f2d0 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f9684001860 tx=0x7f967c001c00).stop 2019-12-05T03:50:28.672 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.664+0000 7f9690d6d700 1 -- 172.21.15.158:0/3235182645 shutdown_connections 2019-12-05T03:50:28.672 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.664+0000 7f9690d6d700 1 --2- 172.21.15.158:0/3235182645 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f967003b450 0x7f967003d960 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:28.672 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.664+0000 7f9690d6d700 1 --2- 172.21.15.158:0/3235182645 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f968c1523a0 0x7f968c13f2d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:28.673 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.664+0000 7f9690d6d700 1 -- 172.21.15.158:0/3235182645 shutdown_connections 2019-12-05T03:50:28.673 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.664+0000 7f9690d6d700 1 -- 172.21.15.158:0/3235182645 wait complete. 2019-12-05T03:50:28.673 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.664+0000 7f9690d6d700 1 -- 172.21.15.158:0/3235182645 >> 172.21.15.158:0/3235182645 conn(0x7f968c0b66b0 msgr2=0x7f968c07da00 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:28.686 INFO:tasks.cephfs_test_runner:Starting test: test_forbidden_modification (tasks.cephfs.test_pool_perm.TestPoolPerm) 2019-12-05T03:50:28.687 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification' 2019-12-05T03:50:28.787 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.772+0000 7fa9c3f61700 1 Processor -- start 2019-12-05T03:50:28.787 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.772+0000 7fa9c3f61700 1 -- start start 2019-12-05T03:50:28.788 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.776+0000 7fa9c3f61700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9bc09cf50 0x7fa9bc09a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:28.788 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.776+0000 7fa9c3f61700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa9bc05a730 0x7fa9bc151450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:28.788 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.776+0000 7fa9c3f61700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9bc0acca0 con 0x7fa9bc1519a0 2019-12-05T03:50:28.788 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.776+0000 7fa9c3f61700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9bc0b1720 con 0x7fa9bc05a730 2019-12-05T03:50:28.788 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.776+0000 7fa9c3f61700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9bc0b19c0 con 0x7fa9bc09cf50 2019-12-05T03:50:28.789 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.776+0000 7fa9c24fe700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9bc09cf50 0x7fa9bc09a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:28.789 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.776+0000 7fa9c1cfd700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa9bc05a730 0x7fa9bc151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:28.789 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.776+0000 7fa9c24fe700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9bc09cf50 0x7fa9bc09a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.158:37280/0 (socket says 172.21.15.158:37280) 2019-12-05T03:50:28.789 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.776+0000 7fa9c24fe700 1 -- 172.21.15.158:0/286210182 learned_addr learned my addr 172.21.15.158:0/286210182 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:28.790 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.776+0000 7fa9c24fe700 1 -- 172.21.15.158:0/286210182 >> v2:172.21.15.96:3300/0 conn(0x7fa9bc05a730 msgr2=0x7fa9bc151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:28.790 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.776+0000 7fa9c24fe700 1 --2- 172.21.15.158:0/286210182 >> v2:172.21.15.96:3300/0 conn(0x7fa9bc05a730 0x7fa9bc151450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:28.790 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.776+0000 7fa9c24fe700 1 -- 172.21.15.158:0/286210182 >> v1:172.21.15.96:6789/0 conn(0x7fa9bc1519a0 legacy=0x7fa9bc0b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:28.790 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.776+0000 7fa9c24fe700 1 -- 172.21.15.158:0/286210182 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9bc05ab60 con 0x7fa9bc09cf50 2019-12-05T03:50:28.791 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.776+0000 7fa9c24fe700 1 --2- 172.21.15.158:0/286210182 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9bc09cf50 0x7fa9bc09a310 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa9b8008b10 tx=0x7fa9b80100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.791 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.776+0000 7fa9c24fe700 1 --2- 172.21.15.158:0/286210182 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9bc09cf50 0x7fa9bc09a310 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa9b8008b10 tx=0x7fa9b80100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.791 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.776+0000 7fa9c24fe700 1 --2- 172.21.15.158:0/286210182 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9bc09cf50 0x7fa9bc09a310 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7fa9b8008b10 tx=0x7fa9b80100b0).ready entity=mon.2 client_cookie=73508b118c73e616 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:28.791 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.776+0000 7fa9c24fe700 1 --2- 172.21.15.158:0/286210182 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9bc09cf50 0x7fa9bc09a310 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7fa9b8008b10 tx=0x7fa9b80100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.792 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.776+0000 7fa9c24fe700 1 --2- 172.21.15.158:0/286210182 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9bc09cf50 0x7fa9bc09a310 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7fa9b8008b10 tx=0x7fa9b80100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.792 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.776+0000 7fa9c14fc700 1 -- 172.21.15.158:0/286210182 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9b800a160 con 0x7fa9bc09cf50 2019-12-05T03:50:28.792 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.776+0000 7fa9c24fe700 1 --2- 172.21.15.158:0/286210182 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9bc09cf50 0x7fa9bc09a310 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7fa9b8008b10 tx=0x7fa9b80100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.792 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.776+0000 7fa9c14fc700 1 -- 172.21.15.158:0/286210182 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b8011b20 con 0x7fa9bc09cf50 2019-12-05T03:50:28.793 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.776+0000 7fa9c14fc700 1 -- 172.21.15.158:0/286210182 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9b800a740 con 0x7fa9bc09cf50 2019-12-05T03:50:28.793 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.776+0000 7fa9c3f61700 1 -- 172.21.15.158:0/286210182 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9bc09cf50 msgr2=0x7fa9bc09a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:28.793 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.776+0000 7fa9c3f61700 1 --2- 172.21.15.158:0/286210182 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9bc09cf50 0x7fa9bc09a310 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7fa9b8008b10 tx=0x7fa9b80100b0).stop 2019-12-05T03:50:28.793 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.780+0000 7fa9c3f61700 1 -- 172.21.15.158:0/286210182 shutdown_connections 2019-12-05T03:50:28.793 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.780+0000 7fa9c3f61700 1 --2- 172.21.15.158:0/286210182 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9bc09cf50 0x7fa9bc09a310 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:28.794 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.780+0000 7fa9c3f61700 1 --2- 172.21.15.158:0/286210182 >> v2:172.21.15.96:3300/0 conn(0x7fa9bc05a730 0x7fa9bc151450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:28.794 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.780+0000 7fa9c3f61700 1 -- 172.21.15.158:0/286210182 shutdown_connections 2019-12-05T03:50:28.794 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.780+0000 7fa9c3f61700 1 -- 172.21.15.158:0/286210182 wait complete. 2019-12-05T03:50:28.794 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.780+0000 7fa9c3f61700 1 -- 172.21.15.158:0/286210182 >> 172.21.15.158:0/286210182 conn(0x7fa9bc0b7e50 msgr2=0x7fa9bc0b3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:28.800 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.780+0000 7fa9c3f61700 1 Processor -- start 2019-12-05T03:50:28.800 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.780+0000 7fa9c3f61700 1 -- start start 2019-12-05T03:50:28.800 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.784+0000 7fa9c3f61700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9bc152d10 0x7fa9bc151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:28.800 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.784+0000 7fa9c3f61700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9bc13c380 con 0x7fa9bc07c480 2019-12-05T03:50:28.801 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.784+0000 7fa9c3f61700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9bc0b1010 con 0x7fa9bc13ce70 2019-12-05T03:50:28.801 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.784+0000 7fa9c3f61700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9bc13c690 con 0x7fa9bc152d10 2019-12-05T03:50:28.801 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.784+0000 7fa9c24fe700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fa9bc13ce70 0x7fa9bc07af80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49326/0 (socket says 172.21.15.158:49326) 2019-12-05T03:50:28.801 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.784+0000 7fa9c24fe700 1 -- 172.21.15.158:0/686202585 learned_addr learned my addr 172.21.15.158:0/686202585 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:28.803 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.784+0000 7fa9c2cff700 1 --2- 172.21.15.158:0/686202585 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9bc152d10 0x7fa9bc151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:28.803 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.784+0000 7fa9b2ffd700 1 -- 172.21.15.158:0/686202585 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3086739800 0 0) 0x7fa9bc0b1010 con 0x7fa9bc13ce70 2019-12-05T03:50:28.804 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.784+0000 7fa9b2ffd700 1 -- 172.21.15.158:0/686202585 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9a40030b0 con 0x7fa9bc13ce70 2019-12-05T03:50:28.804 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.784+0000 7fa9b2ffd700 1 -- 172.21.15.158:0/686202585 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1240849976 0 0) 0x7fa9bc13c380 con 0x7fa9bc07c480 2019-12-05T03:50:28.804 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.784+0000 7fa9b2ffd700 1 -- 172.21.15.158:0/686202585 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9bc0b1010 con 0x7fa9bc07c480 2019-12-05T03:50:28.804 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.784+0000 7fa9b2ffd700 1 -- 172.21.15.158:0/686202585 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2427781202 0 0) 0x7fa9a40030b0 con 0x7fa9bc13ce70 2019-12-05T03:50:28.804 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.784+0000 7fa9b2ffd700 1 -- 172.21.15.158:0/686202585 --> v1:172.21.15.158:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa9bc13c380 con 0x7fa9bc13ce70 2019-12-05T03:50:28.804 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.784+0000 7fa9b2ffd700 1 -- 172.21.15.158:0/686202585 <== mon.1 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 828730332 0 0) 0x7fa9b800a160 con 0x7fa9bc13ce70 2019-12-05T03:50:28.805 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.784+0000 7fa9c2cff700 1 -- 172.21.15.158:0/686202585 >> v1:172.21.15.158:6789/0 conn(0x7fa9bc13ce70 legacy=0x7fa9bc07af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:28.805 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.784+0000 7fa9c2cff700 1 -- 172.21.15.158:0/686202585 >> v1:172.21.15.96:6789/0 conn(0x7fa9bc07c480 legacy=0x7fa9bc151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:28.805 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.784+0000 7fa9c2cff700 1 -- 172.21.15.158:0/686202585 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9bc07c8b0 con 0x7fa9bc152d10 2019-12-05T03:50:28.805 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.784+0000 7fa9c2cff700 1 --2- 172.21.15.158:0/686202585 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9bc152d10 0x7fa9bc151a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa9b4000e90 tx=0x7fa9b8008650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.805 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.784+0000 7fa9c2cff700 1 --2- 172.21.15.158:0/686202585 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9bc152d10 0x7fa9bc151a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa9b4000e90 tx=0x7fa9b8008650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.805 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.784+0000 7fa9c2cff700 1 --2- 172.21.15.158:0/686202585 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9bc152d10 0x7fa9bc151a20 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7fa9b4000e90 tx=0x7fa9b8008650).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:28.805 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.784+0000 7fa9c2cff700 1 --2- 172.21.15.158:0/686202585 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9bc152d10 0x7fa9bc151a20 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7fa9b4000e90 tx=0x7fa9b8008650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.806 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.784+0000 7fa9b2ffd700 1 -- 172.21.15.158:0/686202585 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9b4006920 con 0x7fa9bc152d10 2019-12-05T03:50:28.806 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.784+0000 7fa9c2cff700 1 --2- 172.21.15.158:0/686202585 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9bc152d10 0x7fa9bc151a20 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7fa9b4000e90 tx=0x7fa9b8008650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.806 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.784+0000 7fa9b2ffd700 1 -- 172.21.15.158:0/686202585 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b4006540 con 0x7fa9bc152d10 2019-12-05T03:50:28.806 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.784+0000 7fa9c2cff700 1 --2- 172.21.15.158:0/686202585 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9bc152d10 0x7fa9bc151a20 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7fa9b4000e90 tx=0x7fa9b8008650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.806 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.784+0000 7fa9c3f61700 1 -- 172.21.15.158:0/686202585 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9bc07b780 con 0x7fa9bc152d10 2019-12-05T03:50:28.806 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.784+0000 7fa9b2ffd700 1 -- 172.21.15.158:0/686202585 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9b4010d10 con 0x7fa9bc152d10 2019-12-05T03:50:28.807 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.784+0000 7fa9c3f61700 1 -- 172.21.15.158:0/686202585 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9bc153140 con 0x7fa9bc152d10 2019-12-05T03:50:28.807 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.788+0000 7fa9c2cff700 1 --2- 172.21.15.158:0/686202585 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9bc152d10 0x7fa9bc151a20 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7fa9b4000e90 tx=0x7fa9b8008650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.807 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.788+0000 7fa9c2cff700 1 --2- 172.21.15.158:0/686202585 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9bc152d10 0x7fa9bc151a20 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7fa9b4000e90 tx=0x7fa9b8008650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.807 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.788+0000 7fa9b2ffd700 1 -- 172.21.15.158:0/686202585 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fa9b4011070 con 0x7fa9bc152d10 2019-12-05T03:50:28.807 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.788+0000 7fa9b2ffd700 1 --2- 172.21.15.158:0/686202585 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa9a403b870 0x7fa9a403dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:28.807 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.788+0000 7fa9b2ffd700 1 -- 172.21.15.158:0/686202585 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fa9b404ace0 con 0x7fa9bc152d10 2019-12-05T03:50:28.807 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.788+0000 7fa9c24fe700 1 --2- 172.21.15.158:0/686202585 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa9a403b870 0x7fa9a403dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:28.808 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.788+0000 7fa9c24fe700 1 --2- 172.21.15.158:0/686202585 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa9a403b870 0x7fa9a403dd80 crc :-1 s=READY pgs=125 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:28.808 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.788+0000 7fa9c3f61700 1 -- 172.21.15.158:0/686202585 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9bc0554d0 con 0x7fa9bc152d10 2019-12-05T03:50:28.809 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.800+0000 7fa9c2cff700 1 --2- 172.21.15.158:0/686202585 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9bc152d10 0x7fa9bc151a20 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7fa9b4000e90 tx=0x7fa9b8008650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:28.809 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.800+0000 7fa9b2ffd700 1 -- 172.21.15.158:0/686202585 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fa9b4031d20 con 0x7fa9bc152d10 2019-12-05T03:50:28.974 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:28.968+0000 7fa9c3f61700 1 -- 172.21.15.158:0/686202585 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]} v 0) v1 -- 0x7fa9bc066930 con 0x7fa9bc152d10 2019-12-05T03:50:29.980 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:29.972+0000 7fa9c2cff700 1 --2- 172.21.15.158:0/686202585 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9bc152d10 0x7fa9bc151a20 secure :-1 s=THROTTLE_DONE pgs=60 cs=0 l=1 rx=0x7fa9b4000e90 tx=0x7fa9b8008650).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:29.981 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:29.972+0000 7fa9b2ffd700 1 -- 172.21.15.158:0/686202585 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]}]=0 v48) v1 ==== 150+0+0 (secure 0 0 0) 0x7fa9b4031f80 con 0x7fa9bc152d10 2019-12-05T03:50:29.996 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:29.988+0000 7fa9c3f61700 1 -- 172.21.15.158:0/686202585 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa9a403b870 msgr2=0x7fa9a403dd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:29.996 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:29.988+0000 7fa9c3f61700 1 --2- 172.21.15.158:0/686202585 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa9a403b870 0x7fa9a403dd80 crc :-1 s=READY pgs=125 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:29.997 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:29.988+0000 7fa9c3f61700 1 -- 172.21.15.158:0/686202585 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9bc152d10 msgr2=0x7fa9bc151a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:29.997 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:29.988+0000 7fa9c3f61700 1 --2- 172.21.15.158:0/686202585 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9bc152d10 0x7fa9bc151a20 secure :-1 s=READY pgs=60 cs=0 l=1 rx=0x7fa9b4000e90 tx=0x7fa9b8008650).stop 2019-12-05T03:50:29.997 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:29.988+0000 7fa9c3f61700 1 -- 172.21.15.158:0/686202585 shutdown_connections 2019-12-05T03:50:29.997 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:29.988+0000 7fa9c3f61700 1 --2- 172.21.15.158:0/686202585 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa9bc152d10 0x7fa9bc151a20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:29.997 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:29.988+0000 7fa9c3f61700 1 --2- 172.21.15.158:0/686202585 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa9a403b870 0x7fa9a403dd80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:29.997 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:29.988+0000 7fa9c3f61700 1 -- 172.21.15.158:0/686202585 shutdown_connections 2019-12-05T03:50:29.997 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:29.988+0000 7fa9c3f61700 1 -- 172.21.15.158:0/686202585 wait complete. 2019-12-05T03:50:29.998 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:29.988+0000 7fa9c3f61700 1 -- 172.21.15.158:0/686202585 >> 172.21.15.158:0/686202585 conn(0x7fa9bc0b7e50 msgr2=0x7fa9bc1555b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:30.008 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2019-12-05T03:50:30.009 INFO:teuthology.orchestra.run.smithi096:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-12-05T03:50:30.034 INFO:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2019-12-05T03:50:30.069 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2019-12-05T03:50:30.069 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:30.069 INFO:teuthology.orchestra.run.smithi158:> stat --file-system '--printf=%T 2019-12-05T03:50:30.070 INFO:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.0 2019-12-05T03:50:30.147 INFO:teuthology.orchestra.run.smithi158.stdout:fuseblk 2019-12-05T03:50:30.147 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2019-12-05T03:50:30.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:30.148 INFO:teuthology.orchestra.run.smithi158:> stat --file-system '--printf=%T 2019-12-05T03:50:30.148 INFO:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.0 2019-12-05T03:50:30.227 INFO:teuthology.orchestra.run.smithi158.stdout:fuseblk 2019-12-05T03:50:30.227 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2019-12-05T03:50:30.227 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi158.front.sepia.ceph.com... 2019-12-05T03:50:30.228 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-12-05T03:50:30.228 INFO:teuthology.orchestra.run.smithi158:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2019-12-05T03:50:30.389 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:30.389 INFO:teuthology.orchestra.run.smithi158:> stat --file-system '--printf=%T 2019-12-05T03:50:30.389 INFO:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.0 2019-12-05T03:50:30.412 INFO:teuthology.orchestra.run.smithi158.stdout:ext2/ext3 2019-12-05T03:50:30.412 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2019-12-05T03:50:30.412 INFO:teuthology.orchestra.run:waiting for 900 2019-12-05T03:50:30.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-12-05T03:50:30.413 INFO:teuthology.orchestra.run.smithi158:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-12-05T03:50:30.515 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:30.515 INFO:teuthology.orchestra.run.smithi158:> stat --file-system '--printf=%T 2019-12-05T03:50:30.515 INFO:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1 2019-12-05T03:50:30.558 INFO:teuthology.orchestra.run.smithi158.stdout:fuseblk 2019-12-05T03:50:30.559 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2019-12-05T03:50:30.559 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:30.559 INFO:teuthology.orchestra.run.smithi158:> stat --file-system '--printf=%T 2019-12-05T03:50:30.559 INFO:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1 2019-12-05T03:50:30.634 INFO:teuthology.orchestra.run.smithi158.stdout:fuseblk 2019-12-05T03:50:30.634 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2019-12-05T03:50:30.634 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi158.front.sepia.ceph.com... 2019-12-05T03:50:30.634 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-12-05T03:50:30.635 INFO:teuthology.orchestra.run.smithi158:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2019-12-05T03:50:30.795 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:30.795 INFO:teuthology.orchestra.run.smithi158:> stat --file-system '--printf=%T 2019-12-05T03:50:30.796 INFO:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.1 2019-12-05T03:50:30.807 INFO:teuthology.orchestra.run.smithi158.stdout:ext2/ext3 2019-12-05T03:50:30.808 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2019-12-05T03:50:30.808 INFO:teuthology.orchestra.run:waiting for 900 2019-12-05T03:50:30.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-12-05T03:50:30.808 INFO:teuthology.orchestra.run.smithi158:> rmdir -- /home/ubuntu/cephtest/mnt.1 2019-12-05T03:50:30.880 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:30.880 INFO:teuthology.orchestra.run.smithi096:> stat --file-system '--printf=%T 2019-12-05T03:50:30.880 INFO:teuthology.orchestra.run.smithi096:> ' -- /home/ubuntu/cephtest/mnt.2 2019-12-05T03:50:30.893 INFO:teuthology.orchestra.run.smithi096.stdout:fuseblk 2019-12-05T03:50:30.893 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2019-12-05T03:50:30.894 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:30.894 INFO:teuthology.orchestra.run.smithi096:> stat --file-system '--printf=%T 2019-12-05T03:50:30.894 INFO:teuthology.orchestra.run.smithi096:> ' -- /home/ubuntu/cephtest/mnt.2 2019-12-05T03:50:30.975 INFO:teuthology.orchestra.run.smithi096.stdout:fuseblk 2019-12-05T03:50:30.975 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2019-12-05T03:50:30.976 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi096.front.sepia.ceph.com... 2019-12-05T03:50:30.976 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-12-05T03:50:30.976 INFO:teuthology.orchestra.run.smithi096:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2019-12-05T03:50:31.135 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:31.135 INFO:teuthology.orchestra.run.smithi096:> stat --file-system '--printf=%T 2019-12-05T03:50:31.135 INFO:teuthology.orchestra.run.smithi096:> ' -- /home/ubuntu/cephtest/mnt.2 2019-12-05T03:50:31.148 INFO:teuthology.orchestra.run.smithi096.stdout:ext2/ext3 2019-12-05T03:50:31.149 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2019-12-05T03:50:31.149 INFO:teuthology.orchestra.run:waiting for 900 2019-12-05T03:50:31.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-12-05T03:50:31.149 INFO:teuthology.orchestra.run.smithi096:> rmdir -- /home/ubuntu/cephtest/mnt.2 2019-12-05T03:50:31.232 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:31.232 INFO:teuthology.orchestra.run.smithi096:> stat --file-system '--printf=%T 2019-12-05T03:50:31.232 INFO:teuthology.orchestra.run.smithi096:> ' -- /home/ubuntu/cephtest/mnt.3 2019-12-05T03:50:31.307 INFO:teuthology.orchestra.run.smithi096.stdout:fuseblk 2019-12-05T03:50:31.308 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2019-12-05T03:50:31.308 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:31.308 INFO:teuthology.orchestra.run.smithi096:> stat --file-system '--printf=%T 2019-12-05T03:50:31.308 INFO:teuthology.orchestra.run.smithi096:> ' -- /home/ubuntu/cephtest/mnt.3 2019-12-05T03:50:31.383 INFO:teuthology.orchestra.run.smithi096.stdout:fuseblk 2019-12-05T03:50:31.384 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2019-12-05T03:50:31.384 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi096.front.sepia.ceph.com... 2019-12-05T03:50:31.384 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-12-05T03:50:31.384 INFO:teuthology.orchestra.run.smithi096:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2019-12-05T03:50:31.511 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:31.511 INFO:teuthology.orchestra.run.smithi096:> stat --file-system '--printf=%T 2019-12-05T03:50:31.511 INFO:teuthology.orchestra.run.smithi096:> ' -- /home/ubuntu/cephtest/mnt.3 2019-12-05T03:50:31.590 INFO:teuthology.orchestra.run.smithi096.stdout:ext2/ext3 2019-12-05T03:50:31.591 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2019-12-05T03:50:31.591 INFO:teuthology.orchestra.run:waiting for 900 2019-12-05T03:50:31.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-12-05T03:50:31.591 INFO:teuthology.orchestra.run.smithi096:> rmdir -- /home/ubuntu/cephtest/mnt.3 2019-12-05T03:50:31.663 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2019-12-05T03:50:31.663 INFO:teuthology.orchestra.run:waiting for 300 2019-12-05T03:50:31.663 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2019-12-05T03:50:31.663 INFO:teuthology.orchestra.run:waiting for 300 2019-12-05T03:50:31.674 INFO:tasks.ceph.mds.a:Stopped 2019-12-05T03:50:31.674 DEBUG:teuthology.parallel:result is None 2019-12-05T03:50:31.716 INFO:tasks.ceph.mds.b:Stopped 2019-12-05T03:50:31.717 DEBUG:teuthology.parallel:result is None 2019-12-05T03:50:31.717 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2019-12-05T03:50:31.718 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2019-12-05T03:50:31.834 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.820+0000 7fb63936f700 1 Processor -- start 2019-12-05T03:50:31.834 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.820+0000 7fb63936f700 1 -- start start 2019-12-05T03:50:31.834 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7fb63936f700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb63409cf50 0x7fb63409a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:31.834 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7fb63936f700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fb6341553a0 0x7fb6341557d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:31.834 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7fb63936f700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6340acca0 con 0x7fb63405a730 2019-12-05T03:50:31.835 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7fb63936f700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6340b1720 con 0x7fb6341553a0 2019-12-05T03:50:31.835 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7fb63936f700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6340b19c0 con 0x7fb63409cf50 2019-12-05T03:50:31.835 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7fb633fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fb6341553a0 0x7fb6341557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:31.835 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7fb633fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fb6341553a0 0x7fb6341557d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54558/0 (socket says 172.21.15.158:54558) 2019-12-05T03:50:31.835 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7fb633fff700 1 -- 172.21.15.158:0/1173396481 learned_addr learned my addr 172.21.15.158:0/1173396481 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:31.835 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7fb6337fe700 1 --2- 172.21.15.158:0/1173396481 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb63409cf50 0x7fb63409a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:31.835 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7fb633fff700 1 -- 172.21.15.158:0/1173396481 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb63409cf50 msgr2=0x7fb63409a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:31.836 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7fb633fff700 1 --2- 172.21.15.158:0/1173396481 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb63409cf50 0x7fb63409a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:31.836 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7fb633fff700 1 -- 172.21.15.158:0/1173396481 >> v1:172.21.15.96:6789/0 conn(0x7fb63405a730 legacy=0x7fb634151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:31.836 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7fb633fff700 1 -- 172.21.15.158:0/1173396481 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63405ab60 con 0x7fb6341553a0 2019-12-05T03:50:31.836 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7fb633fff700 1 --2- 172.21.15.158:0/1173396481 >> v2:172.21.15.158:3300/0 conn(0x7fb6341553a0 0x7fb6341557d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb6340b18e0 tx=0x7fb62c00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:31.836 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7fb633fff700 1 --2- 172.21.15.158:0/1173396481 >> v2:172.21.15.158:3300/0 conn(0x7fb6341553a0 0x7fb6341557d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb6340b18e0 tx=0x7fb62c00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:31.836 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7fb633fff700 1 --2- 172.21.15.158:0/1173396481 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb6341553a0 0x7fb6341557d0 secure :-1 s=READY pgs=266 cs=0 l=1 rx=0x7fb6340b18e0 tx=0x7fb62c00fd30).ready entity=mon.1 client_cookie=861cd0aa831de5e5 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:31.836 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7fb633fff700 1 --2- 172.21.15.158:0/1173396481 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb6341553a0 0x7fb6341557d0 secure :-1 s=THROTTLE_DONE pgs=266 cs=0 l=1 rx=0x7fb6340b18e0 tx=0x7fb62c00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:31.837 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7fb633fff700 1 --2- 172.21.15.158:0/1173396481 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb6341553a0 0x7fb6341557d0 secure :-1 s=THROTTLE_DONE pgs=266 cs=0 l=1 rx=0x7fb6340b18e0 tx=0x7fb62c00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:31.837 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7fb633fff700 1 --2- 172.21.15.158:0/1173396481 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb6341553a0 0x7fb6341557d0 secure :-1 s=THROTTLE_DONE pgs=266 cs=0 l=1 rx=0x7fb6340b18e0 tx=0x7fb62c00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:31.837 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7fb6327fc700 1 -- 172.21.15.158:0/1173396481 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb62c0113b0 con 0x7fb6341553a0 2019-12-05T03:50:31.837 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7fb6327fc700 1 -- 172.21.15.158:0/1173396481 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62c008bb0 con 0x7fb6341553a0 2019-12-05T03:50:31.837 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7fb6327fc700 1 -- 172.21.15.158:0/1173396481 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb62c011990 con 0x7fb6341553a0 2019-12-05T03:50:31.837 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7fb63936f700 1 -- 172.21.15.158:0/1173396481 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb6341553a0 msgr2=0x7fb6341557d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:31.837 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7fb63936f700 1 --2- 172.21.15.158:0/1173396481 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb6341553a0 0x7fb6341557d0 secure :-1 s=READY pgs=266 cs=0 l=1 rx=0x7fb6340b18e0 tx=0x7fb62c00fd30).stop 2019-12-05T03:50:31.838 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7fb63936f700 1 -- 172.21.15.158:0/1173396481 shutdown_connections 2019-12-05T03:50:31.838 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7fb63936f700 1 --2- 172.21.15.158:0/1173396481 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fb6341553a0 0x7fb6341557d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:31.838 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7fb63936f700 1 --2- 172.21.15.158:0/1173396481 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb63409cf50 0x7fb63409a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:31.838 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7fb63936f700 1 -- 172.21.15.158:0/1173396481 shutdown_connections 2019-12-05T03:50:31.838 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7fb63936f700 1 -- 172.21.15.158:0/1173396481 wait complete. 2019-12-05T03:50:31.838 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7fb63936f700 1 -- 172.21.15.158:0/1173396481 >> 172.21.15.158:0/1173396481 conn(0x7fb6340b7e50 msgr2=0x7fb6340b3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:31.846 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7f52e87ab700 1 Processor -- start 2019-12-05T03:50:31.846 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7f52e87ab700 1 -- start start 2019-12-05T03:50:31.846 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7f52e87ab700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f52e009a320 0x7f52e005a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:31.846 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7f52e87ab700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52e00accb0 con 0x7f52e01553b0 2019-12-05T03:50:31.847 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7f52e87ab700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52e00b6980 con 0x7f52e009cf60 2019-12-05T03:50:31.847 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7f52e87ab700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52e009a750 con 0x7f52e009a320 2019-12-05T03:50:31.847 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7f52e6547700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f52e009a320 0x7f52e005a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:31.847 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7f52e6547700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f52e009a320 0x7f52e005a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54562/0 (socket says 172.21.15.158:54562) 2019-12-05T03:50:31.847 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7f52e6547700 1 -- 172.21.15.158:0/264736844 learned_addr learned my addr 172.21.15.158:0/264736844 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:31.847 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7f52e6547700 1 -- 172.21.15.158:0/264736844 >> v1:172.21.15.158:6789/0 conn(0x7f52e009cf60 legacy=0x7f52e0151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:31.847 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7f52e6547700 1 -- 172.21.15.158:0/264736844 >> v1:172.21.15.96:6789/0 conn(0x7f52e01553b0 legacy=0x7f52e01557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:31.848 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7f52e6547700 1 -- 172.21.15.158:0/264736844 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e0155fe0 con 0x7f52e009a320 2019-12-05T03:50:31.848 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7f52e6547700 1 --2- 172.21.15.158:0/264736844 >> v2:172.21.15.158:3300/0 conn(0x7f52e009a320 0x7f52e005a740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f52d0008790 tx=0x7f52d000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:31.848 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7f52e6547700 1 --2- 172.21.15.158:0/264736844 >> v2:172.21.15.158:3300/0 conn(0x7f52e009a320 0x7f52e005a740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f52d0008790 tx=0x7f52d000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:31.848 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7f52e6547700 1 --2- 172.21.15.158:0/264736844 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52e009a320 0x7f52e005a740 secure :-1 s=READY pgs=268 cs=0 l=1 rx=0x7f52d0008790 tx=0x7f52d000fcb0).ready entity=mon.1 client_cookie=74eb97a75ab64d18 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:31.848 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7f52e6547700 1 --2- 172.21.15.158:0/264736844 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52e009a320 0x7f52e005a740 secure :-1 s=THROTTLE_DONE pgs=268 cs=0 l=1 rx=0x7f52d0008790 tx=0x7f52d000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:31.848 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7f52e5d46700 1 -- 172.21.15.158:0/264736844 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52d00114e0 con 0x7f52e009a320 2019-12-05T03:50:31.848 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7f52e6547700 1 --2- 172.21.15.158:0/264736844 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52e009a320 0x7f52e005a740 secure :-1 s=THROTTLE_DONE pgs=268 cs=0 l=1 rx=0x7f52d0008790 tx=0x7f52d000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:31.849 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7f52e6547700 1 --2- 172.21.15.158:0/264736844 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52e009a320 0x7f52e005a740 secure :-1 s=THROTTLE_DONE pgs=268 cs=0 l=1 rx=0x7f52d0008790 tx=0x7f52d000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:31.849 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7f52e5d46700 1 -- 172.21.15.158:0/264736844 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d0008ca0 con 0x7f52e009a320 2019-12-05T03:50:31.849 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7f52e5d46700 1 -- 172.21.15.158:0/264736844 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52d0011ac0 con 0x7f52e009a320 2019-12-05T03:50:31.849 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7f52e87ab700 1 -- 172.21.15.158:0/264736844 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52e009a320 msgr2=0x7f52e005a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:31.849 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.824+0000 7f52e87ab700 1 --2- 172.21.15.158:0/264736844 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52e009a320 0x7f52e005a740 secure :-1 s=READY pgs=268 cs=0 l=1 rx=0x7f52d0008790 tx=0x7f52d000fcb0).stop 2019-12-05T03:50:31.849 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.828+0000 7f52e87ab700 1 -- 172.21.15.158:0/264736844 shutdown_connections 2019-12-05T03:50:31.849 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.828+0000 7f52e87ab700 1 --2- 172.21.15.158:0/264736844 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52e009a320 0x7f52e005a740 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:31.850 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.828+0000 7f52e87ab700 1 -- 172.21.15.158:0/264736844 shutdown_connections 2019-12-05T03:50:31.850 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.828+0000 7f52e87ab700 1 -- 172.21.15.158:0/264736844 wait complete. 2019-12-05T03:50:31.850 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.828+0000 7f52e87ab700 1 -- 172.21.15.158:0/264736844 >> 172.21.15.158:0/264736844 conn(0x7f52e00b7e60 msgr2=0x7f52e00b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:31.850 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.828+0000 7f52e87ab700 1 Processor -- start 2019-12-05T03:50:31.850 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.828+0000 7f52e87ab700 1 -- start start 2019-12-05T03:50:31.850 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7f52e87ab700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f52e007d880 0x7f52e01332e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:31.850 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7f52e87ab700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52e007bbf0 con 0x7f52e0154a10 2019-12-05T03:50:31.851 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7f52e87ab700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52e01376f0 con 0x7f52e0152b70 2019-12-05T03:50:31.851 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7f52e87ab700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52e007df30 con 0x7f52e007d880 2019-12-05T03:50:31.851 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7f52e6d48700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f52e0152b70 0x7f52e007b3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49352/0 (socket says 172.21.15.158:49352) 2019-12-05T03:50:31.851 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7f52e6d48700 1 -- 172.21.15.158:0/3188255295 learned_addr learned my addr 172.21.15.158:0/3188255295 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:31.851 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7f52e7549700 1 --2- 172.21.15.158:0/3188255295 >> v2:172.21.15.158:3300/0 conn(0x7f52e007d880 0x7f52e01332e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:31.851 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7f52d77fe700 1 -- 172.21.15.158:0/3188255295 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2717167938 0 0) 0x7f52e01376f0 con 0x7f52e0152b70 2019-12-05T03:50:31.851 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7f52d77fe700 1 -- 172.21.15.158:0/3188255295 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52c80030b0 con 0x7f52e0152b70 2019-12-05T03:50:31.851 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7f52e7549700 1 -- 172.21.15.158:0/3188255295 >> v1:172.21.15.158:6789/0 conn(0x7f52e0152b70 legacy=0x7f52e007b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:31.852 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7f52e7549700 1 -- 172.21.15.158:0/3188255295 >> v1:172.21.15.96:6789/0 conn(0x7f52e0154a10 legacy=0x7f52e0136ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:31.852 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7f52e7549700 1 -- 172.21.15.158:0/3188255295 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e01550e0 con 0x7f52e007d880 2019-12-05T03:50:31.852 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7f52e7549700 1 --2- 172.21.15.158:0/3188255295 >> v2:172.21.15.158:3300/0 conn(0x7f52e007d880 0x7f52e01332e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f52d8001210 tx=0x7f52d8010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:31.852 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7f52e7549700 1 --2- 172.21.15.158:0/3188255295 >> v2:172.21.15.158:3300/0 conn(0x7f52e007d880 0x7f52e01332e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f52d8001210 tx=0x7f52d8010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:31.858 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7f52e7549700 1 --2- 172.21.15.158:0/3188255295 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52e007d880 0x7f52e01332e0 secure :-1 s=READY pgs=271 cs=0 l=1 rx=0x7f52d8001210 tx=0x7f52d8010ac0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:31.858 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7f52e7549700 1 --2- 172.21.15.158:0/3188255295 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52e007d880 0x7f52e01332e0 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7f52d8001210 tx=0x7f52d8010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:31.858 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7f52d77fe700 1 -- 172.21.15.158:0/3188255295 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52d8002240 con 0x7f52e007d880 2019-12-05T03:50:31.858 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7f52e87ab700 1 -- 172.21.15.158:0/3188255295 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52e007dcb0 con 0x7f52e007d880 2019-12-05T03:50:31.858 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7f52e7549700 1 --2- 172.21.15.158:0/3188255295 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52e007d880 0x7f52e01332e0 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7f52d8001210 tx=0x7f52d8010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:31.859 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7f52e7549700 1 --2- 172.21.15.158:0/3188255295 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52e007d880 0x7f52e01332e0 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7f52d8001210 tx=0x7f52d8010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:31.859 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7f52d77fe700 1 -- 172.21.15.158:0/3188255295 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d800b0a0 con 0x7f52e007d880 2019-12-05T03:50:31.859 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7f52e87ab700 1 -- 172.21.15.158:0/3188255295 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52e0133830 con 0x7f52e007d880 2019-12-05T03:50:31.859 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7f52d77fe700 1 -- 172.21.15.158:0/3188255295 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52d8002670 con 0x7f52e007d880 2019-12-05T03:50:31.859 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7f52e7549700 1 --2- 172.21.15.158:0/3188255295 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52e007d880 0x7f52e01332e0 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7f52d8001210 tx=0x7f52d8010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:31.859 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.836+0000 7f52d77fe700 1 -- 172.21.15.158:0/3188255295 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f52d8002980 con 0x7f52e007d880 2019-12-05T03:50:31.859 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.836+0000 7f52e7549700 1 --2- 172.21.15.158:0/3188255295 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52e007d880 0x7f52e01332e0 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7f52d8001210 tx=0x7f52d8010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:31.860 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.836+0000 7f52d77fe700 1 --2- 172.21.15.158:0/3188255295 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f52c803b260 0x7f52c803d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:31.860 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.836+0000 7f52d77fe700 1 -- 172.21.15.158:0/3188255295 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f52d804b290 con 0x7f52e007d880 2019-12-05T03:50:31.860 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.836+0000 7f52e6d48700 1 --2- 172.21.15.158:0/3188255295 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f52c803b260 0x7f52c803d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:31.860 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.836+0000 7f52e6d48700 1 --2- 172.21.15.158:0/3188255295 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f52c803b260 0x7f52c803d770 crc :-1 s=READY pgs=127 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:31.860 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.828+0000 7fb63936f700 1 Processor -- start 2019-12-05T03:50:31.860 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.828+0000 7fb63936f700 1 -- start start 2019-12-05T03:50:31.861 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.828+0000 7fb63936f700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb63413c090 0x7fb63412b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:31.861 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.828+0000 7fb63936f700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb63407da80 con 0x7fb634151220 2019-12-05T03:50:31.861 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7fb63936f700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb634153540 con 0x7fb634154a70 2019-12-05T03:50:31.861 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7fb63936f700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb63413c4c0 con 0x7fb63413c090 2019-12-05T03:50:31.861 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7fb632ffd700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fb634154a70 0x7fb63407d280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49348/0 (socket says 172.21.15.158:49348) 2019-12-05T03:50:31.861 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7fb632ffd700 1 -- 172.21.15.158:0/1095321200 learned_addr learned my addr 172.21.15.158:0/1095321200 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:31.861 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7fb633fff700 1 --2- 172.21.15.158:0/1095321200 >> v2:172.21.15.96:3300/0 conn(0x7fb63413c090 0x7fb63412b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:31.862 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7fb61bfff700 1 -- 172.21.15.158:0/1095321200 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1543795808 0 0) 0x7fb634153540 con 0x7fb634154a70 2019-12-05T03:50:31.862 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7fb61bfff700 1 -- 172.21.15.158:0/1095321200 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6140030b0 con 0x7fb634154a70 2019-12-05T03:50:31.862 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7fb61bfff700 1 -- 172.21.15.158:0/1095321200 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1135127946 0 0) 0x7fb6140030b0 con 0x7fb634154a70 2019-12-05T03:50:31.862 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7fb61bfff700 1 -- 172.21.15.158:0/1095321200 --> v1:172.21.15.158:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb634153540 con 0x7fb634154a70 2019-12-05T03:50:31.862 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7fb61bfff700 1 -- 172.21.15.158:0/1095321200 <== mon.1 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 828730332 0 0) 0x7fb628001a60 con 0x7fb634154a70 2019-12-05T03:50:31.862 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7fb633fff700 1 -- 172.21.15.158:0/1095321200 >> v1:172.21.15.158:6789/0 conn(0x7fb634154a70 legacy=0x7fb63407d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:31.862 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7fb633fff700 1 -- 172.21.15.158:0/1095321200 >> v1:172.21.15.96:6789/0 conn(0x7fb634151220 legacy=0x7fb63413c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:31.863 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7fb633fff700 1 -- 172.21.15.158:0/1095321200 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb634153770 con 0x7fb63413c090 2019-12-05T03:50:31.863 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7fb633fff700 1 --2- 172.21.15.158:0/1095321200 >> v2:172.21.15.96:3300/0 conn(0x7fb63413c090 0x7fb63412b940 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb6240033f0 tx=0x7fb624007aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:31.863 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7fb633fff700 1 --2- 172.21.15.158:0/1095321200 >> v2:172.21.15.96:3300/0 conn(0x7fb63413c090 0x7fb63412b940 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb6240033f0 tx=0x7fb624007aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:31.863 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7fb633fff700 1 --2- 172.21.15.158:0/1095321200 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb63413c090 0x7fb63412b940 secure :-1 s=READY pgs=200 cs=0 l=1 rx=0x7fb6240033f0 tx=0x7fb624007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:31.863 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7fb633fff700 1 --2- 172.21.15.158:0/1095321200 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb63413c090 0x7fb63412b940 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7fb6240033f0 tx=0x7fb624007aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:31.863 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7fb633fff700 1 --2- 172.21.15.158:0/1095321200 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb63413c090 0x7fb63412b940 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7fb6240033f0 tx=0x7fb624007aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:31.863 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7fb633fff700 1 --2- 172.21.15.158:0/1095321200 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb63413c090 0x7fb63412b940 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7fb6240033f0 tx=0x7fb624007aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:31.864 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7fb61bfff700 1 -- 172.21.15.158:0/1095321200 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb62c008da0 con 0x7fb63413c090 2019-12-05T03:50:31.864 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7fb61bfff700 1 -- 172.21.15.158:0/1095321200 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62c0115b0 con 0x7fb63413c090 2019-12-05T03:50:31.864 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7fb63936f700 1 -- 172.21.15.158:0/1095321200 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb634153a40 con 0x7fb63413c090 2019-12-05T03:50:31.864 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7fb61bfff700 1 -- 172.21.15.158:0/1095321200 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb62c00f360 con 0x7fb63413c090 2019-12-05T03:50:31.864 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7fb63936f700 1 -- 172.21.15.158:0/1095321200 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb634153f10 con 0x7fb63413c090 2019-12-05T03:50:31.864 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7fb633fff700 1 --2- 172.21.15.158:0/1095321200 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb63413c090 0x7fb63412b940 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7fb6240033f0 tx=0x7fb624007aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:31.864 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7fb61bfff700 1 -- 172.21.15.158:0/1095321200 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fb62c00f560 con 0x7fb63413c090 2019-12-05T03:50:31.865 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.832+0000 7fb633fff700 1 --2- 172.21.15.158:0/1095321200 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb63413c090 0x7fb63412b940 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7fb6240033f0 tx=0x7fb624007aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:31.865 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.836+0000 7fb61bfff700 1 --2- 172.21.15.158:0/1095321200 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fb61403b680 0x7fb61403db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:31.865 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.836+0000 7fb61bfff700 1 -- 172.21.15.158:0/1095321200 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fb62c04ad20 con 0x7fb63413c090 2019-12-05T03:50:31.865 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.836+0000 7fb6337fe700 1 --2- 172.21.15.158:0/1095321200 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fb61403b680 0x7fb61403db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:31.865 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.836+0000 7fb6337fe700 1 --2- 172.21.15.158:0/1095321200 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fb61403b680 0x7fb61403db90 crc :-1 s=READY pgs=126 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:31.865 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.836+0000 7fb63936f700 1 -- 172.21.15.158:0/1095321200 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6340554d0 con 0x7fb63413c090 2019-12-05T03:50:31.866 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.840+0000 7f52e87ab700 1 -- 172.21.15.158:0/3188255295 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52e00554e0 con 0x7f52e007d880 2019-12-05T03:50:31.866 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.844+0000 7f52e7549700 1 --2- 172.21.15.158:0/3188255295 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52e007d880 0x7f52e01332e0 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7f52d8001210 tx=0x7f52d8010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:31.866 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.844+0000 7f52d77fe700 1 -- 172.21.15.158:0/3188255295 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f52d80322f0 con 0x7f52e007d880 2019-12-05T03:50:31.867 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.848+0000 7fb633fff700 1 --2- 172.21.15.158:0/1095321200 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb63413c090 0x7fb63412b940 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7fb6240033f0 tx=0x7fb624007aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:31.867 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:31.848+0000 7fb61bfff700 1 -- 172.21.15.158:0/1095321200 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fb62c031da0 con 0x7fb63413c090 2019-12-05T03:50:32.018 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:32.012+0000 7f52e87ab700 1 -- 172.21.15.158:0/3188255295 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f52e0066940 con 0x7f52e007d880 2019-12-05T03:50:32.026 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:32.020+0000 7fb63936f700 1 -- 172.21.15.158:0/1095321200 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7fb634066930 con 0x7fb63413c090 2019-12-05T03:50:32.983 INFO:tasks.ceph.mon.b.smithi096.stderr:2019-12-05T03:50:32.981+0000 7fac20e43700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-12-05T03:50:32.994 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:32.988+0000 7fb633fff700 1 --2- 172.21.15.158:0/1095321200 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb63413c090 0x7fb63412b940 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7fb6240033f0 tx=0x7fb624007aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:32.994 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:32.988+0000 7fb61bfff700 1 -- 172.21.15.158:0/1095321200 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 4241 v7) v1 ==== 95+0+0 (secure 0 0 0) 0x7fb62c02fa20 con 0x7fb63413c090 2019-12-05T03:50:32.995 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:32.988+0000 7f52e7549700 1 --2- 172.21.15.158:0/3188255295 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52e007d880 0x7f52e01332e0 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7f52d8001210 tx=0x7f52d8010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:32.995 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:32.988+0000 7f52d77fe700 1 -- 172.21.15.158:0/3188255295 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 4339 v7) v1 ==== 95+0+0 (secure 0 0 0) 0x7f52d8032550 con 0x7f52e007d880 2019-12-05T03:50:33.034 INFO:teuthology.orchestra.run.smithi158.stderr:failed mds gid 4339 2019-12-05T03:50:33.039 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.032+0000 7f52e87ab700 1 -- 172.21.15.158:0/3188255295 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f52c803b260 msgr2=0x7f52c803d770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:33.039 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.032+0000 7f52e87ab700 1 --2- 172.21.15.158:0/3188255295 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f52c803b260 0x7f52c803d770 crc :-1 s=READY pgs=127 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:33.039 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.032+0000 7f52e87ab700 1 -- 172.21.15.158:0/3188255295 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52e007d880 msgr2=0x7f52e01332e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:33.039 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.032+0000 7f52e87ab700 1 --2- 172.21.15.158:0/3188255295 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52e007d880 0x7f52e01332e0 secure :-1 s=READY pgs=271 cs=0 l=1 rx=0x7f52d8001210 tx=0x7f52d8010ac0).stop 2019-12-05T03:50:33.039 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.032+0000 7f52e87ab700 1 -- 172.21.15.158:0/3188255295 shutdown_connections 2019-12-05T03:50:33.040 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.032+0000 7f52e87ab700 1 --2- 172.21.15.158:0/3188255295 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f52e007d880 0x7f52e01332e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:33.040 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.032+0000 7f52e87ab700 1 --2- 172.21.15.158:0/3188255295 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f52c803b260 0x7f52c803d770 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:33.040 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.032+0000 7f52e87ab700 1 -- 172.21.15.158:0/3188255295 shutdown_connections 2019-12-05T03:50:33.040 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.032+0000 7f52e87ab700 1 -- 172.21.15.158:0/3188255295 wait complete. 2019-12-05T03:50:33.040 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.032+0000 7f52e87ab700 1 -- 172.21.15.158:0/3188255295 >> 172.21.15.158:0/3188255295 conn(0x7f52e00b7e60 msgr2=0x7f52e01273b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:33.041 INFO:teuthology.orchestra.run.smithi158.stderr:failed mds gid 4241 2019-12-05T03:50:33.046 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.040+0000 7fb63936f700 1 -- 172.21.15.158:0/1095321200 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fb61403b680 msgr2=0x7fb61403db90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:33.046 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.040+0000 7fb63936f700 1 --2- 172.21.15.158:0/1095321200 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fb61403b680 0x7fb61403db90 crc :-1 s=READY pgs=126 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:33.047 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.040+0000 7fb63936f700 1 -- 172.21.15.158:0/1095321200 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb63413c090 msgr2=0x7fb63412b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:33.047 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.040+0000 7fb63936f700 1 --2- 172.21.15.158:0/1095321200 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb63413c090 0x7fb63412b940 secure :-1 s=READY pgs=200 cs=0 l=1 rx=0x7fb6240033f0 tx=0x7fb624007aa0).stop 2019-12-05T03:50:33.047 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.040+0000 7fb63936f700 1 -- 172.21.15.158:0/1095321200 shutdown_connections 2019-12-05T03:50:33.047 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.040+0000 7fb63936f700 1 --2- 172.21.15.158:0/1095321200 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb63413c090 0x7fb63412b940 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:33.047 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.040+0000 7fb63936f700 1 --2- 172.21.15.158:0/1095321200 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fb61403b680 0x7fb61403db90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:33.047 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.040+0000 7fb63936f700 1 -- 172.21.15.158:0/1095321200 shutdown_connections 2019-12-05T03:50:33.047 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.040+0000 7fb63936f700 1 -- 172.21.15.158:0/1095321200 wait complete. 2019-12-05T03:50:33.048 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.040+0000 7fb63936f700 1 -- 172.21.15.158:0/1095321200 >> 172.21.15.158:0/1095321200 conn(0x7fb63407e410 msgr2=0x7fb6340b52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:33.051 DEBUG:teuthology.parallel:result is '' 2019-12-05T03:50:33.058 DEBUG:teuthology.parallel:result is '' 2019-12-05T03:50:33.059 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2019-12-05T03:50:33.233 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.220+0000 7f408556f700 1 Processor -- start 2019-12-05T03:50:33.264 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.220+0000 7f408556f700 1 -- start start 2019-12-05T03:50:33.264 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.224+0000 7f408556f700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f408009a320 0x7f408005a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:33.264 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.224+0000 7f408556f700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f40801553b0 0x7f40801557e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:33.265 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.224+0000 7f408556f700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40800accb0 con 0x7f408009cf60 2019-12-05T03:50:33.265 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.224+0000 7f408556f700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f408009a750 con 0x7f408009a320 2019-12-05T03:50:33.265 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.224+0000 7f408556f700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40800b1730 con 0x7f40801553b0 2019-12-05T03:50:33.265 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.224+0000 7f407ffff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f40801553b0 0x7f40801557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:33.265 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.224+0000 7f407ffff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f40801553b0 0x7f40801557e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54586/0 (socket says 172.21.15.158:54586) 2019-12-05T03:50:33.265 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.224+0000 7f407ffff700 1 -- 172.21.15.158:0/3150582050 learned_addr learned my addr 172.21.15.158:0/3150582050 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:33.266 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.224+0000 7f4076ffd700 1 --2- 172.21.15.158:0/3150582050 >> v2:172.21.15.96:3300/0 conn(0x7f408009a320 0x7f408005a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:33.266 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.224+0000 7f407ffff700 1 -- 172.21.15.158:0/3150582050 >> v2:172.21.15.96:3300/0 conn(0x7f408009a320 msgr2=0x7f408005a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:33.266 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.224+0000 7f407ffff700 1 --2- 172.21.15.158:0/3150582050 >> v2:172.21.15.96:3300/0 conn(0x7f408009a320 0x7f408005a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:33.266 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.224+0000 7f407ffff700 1 -- 172.21.15.158:0/3150582050 >> v1:172.21.15.96:6789/0 conn(0x7f408009cf60 legacy=0x7f4080151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:33.266 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.224+0000 7f407ffff700 1 -- 172.21.15.158:0/3150582050 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40800b6980 con 0x7f40801553b0 2019-12-05T03:50:33.266 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.224+0000 7f407ffff700 1 --2- 172.21.15.158:0/3150582050 >> v2:172.21.15.158:3300/0 conn(0x7f40801553b0 0x7f40801557e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4078008b10 tx=0x7f40780100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:33.267 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.224+0000 7f407ffff700 1 --2- 172.21.15.158:0/3150582050 >> v2:172.21.15.158:3300/0 conn(0x7f40801553b0 0x7f40801557e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4078008b10 tx=0x7f40780100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:33.267 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.224+0000 7f407ffff700 1 --2- 172.21.15.158:0/3150582050 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f40801553b0 0x7f40801557e0 secure :-1 s=READY pgs=272 cs=0 l=1 rx=0x7f4078008b10 tx=0x7f40780100b0).ready entity=mon.1 client_cookie=75e17f60f75f3633 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:33.267 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.224+0000 7f407ffff700 1 --2- 172.21.15.158:0/3150582050 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f40801553b0 0x7f40801557e0 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7f4078008b10 tx=0x7f40780100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:33.267 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.224+0000 7f407ffff700 1 --2- 172.21.15.158:0/3150582050 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f40801553b0 0x7f40801557e0 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7f4078008b10 tx=0x7f40780100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:33.267 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.224+0000 7f407effd700 1 -- 172.21.15.158:0/3150582050 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4078010d60 con 0x7f40801553b0 2019-12-05T03:50:33.267 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.224+0000 7f407ffff700 1 --2- 172.21.15.158:0/3150582050 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f40801553b0 0x7f40801557e0 secure :-1 s=THROTTLE_DONE pgs=272 cs=0 l=1 rx=0x7f4078008b10 tx=0x7f40780100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:33.267 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.224+0000 7f407effd700 1 -- 172.21.15.158:0/3150582050 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4078010980 con 0x7f40801553b0 2019-12-05T03:50:33.268 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.224+0000 7f407effd700 1 -- 172.21.15.158:0/3150582050 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40780114a0 con 0x7f40801553b0 2019-12-05T03:50:33.268 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.224+0000 7f408556f700 1 -- 172.21.15.158:0/3150582050 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f40801553b0 msgr2=0x7f40801557e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:33.268 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.224+0000 7f408556f700 1 --2- 172.21.15.158:0/3150582050 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f40801553b0 0x7f40801557e0 secure :-1 s=READY pgs=272 cs=0 l=1 rx=0x7f4078008b10 tx=0x7f40780100b0).stop 2019-12-05T03:50:33.268 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.224+0000 7f408556f700 1 -- 172.21.15.158:0/3150582050 shutdown_connections 2019-12-05T03:50:33.268 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.224+0000 7f408556f700 1 --2- 172.21.15.158:0/3150582050 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f40801553b0 0x7f40801557e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:33.268 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.224+0000 7f408556f700 1 --2- 172.21.15.158:0/3150582050 >> v2:172.21.15.96:3300/0 conn(0x7f408009a320 0x7f408005a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:33.268 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.224+0000 7f408556f700 1 -- 172.21.15.158:0/3150582050 shutdown_connections 2019-12-05T03:50:33.269 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.224+0000 7f408556f700 1 -- 172.21.15.158:0/3150582050 wait complete. 2019-12-05T03:50:33.269 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.224+0000 7f408556f700 1 -- 172.21.15.158:0/3150582050 >> 172.21.15.158:0/3150582050 conn(0x7f40800b7e60 msgr2=0x7f40800b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:33.273 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.228+0000 7f408556f700 1 Processor -- start 2019-12-05T03:50:33.273 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.228+0000 7f408556f700 1 -- start start 2019-12-05T03:50:33.273 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.228+0000 7f408556f700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f408007e070 0x7f408005f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:33.273 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.228+0000 7f408556f700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f408013c2c0 0x7f408013c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:33.274 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.228+0000 7f408556f700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f408007e4a0 con 0x7f40800af220 2019-12-05T03:50:33.274 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.228+0000 7f408556f700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f408013cc40 con 0x7f408007e070 2019-12-05T03:50:33.274 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.228+0000 7f408556f700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f408005fd30 con 0x7f408013c2c0 2019-12-05T03:50:33.274 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.228+0000 7f407f7fe700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f40800af220 0x7f408013cec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49368/0 (socket says 172.21.15.158:49368) 2019-12-05T03:50:33.274 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.232+0000 7f407f7fe700 1 -- 172.21.15.158:0/3656952121 learned_addr learned my addr 172.21.15.158:0/3656952121 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:33.274 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.232+0000 7f407ffff700 1 --2- 172.21.15.158:0/3656952121 >> v2:172.21.15.158:3300/0 conn(0x7f408013c2c0 0x7f408013c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:33.274 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.232+0000 7f4076ffd700 1 --2- 172.21.15.158:0/3656952121 >> v2:172.21.15.96:3300/0 conn(0x7f408007e070 0x7f408005f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:33.275 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.232+0000 7f407cff9700 1 -- 172.21.15.158:0/3656952121 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3638232453 0 0) 0x7f408007e4a0 con 0x7f40800af220 2019-12-05T03:50:33.275 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.232+0000 7f407cff9700 1 -- 172.21.15.158:0/3656952121 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40640030b0 con 0x7f40800af220 2019-12-05T03:50:33.275 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.232+0000 7f407ffff700 1 -- 172.21.15.158:0/3656952121 >> v2:172.21.15.96:3300/0 conn(0x7f408007e070 msgr2=0x7f408005f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:33.275 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.232+0000 7f407ffff700 1 --2- 172.21.15.158:0/3656952121 >> v2:172.21.15.96:3300/0 conn(0x7f408007e070 0x7f408005f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:33.275 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.232+0000 7f407ffff700 1 -- 172.21.15.158:0/3656952121 >> v1:172.21.15.158:6789/0 conn(0x7f40800af220 legacy=0x7f408013cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:33.275 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.232+0000 7f407ffff700 1 -- 172.21.15.158:0/3656952121 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408013d6c0 con 0x7f408013c2c0 2019-12-05T03:50:33.275 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.232+0000 7f407ffff700 1 --2- 172.21.15.158:0/3656952121 >> v2:172.21.15.158:3300/0 conn(0x7f408013c2c0 0x7f408013c6f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f40800af7d0 tx=0x7f4078010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:33.276 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.232+0000 7f407ffff700 1 --2- 172.21.15.158:0/3656952121 >> v2:172.21.15.158:3300/0 conn(0x7f408013c2c0 0x7f408013c6f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f40800af7d0 tx=0x7f4078010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:33.276 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.232+0000 7f407ffff700 1 --2- 172.21.15.158:0/3656952121 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f408013c2c0 0x7f408013c6f0 secure :-1 s=READY pgs=274 cs=0 l=1 rx=0x7f40800af7d0 tx=0x7f4078010cf0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:33.276 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.232+0000 7f407ffff700 1 --2- 172.21.15.158:0/3656952121 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f408013c2c0 0x7f408013c6f0 secure :-1 s=THROTTLE_DONE pgs=274 cs=0 l=1 rx=0x7f40800af7d0 tx=0x7f4078010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:33.276 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.232+0000 7f407cff9700 1 -- 172.21.15.158:0/3656952121 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4078011bb0 con 0x7f408013c2c0 2019-12-05T03:50:33.276 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.232+0000 7f407ffff700 1 --2- 172.21.15.158:0/3656952121 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f408013c2c0 0x7f408013c6f0 secure :-1 s=THROTTLE_DONE pgs=274 cs=0 l=1 rx=0x7f40800af7d0 tx=0x7f4078010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:33.276 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.232+0000 7f408556f700 1 -- 172.21.15.158:0/3656952121 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4080140950 con 0x7f408013c2c0 2019-12-05T03:50:33.276 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.232+0000 7f407cff9700 1 -- 172.21.15.158:0/3656952121 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40780110c0 con 0x7f408013c2c0 2019-12-05T03:50:33.277 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.232+0000 7f407ffff700 1 --2- 172.21.15.158:0/3656952121 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f408013c2c0 0x7f408013c6f0 secure :-1 s=THROTTLE_DONE pgs=274 cs=0 l=1 rx=0x7f40800af7d0 tx=0x7f4078010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:33.277 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.232+0000 7f407cff9700 1 -- 172.21.15.158:0/3656952121 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4078005ab0 con 0x7f408013c2c0 2019-12-05T03:50:33.277 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.232+0000 7f408556f700 1 -- 172.21.15.158:0/3656952121 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4080140ea0 con 0x7f408013c2c0 2019-12-05T03:50:33.277 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.232+0000 7f407ffff700 1 --2- 172.21.15.158:0/3656952121 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f408013c2c0 0x7f408013c6f0 secure :-1 s=THROTTLE_DONE pgs=274 cs=0 l=1 rx=0x7f40800af7d0 tx=0x7f4078010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:33.277 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.232+0000 7f407cff9700 1 -- 172.21.15.158:0/3656952121 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f407800f280 con 0x7f408013c2c0 2019-12-05T03:50:33.277 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.232+0000 7f407ffff700 1 --2- 172.21.15.158:0/3656952121 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f408013c2c0 0x7f408013c6f0 secure :-1 s=THROTTLE_DONE pgs=274 cs=0 l=1 rx=0x7f40800af7d0 tx=0x7f4078010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:33.277 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.232+0000 7f407cff9700 1 --2- 172.21.15.158:0/3656952121 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f406403b280 0x7f406403d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:33.278 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.232+0000 7f407cff9700 1 -- 172.21.15.158:0/3656952121 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6117+0+0 (secure 0 0 0) 0x7f407804db20 con 0x7f408013c2c0 2019-12-05T03:50:33.278 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.232+0000 7f407f7fe700 1 --2- 172.21.15.158:0/3656952121 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f406403b280 0x7f406403d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:33.278 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.232+0000 7f407f7fe700 1 --2- 172.21.15.158:0/3656952121 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f406403b280 0x7f406403d790 crc :-1 s=READY pgs=128 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:33.278 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.236+0000 7f408556f700 1 -- 172.21.15.158:0/3656952121 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40800554e0 con 0x7f408013c2c0 2019-12-05T03:50:33.278 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.240+0000 7f407ffff700 1 --2- 172.21.15.158:0/3656952121 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f408013c2c0 0x7f408013c6f0 secure :-1 s=THROTTLE_DONE pgs=274 cs=0 l=1 rx=0x7f40800af7d0 tx=0x7f4078010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:33.278 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.240+0000 7f407cff9700 1 -- 172.21.15.158:0/3656952121 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f4078034b80 con 0x7f408013c2c0 2019-12-05T03:50:33.411 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.404+0000 7f408556f700 1 -- 172.21.15.158:0/3656952121 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f4080066940 con 0x7f408013c2c0 2019-12-05T03:50:33.412 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.404+0000 7f407ffff700 1 --2- 172.21.15.158:0/3656952121 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f408013c2c0 0x7f408013c6f0 secure :-1 s=THROTTLE_DONE pgs=274 cs=0 l=1 rx=0x7f40800af7d0 tx=0x7f4078010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:33.412 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.404+0000 7f407cff9700 1 -- 172.21.15.158:0/3656952121 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v25) v1 ==== 81+0+31837 (secure 0 0 0) 0x7f4078005d50 con 0x7f408013c2c0 2019-12-05T03:50:33.413 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:33.414 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2019-12-05T03:50:33.414 INFO:teuthology.orchestra.run.smithi158.stdout: "epoch": 25, 2019-12-05T03:50:33.414 INFO:teuthology.orchestra.run.smithi158.stdout: "fsid": "a91186ae-f496-4de1-918d-820c55ff1feb", 2019-12-05T03:50:33.414 INFO:teuthology.orchestra.run.smithi158.stdout: "created": "2019-12-05T03:49:39.187523+0000", 2019-12-05T03:50:33.414 INFO:teuthology.orchestra.run.smithi158.stdout: "modified": "2019-12-05T03:50:32.028649+0000", 2019-12-05T03:50:33.414 INFO:teuthology.orchestra.run.smithi158.stdout: "last_up_change": "2019-12-05T03:49:48.551934+0000", 2019-12-05T03:50:33.415 INFO:teuthology.orchestra.run.smithi158.stdout: "last_in_change": "2019-12-05T03:49:48.551934+0000", 2019-12-05T03:50:33.415 INFO:teuthology.orchestra.run.smithi158.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2019-12-05T03:50:33.415 INFO:teuthology.orchestra.run.smithi158.stdout: "flags_num": 5799936, 2019-12-05T03:50:33.415 INFO:teuthology.orchestra.run.smithi158.stdout: "flags_set": [ 2019-12-05T03:50:33.415 INFO:teuthology.orchestra.run.smithi158.stdout: "pglog_hardlimit", 2019-12-05T03:50:33.415 INFO:teuthology.orchestra.run.smithi158.stdout: "purged_snapdirs", 2019-12-05T03:50:33.415 INFO:teuthology.orchestra.run.smithi158.stdout: "recovery_deletes", 2019-12-05T03:50:33.416 INFO:teuthology.orchestra.run.smithi158.stdout: "sortbitwise" 2019-12-05T03:50:33.416 INFO:teuthology.orchestra.run.smithi158.stdout: ], 2019-12-05T03:50:33.416 INFO:teuthology.orchestra.run.smithi158.stdout: "crush_version": 5, 2019-12-05T03:50:33.416 INFO:teuthology.orchestra.run.smithi158.stdout: "full_ratio": 0.94999998807907104, 2019-12-05T03:50:33.416 INFO:teuthology.orchestra.run.smithi158.stdout: "backfillfull_ratio": 0.89999997615814209, 2019-12-05T03:50:33.416 INFO:teuthology.orchestra.run.smithi158.stdout: "nearfull_ratio": 0.85000002384185791, 2019-12-05T03:50:33.416 INFO:teuthology.orchestra.run.smithi158.stdout: "cluster_snapshot": "", 2019-12-05T03:50:33.416 INFO:teuthology.orchestra.run.smithi158.stdout: "pool_max": 3, 2019-12-05T03:50:33.417 INFO:teuthology.orchestra.run.smithi158.stdout: "max_osd": 8, 2019-12-05T03:50:33.417 INFO:teuthology.orchestra.run.smithi158.stdout: "require_min_compat_client": "jewel", 2019-12-05T03:50:33.417 INFO:teuthology.orchestra.run.smithi158.stdout: "min_compat_client": "jewel", 2019-12-05T03:50:33.417 INFO:teuthology.orchestra.run.smithi158.stdout: "require_osd_release": "octopus", 2019-12-05T03:50:33.417 INFO:teuthology.orchestra.run.smithi158.stdout: "pools": [ 2019-12-05T03:50:33.417 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.417 INFO:teuthology.orchestra.run.smithi158.stdout: "pool": 1, 2019-12-05T03:50:33.428 INFO:teuthology.orchestra.run.smithi158.stdout: "pool_name": "rbd", 2019-12-05T03:50:33.428 INFO:teuthology.orchestra.run.smithi158.stdout: "create_time": "2019-12-05T03:49:52.900870+0000", 2019-12-05T03:50:33.429 INFO:teuthology.orchestra.run.smithi158.stdout: "flags": 1, 2019-12-05T03:50:33.429 INFO:teuthology.orchestra.run.smithi158.stdout: "flags_names": "hashpspool", 2019-12-05T03:50:33.429 INFO:teuthology.orchestra.run.smithi158.stdout: "type": 1, 2019-12-05T03:50:33.429 INFO:teuthology.orchestra.run.smithi158.stdout: "size": 2, 2019-12-05T03:50:33.429 INFO:teuthology.orchestra.run.smithi158.stdout: "min_size": 1, 2019-12-05T03:50:33.430 INFO:teuthology.orchestra.run.smithi158.stdout: "crush_rule": 0, 2019-12-05T03:50:33.430 INFO:teuthology.orchestra.run.smithi158.stdout: "object_hash": 2, 2019-12-05T03:50:33.430 INFO:teuthology.orchestra.run.smithi158.stdout: "pg_autoscale_mode": "off", 2019-12-05T03:50:33.430 INFO:teuthology.orchestra.run.smithi158.stdout: "pg_num": 8, 2019-12-05T03:50:33.430 INFO:teuthology.orchestra.run.smithi158.stdout: "pg_placement_num": 8, 2019-12-05T03:50:33.430 INFO:teuthology.orchestra.run.smithi158.stdout: "pg_placement_num_target": 8, 2019-12-05T03:50:33.430 INFO:teuthology.orchestra.run.smithi158.stdout: "pg_num_target": 8, 2019-12-05T03:50:33.431 INFO:teuthology.orchestra.run.smithi158.stdout: "pg_num_pending": 8, 2019-12-05T03:50:33.431 INFO:teuthology.orchestra.run.smithi158.stdout: "last_pg_merge_meta": { 2019-12-05T03:50:33.431 INFO:teuthology.orchestra.run.smithi158.stdout: "source_pgid": "0.0", 2019-12-05T03:50:33.431 INFO:teuthology.orchestra.run.smithi158.stdout: "ready_epoch": 0, 2019-12-05T03:50:33.431 INFO:teuthology.orchestra.run.smithi158.stdout: "last_epoch_started": 0, 2019-12-05T03:50:33.431 INFO:teuthology.orchestra.run.smithi158.stdout: "last_epoch_clean": 0, 2019-12-05T03:50:33.431 INFO:teuthology.orchestra.run.smithi158.stdout: "source_version": "0'0", 2019-12-05T03:50:33.432 INFO:teuthology.orchestra.run.smithi158.stdout: "target_version": "0'0" 2019-12-05T03:50:33.432 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.432 INFO:teuthology.orchestra.run.smithi158.stdout: "last_change": "17", 2019-12-05T03:50:33.432 INFO:teuthology.orchestra.run.smithi158.stdout: "last_force_op_resend": "0", 2019-12-05T03:50:33.432 INFO:teuthology.orchestra.run.smithi158.stdout: "last_force_op_resend_prenautilus": "0", 2019-12-05T03:50:33.432 INFO:teuthology.orchestra.run.smithi158.stdout: "last_force_op_resend_preluminous": "0", 2019-12-05T03:50:33.432 INFO:teuthology.orchestra.run.smithi158.stdout: "auid": 0, 2019-12-05T03:50:33.433 INFO:teuthology.orchestra.run.smithi158.stdout: "snap_mode": "selfmanaged", 2019-12-05T03:50:33.433 INFO:teuthology.orchestra.run.smithi158.stdout: "snap_seq": 0, 2019-12-05T03:50:33.433 INFO:teuthology.orchestra.run.smithi158.stdout: "snap_epoch": 0, 2019-12-05T03:50:33.433 INFO:teuthology.orchestra.run.smithi158.stdout: "pool_snaps": [], 2019-12-05T03:50:33.433 INFO:teuthology.orchestra.run.smithi158.stdout: "removed_snaps": "[]", 2019-12-05T03:50:33.433 INFO:teuthology.orchestra.run.smithi158.stdout: "quota_max_bytes": 0, 2019-12-05T03:50:33.433 INFO:teuthology.orchestra.run.smithi158.stdout: "quota_max_objects": 0, 2019-12-05T03:50:33.434 INFO:teuthology.orchestra.run.smithi158.stdout: "tiers": [], 2019-12-05T03:50:33.434 INFO:teuthology.orchestra.run.smithi158.stdout: "tier_of": -1, 2019-12-05T03:50:33.434 INFO:teuthology.orchestra.run.smithi158.stdout: "read_tier": -1, 2019-12-05T03:50:33.434 INFO:teuthology.orchestra.run.smithi158.stdout: "write_tier": -1, 2019-12-05T03:50:33.434 INFO:teuthology.orchestra.run.smithi158.stdout: "cache_mode": "none", 2019-12-05T03:50:33.434 INFO:teuthology.orchestra.run.smithi158.stdout: "target_max_bytes": 0, 2019-12-05T03:50:33.434 INFO:teuthology.orchestra.run.smithi158.stdout: "target_max_objects": 0, 2019-12-05T03:50:33.434 INFO:teuthology.orchestra.run.smithi158.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-12-05T03:50:33.435 INFO:teuthology.orchestra.run.smithi158.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-12-05T03:50:33.435 INFO:teuthology.orchestra.run.smithi158.stdout: "cache_target_full_ratio_micro": 800000, 2019-12-05T03:50:33.435 INFO:teuthology.orchestra.run.smithi158.stdout: "cache_min_flush_age": 0, 2019-12-05T03:50:33.435 INFO:teuthology.orchestra.run.smithi158.stdout: "cache_min_evict_age": 0, 2019-12-05T03:50:33.435 INFO:teuthology.orchestra.run.smithi158.stdout: "erasure_code_profile": "", 2019-12-05T03:50:33.435 INFO:teuthology.orchestra.run.smithi158.stdout: "hit_set_params": { 2019-12-05T03:50:33.435 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "none" 2019-12-05T03:50:33.436 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.436 INFO:teuthology.orchestra.run.smithi158.stdout: "hit_set_period": 0, 2019-12-05T03:50:33.436 INFO:teuthology.orchestra.run.smithi158.stdout: "hit_set_count": 0, 2019-12-05T03:50:33.436 INFO:teuthology.orchestra.run.smithi158.stdout: "use_gmt_hitset": true, 2019-12-05T03:50:33.436 INFO:teuthology.orchestra.run.smithi158.stdout: "min_read_recency_for_promote": 0, 2019-12-05T03:50:33.436 INFO:teuthology.orchestra.run.smithi158.stdout: "min_write_recency_for_promote": 0, 2019-12-05T03:50:33.436 INFO:teuthology.orchestra.run.smithi158.stdout: "hit_set_grade_decay_rate": 0, 2019-12-05T03:50:33.437 INFO:teuthology.orchestra.run.smithi158.stdout: "hit_set_search_last_n": 0, 2019-12-05T03:50:33.437 INFO:teuthology.orchestra.run.smithi158.stdout: "grade_table": [], 2019-12-05T03:50:33.437 INFO:teuthology.orchestra.run.smithi158.stdout: "stripe_width": 0, 2019-12-05T03:50:33.437 INFO:teuthology.orchestra.run.smithi158.stdout: "expected_num_objects": 0, 2019-12-05T03:50:33.437 INFO:teuthology.orchestra.run.smithi158.stdout: "fast_read": false, 2019-12-05T03:50:33.438 INFO:teuthology.orchestra.run.smithi158.stdout: "options": {}, 2019-12-05T03:50:33.438 INFO:teuthology.orchestra.run.smithi158.stdout: "application_metadata": { 2019-12-05T03:50:33.439 INFO:teuthology.orchestra.run.smithi158.stdout: "rbd": {} 2019-12-05T03:50:33.439 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.439 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.439 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.439 INFO:teuthology.orchestra.run.smithi158.stdout: "pool": 2, 2019-12-05T03:50:33.440 INFO:teuthology.orchestra.run.smithi158.stdout: "pool_name": "cephfs_metadata", 2019-12-05T03:50:33.440 INFO:teuthology.orchestra.run.smithi158.stdout: "create_time": "2019-12-05T03:49:55.801462+0000", 2019-12-05T03:50:33.440 INFO:teuthology.orchestra.run.smithi158.stdout: "flags": 1, 2019-12-05T03:50:33.440 INFO:teuthology.orchestra.run.smithi158.stdout: "flags_names": "hashpspool", 2019-12-05T03:50:33.440 INFO:teuthology.orchestra.run.smithi158.stdout: "type": 1, 2019-12-05T03:50:33.440 INFO:teuthology.orchestra.run.smithi158.stdout: "size": 2, 2019-12-05T03:50:33.440 INFO:teuthology.orchestra.run.smithi158.stdout: "min_size": 1, 2019-12-05T03:50:33.441 INFO:teuthology.orchestra.run.smithi158.stdout: "crush_rule": 0, 2019-12-05T03:50:33.441 INFO:teuthology.orchestra.run.smithi158.stdout: "object_hash": 2, 2019-12-05T03:50:33.441 INFO:teuthology.orchestra.run.smithi158.stdout: "pg_autoscale_mode": "off", 2019-12-05T03:50:33.441 INFO:teuthology.orchestra.run.smithi158.stdout: "pg_num": 8, 2019-12-05T03:50:33.441 INFO:teuthology.orchestra.run.smithi158.stdout: "pg_placement_num": 8, 2019-12-05T03:50:33.441 INFO:teuthology.orchestra.run.smithi158.stdout: "pg_placement_num_target": 8, 2019-12-05T03:50:33.441 INFO:teuthology.orchestra.run.smithi158.stdout: "pg_num_target": 8, 2019-12-05T03:50:33.442 INFO:teuthology.orchestra.run.smithi158.stdout: "pg_num_pending": 8, 2019-12-05T03:50:33.442 INFO:teuthology.orchestra.run.smithi158.stdout: "last_pg_merge_meta": { 2019-12-05T03:50:33.442 INFO:teuthology.orchestra.run.smithi158.stdout: "source_pgid": "0.0", 2019-12-05T03:50:33.442 INFO:teuthology.orchestra.run.smithi158.stdout: "ready_epoch": 0, 2019-12-05T03:50:33.442 INFO:teuthology.orchestra.run.smithi158.stdout: "last_epoch_started": 0, 2019-12-05T03:50:33.442 INFO:teuthology.orchestra.run.smithi158.stdout: "last_epoch_clean": 0, 2019-12-05T03:50:33.442 INFO:teuthology.orchestra.run.smithi158.stdout: "source_version": "0'0", 2019-12-05T03:50:33.442 INFO:teuthology.orchestra.run.smithi158.stdout: "target_version": "0'0" 2019-12-05T03:50:33.443 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.443 INFO:teuthology.orchestra.run.smithi158.stdout: "last_change": "23", 2019-12-05T03:50:33.443 INFO:teuthology.orchestra.run.smithi158.stdout: "last_force_op_resend": "0", 2019-12-05T03:50:33.443 INFO:teuthology.orchestra.run.smithi158.stdout: "last_force_op_resend_prenautilus": "0", 2019-12-05T03:50:33.443 INFO:teuthology.orchestra.run.smithi158.stdout: "last_force_op_resend_preluminous": "0", 2019-12-05T03:50:33.443 INFO:teuthology.orchestra.run.smithi158.stdout: "auid": 0, 2019-12-05T03:50:33.443 INFO:teuthology.orchestra.run.smithi158.stdout: "snap_mode": "selfmanaged", 2019-12-05T03:50:33.444 INFO:teuthology.orchestra.run.smithi158.stdout: "snap_seq": 0, 2019-12-05T03:50:33.444 INFO:teuthology.orchestra.run.smithi158.stdout: "snap_epoch": 0, 2019-12-05T03:50:33.444 INFO:teuthology.orchestra.run.smithi158.stdout: "pool_snaps": [], 2019-12-05T03:50:33.444 INFO:teuthology.orchestra.run.smithi158.stdout: "removed_snaps": "[]", 2019-12-05T03:50:33.444 INFO:teuthology.orchestra.run.smithi158.stdout: "quota_max_bytes": 0, 2019-12-05T03:50:33.444 INFO:teuthology.orchestra.run.smithi158.stdout: "quota_max_objects": 0, 2019-12-05T03:50:33.444 INFO:teuthology.orchestra.run.smithi158.stdout: "tiers": [], 2019-12-05T03:50:33.445 INFO:teuthology.orchestra.run.smithi158.stdout: "tier_of": -1, 2019-12-05T03:50:33.445 INFO:teuthology.orchestra.run.smithi158.stdout: "read_tier": -1, 2019-12-05T03:50:33.445 INFO:teuthology.orchestra.run.smithi158.stdout: "write_tier": -1, 2019-12-05T03:50:33.445 INFO:teuthology.orchestra.run.smithi158.stdout: "cache_mode": "none", 2019-12-05T03:50:33.445 INFO:teuthology.orchestra.run.smithi158.stdout: "target_max_bytes": 0, 2019-12-05T03:50:33.445 INFO:teuthology.orchestra.run.smithi158.stdout: "target_max_objects": 0, 2019-12-05T03:50:33.445 INFO:teuthology.orchestra.run.smithi158.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-12-05T03:50:33.446 INFO:teuthology.orchestra.run.smithi158.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-12-05T03:50:33.446 INFO:teuthology.orchestra.run.smithi158.stdout: "cache_target_full_ratio_micro": 800000, 2019-12-05T03:50:33.446 INFO:teuthology.orchestra.run.smithi158.stdout: "cache_min_flush_age": 0, 2019-12-05T03:50:33.446 INFO:teuthology.orchestra.run.smithi158.stdout: "cache_min_evict_age": 0, 2019-12-05T03:50:33.446 INFO:teuthology.orchestra.run.smithi158.stdout: "erasure_code_profile": "", 2019-12-05T03:50:33.446 INFO:teuthology.orchestra.run.smithi158.stdout: "hit_set_params": { 2019-12-05T03:50:33.446 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "none" 2019-12-05T03:50:33.447 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.447 INFO:teuthology.orchestra.run.smithi158.stdout: "hit_set_period": 0, 2019-12-05T03:50:33.447 INFO:teuthology.orchestra.run.smithi158.stdout: "hit_set_count": 0, 2019-12-05T03:50:33.447 INFO:teuthology.orchestra.run.smithi158.stdout: "use_gmt_hitset": true, 2019-12-05T03:50:33.447 INFO:teuthology.orchestra.run.smithi158.stdout: "min_read_recency_for_promote": 0, 2019-12-05T03:50:33.447 INFO:teuthology.orchestra.run.smithi158.stdout: "min_write_recency_for_promote": 0, 2019-12-05T03:50:33.447 INFO:teuthology.orchestra.run.smithi158.stdout: "hit_set_grade_decay_rate": 0, 2019-12-05T03:50:33.447 INFO:teuthology.orchestra.run.smithi158.stdout: "hit_set_search_last_n": 0, 2019-12-05T03:50:33.448 INFO:teuthology.orchestra.run.smithi158.stdout: "grade_table": [], 2019-12-05T03:50:33.448 INFO:teuthology.orchestra.run.smithi158.stdout: "stripe_width": 0, 2019-12-05T03:50:33.449 INFO:teuthology.orchestra.run.smithi158.stdout: "expected_num_objects": 0, 2019-12-05T03:50:33.449 INFO:teuthology.orchestra.run.smithi158.stdout: "fast_read": false, 2019-12-05T03:50:33.449 INFO:teuthology.orchestra.run.smithi158.stdout: "options": { 2019-12-05T03:50:33.449 INFO:teuthology.orchestra.run.smithi158.stdout: "pg_autoscale_bias": 4, 2019-12-05T03:50:33.449 INFO:teuthology.orchestra.run.smithi158.stdout: "pg_num_min": 16, 2019-12-05T03:50:33.450 INFO:teuthology.orchestra.run.smithi158.stdout: "recovery_priority": 5 2019-12-05T03:50:33.450 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.450 INFO:teuthology.orchestra.run.smithi158.stdout: "application_metadata": { 2019-12-05T03:50:33.450 INFO:teuthology.orchestra.run.smithi158.stdout: "cephfs": { 2019-12-05T03:50:33.450 INFO:teuthology.orchestra.run.smithi158.stdout: "metadata": "cephfs" 2019-12-05T03:50:33.450 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.450 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.451 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.451 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.451 INFO:teuthology.orchestra.run.smithi158.stdout: "pool": 3, 2019-12-05T03:50:33.451 INFO:teuthology.orchestra.run.smithi158.stdout: "pool_name": "cephfs_data", 2019-12-05T03:50:33.451 INFO:teuthology.orchestra.run.smithi158.stdout: "create_time": "2019-12-05T03:49:58.659250+0000", 2019-12-05T03:50:33.451 INFO:teuthology.orchestra.run.smithi158.stdout: "flags": 5, 2019-12-05T03:50:33.451 INFO:teuthology.orchestra.run.smithi158.stdout: "flags_names": "hashpspool,ec_overwrites", 2019-12-05T03:50:33.452 INFO:teuthology.orchestra.run.smithi158.stdout: "type": 3, 2019-12-05T03:50:33.452 INFO:teuthology.orchestra.run.smithi158.stdout: "size": 4, 2019-12-05T03:50:33.452 INFO:teuthology.orchestra.run.smithi158.stdout: "min_size": 3, 2019-12-05T03:50:33.452 INFO:teuthology.orchestra.run.smithi158.stdout: "crush_rule": 1, 2019-12-05T03:50:33.452 INFO:teuthology.orchestra.run.smithi158.stdout: "object_hash": 2, 2019-12-05T03:50:33.452 INFO:teuthology.orchestra.run.smithi158.stdout: "pg_autoscale_mode": "off", 2019-12-05T03:50:33.452 INFO:teuthology.orchestra.run.smithi158.stdout: "pg_num": 8, 2019-12-05T03:50:33.453 INFO:teuthology.orchestra.run.smithi158.stdout: "pg_placement_num": 8, 2019-12-05T03:50:33.453 INFO:teuthology.orchestra.run.smithi158.stdout: "pg_placement_num_target": 8, 2019-12-05T03:50:33.453 INFO:teuthology.orchestra.run.smithi158.stdout: "pg_num_target": 8, 2019-12-05T03:50:33.453 INFO:teuthology.orchestra.run.smithi158.stdout: "pg_num_pending": 8, 2019-12-05T03:50:33.453 INFO:teuthology.orchestra.run.smithi158.stdout: "last_pg_merge_meta": { 2019-12-05T03:50:33.453 INFO:teuthology.orchestra.run.smithi158.stdout: "source_pgid": "0.0", 2019-12-05T03:50:33.453 INFO:teuthology.orchestra.run.smithi158.stdout: "ready_epoch": 0, 2019-12-05T03:50:33.454 INFO:teuthology.orchestra.run.smithi158.stdout: "last_epoch_started": 0, 2019-12-05T03:50:33.454 INFO:teuthology.orchestra.run.smithi158.stdout: "last_epoch_clean": 0, 2019-12-05T03:50:33.454 INFO:teuthology.orchestra.run.smithi158.stdout: "source_version": "0'0", 2019-12-05T03:50:33.454 INFO:teuthology.orchestra.run.smithi158.stdout: "target_version": "0'0" 2019-12-05T03:50:33.454 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.454 INFO:teuthology.orchestra.run.smithi158.stdout: "last_change": "23", 2019-12-05T03:50:33.454 INFO:teuthology.orchestra.run.smithi158.stdout: "last_force_op_resend": "0", 2019-12-05T03:50:33.454 INFO:teuthology.orchestra.run.smithi158.stdout: "last_force_op_resend_prenautilus": "0", 2019-12-05T03:50:33.455 INFO:teuthology.orchestra.run.smithi158.stdout: "last_force_op_resend_preluminous": "0", 2019-12-05T03:50:33.455 INFO:teuthology.orchestra.run.smithi158.stdout: "auid": 0, 2019-12-05T03:50:33.455 INFO:teuthology.orchestra.run.smithi158.stdout: "snap_mode": "selfmanaged", 2019-12-05T03:50:33.455 INFO:teuthology.orchestra.run.smithi158.stdout: "snap_seq": 0, 2019-12-05T03:50:33.455 INFO:teuthology.orchestra.run.smithi158.stdout: "snap_epoch": 0, 2019-12-05T03:50:33.455 INFO:teuthology.orchestra.run.smithi158.stdout: "pool_snaps": [], 2019-12-05T03:50:33.455 INFO:teuthology.orchestra.run.smithi158.stdout: "removed_snaps": "[]", 2019-12-05T03:50:33.456 INFO:teuthology.orchestra.run.smithi158.stdout: "quota_max_bytes": 0, 2019-12-05T03:50:33.456 INFO:teuthology.orchestra.run.smithi158.stdout: "quota_max_objects": 0, 2019-12-05T03:50:33.456 INFO:teuthology.orchestra.run.smithi158.stdout: "tiers": [], 2019-12-05T03:50:33.456 INFO:teuthology.orchestra.run.smithi158.stdout: "tier_of": -1, 2019-12-05T03:50:33.456 INFO:teuthology.orchestra.run.smithi158.stdout: "read_tier": -1, 2019-12-05T03:50:33.456 INFO:teuthology.orchestra.run.smithi158.stdout: "write_tier": -1, 2019-12-05T03:50:33.456 INFO:teuthology.orchestra.run.smithi158.stdout: "cache_mode": "none", 2019-12-05T03:50:33.457 INFO:teuthology.orchestra.run.smithi158.stdout: "target_max_bytes": 0, 2019-12-05T03:50:33.457 INFO:teuthology.orchestra.run.smithi158.stdout: "target_max_objects": 0, 2019-12-05T03:50:33.457 INFO:teuthology.orchestra.run.smithi158.stdout: "cache_target_dirty_ratio_micro": 400000, 2019-12-05T03:50:33.457 INFO:teuthology.orchestra.run.smithi158.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2019-12-05T03:50:33.457 INFO:teuthology.orchestra.run.smithi158.stdout: "cache_target_full_ratio_micro": 800000, 2019-12-05T03:50:33.457 INFO:teuthology.orchestra.run.smithi158.stdout: "cache_min_flush_age": 0, 2019-12-05T03:50:33.457 INFO:teuthology.orchestra.run.smithi158.stdout: "cache_min_evict_age": 0, 2019-12-05T03:50:33.458 INFO:teuthology.orchestra.run.smithi158.stdout: "erasure_code_profile": "cephfs_data", 2019-12-05T03:50:33.458 INFO:teuthology.orchestra.run.smithi158.stdout: "hit_set_params": { 2019-12-05T03:50:33.458 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "none" 2019-12-05T03:50:33.458 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.458 INFO:teuthology.orchestra.run.smithi158.stdout: "hit_set_period": 0, 2019-12-05T03:50:33.459 INFO:teuthology.orchestra.run.smithi158.stdout: "hit_set_count": 0, 2019-12-05T03:50:33.459 INFO:teuthology.orchestra.run.smithi158.stdout: "use_gmt_hitset": true, 2019-12-05T03:50:33.459 INFO:teuthology.orchestra.run.smithi158.stdout: "min_read_recency_for_promote": 0, 2019-12-05T03:50:33.460 INFO:teuthology.orchestra.run.smithi158.stdout: "min_write_recency_for_promote": 0, 2019-12-05T03:50:33.460 INFO:teuthology.orchestra.run.smithi158.stdout: "hit_set_grade_decay_rate": 0, 2019-12-05T03:50:33.460 INFO:teuthology.orchestra.run.smithi158.stdout: "hit_set_search_last_n": 0, 2019-12-05T03:50:33.460 INFO:teuthology.orchestra.run.smithi158.stdout: "grade_table": [], 2019-12-05T03:50:33.460 INFO:teuthology.orchestra.run.smithi158.stdout: "stripe_width": 8192, 2019-12-05T03:50:33.460 INFO:teuthology.orchestra.run.smithi158.stdout: "expected_num_objects": 0, 2019-12-05T03:50:33.460 INFO:teuthology.orchestra.run.smithi158.stdout: "fast_read": false, 2019-12-05T03:50:33.461 INFO:teuthology.orchestra.run.smithi158.stdout: "options": {}, 2019-12-05T03:50:33.461 INFO:teuthology.orchestra.run.smithi158.stdout: "application_metadata": { 2019-12-05T03:50:33.461 INFO:teuthology.orchestra.run.smithi158.stdout: "cephfs": { 2019-12-05T03:50:33.461 INFO:teuthology.orchestra.run.smithi158.stdout: "data": "cephfs" 2019-12-05T03:50:33.461 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.461 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.461 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.462 INFO:teuthology.orchestra.run.smithi158.stdout: ], 2019-12-05T03:50:33.462 INFO:teuthology.orchestra.run.smithi158.stdout: "osds": [ 2019-12-05T03:50:33.462 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.462 INFO:teuthology.orchestra.run.smithi158.stdout: "osd": 0, 2019-12-05T03:50:33.462 INFO:teuthology.orchestra.run.smithi158.stdout: "uuid": "782c4258-e28c-4a11-9d54-3c9c7a36fba6", 2019-12-05T03:50:33.462 INFO:teuthology.orchestra.run.smithi158.stdout: "up": 1, 2019-12-05T03:50:33.462 INFO:teuthology.orchestra.run.smithi158.stdout: "in": 1, 2019-12-05T03:50:33.463 INFO:teuthology.orchestra.run.smithi158.stdout: "weight": 1, 2019-12-05T03:50:33.463 INFO:teuthology.orchestra.run.smithi158.stdout: "primary_affinity": 1, 2019-12-05T03:50:33.463 INFO:teuthology.orchestra.run.smithi158.stdout: "last_clean_begin": 0, 2019-12-05T03:50:33.463 INFO:teuthology.orchestra.run.smithi158.stdout: "last_clean_end": 0, 2019-12-05T03:50:33.463 INFO:teuthology.orchestra.run.smithi158.stdout: "up_from": 13, 2019-12-05T03:50:33.463 INFO:teuthology.orchestra.run.smithi158.stdout: "up_thru": 21, 2019-12-05T03:50:33.463 INFO:teuthology.orchestra.run.smithi158.stdout: "down_at": 0, 2019-12-05T03:50:33.463 INFO:teuthology.orchestra.run.smithi158.stdout: "lost_at": 0, 2019-12-05T03:50:33.464 INFO:teuthology.orchestra.run.smithi158.stdout: "public_addrs": { 2019-12-05T03:50:33.464 INFO:teuthology.orchestra.run.smithi158.stdout: "addrvec": [ 2019-12-05T03:50:33.464 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.464 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v2", 2019-12-05T03:50:33.464 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:6800", 2019-12-05T03:50:33.464 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12192 2019-12-05T03:50:33.464 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.465 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.465 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:50:33.465 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:6801", 2019-12-05T03:50:33.465 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12192 2019-12-05T03:50:33.465 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.465 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.465 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.466 INFO:teuthology.orchestra.run.smithi158.stdout: "cluster_addrs": { 2019-12-05T03:50:33.466 INFO:teuthology.orchestra.run.smithi158.stdout: "addrvec": [ 2019-12-05T03:50:33.466 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.466 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v2", 2019-12-05T03:50:33.466 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:6802", 2019-12-05T03:50:33.466 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12192 2019-12-05T03:50:33.466 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.467 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.467 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:50:33.467 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:6803", 2019-12-05T03:50:33.467 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12192 2019-12-05T03:50:33.467 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.467 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.467 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.467 INFO:teuthology.orchestra.run.smithi158.stdout: "heartbeat_back_addrs": { 2019-12-05T03:50:33.468 INFO:teuthology.orchestra.run.smithi158.stdout: "addrvec": [ 2019-12-05T03:50:33.468 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.468 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v2", 2019-12-05T03:50:33.468 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:6806", 2019-12-05T03:50:33.468 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12192 2019-12-05T03:50:33.468 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.469 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.469 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:50:33.470 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:6807", 2019-12-05T03:50:33.470 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12192 2019-12-05T03:50:33.470 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.470 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.470 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.470 INFO:teuthology.orchestra.run.smithi158.stdout: "heartbeat_front_addrs": { 2019-12-05T03:50:33.471 INFO:teuthology.orchestra.run.smithi158.stdout: "addrvec": [ 2019-12-05T03:50:33.471 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.471 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v2", 2019-12-05T03:50:33.471 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:6804", 2019-12-05T03:50:33.471 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12192 2019-12-05T03:50:33.471 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.471 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.472 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:50:33.472 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:6805", 2019-12-05T03:50:33.472 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12192 2019-12-05T03:50:33.472 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.472 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.472 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.472 INFO:teuthology.orchestra.run.smithi158.stdout: "public_addr": "172.21.15.158:6801/12192", 2019-12-05T03:50:33.473 INFO:teuthology.orchestra.run.smithi158.stdout: "cluster_addr": "172.21.15.158:6803/12192", 2019-12-05T03:50:33.473 INFO:teuthology.orchestra.run.smithi158.stdout: "heartbeat_back_addr": "172.21.15.158:6807/12192", 2019-12-05T03:50:33.473 INFO:teuthology.orchestra.run.smithi158.stdout: "heartbeat_front_addr": "172.21.15.158:6805/12192", 2019-12-05T03:50:33.473 INFO:teuthology.orchestra.run.smithi158.stdout: "state": [ 2019-12-05T03:50:33.473 INFO:teuthology.orchestra.run.smithi158.stdout: "exists", 2019-12-05T03:50:33.473 INFO:teuthology.orchestra.run.smithi158.stdout: "up" 2019-12-05T03:50:33.473 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.473 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.474 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.474 INFO:teuthology.orchestra.run.smithi158.stdout: "osd": 1, 2019-12-05T03:50:33.474 INFO:teuthology.orchestra.run.smithi158.stdout: "uuid": "d4426b21-b666-4158-bf34-a24b14572731", 2019-12-05T03:50:33.474 INFO:teuthology.orchestra.run.smithi158.stdout: "up": 1, 2019-12-05T03:50:33.474 INFO:teuthology.orchestra.run.smithi158.stdout: "in": 1, 2019-12-05T03:50:33.474 INFO:teuthology.orchestra.run.smithi158.stdout: "weight": 1, 2019-12-05T03:50:33.474 INFO:teuthology.orchestra.run.smithi158.stdout: "primary_affinity": 1, 2019-12-05T03:50:33.475 INFO:teuthology.orchestra.run.smithi158.stdout: "last_clean_begin": 0, 2019-12-05T03:50:33.475 INFO:teuthology.orchestra.run.smithi158.stdout: "last_clean_end": 0, 2019-12-05T03:50:33.475 INFO:teuthology.orchestra.run.smithi158.stdout: "up_from": 13, 2019-12-05T03:50:33.475 INFO:teuthology.orchestra.run.smithi158.stdout: "up_thru": 15, 2019-12-05T03:50:33.475 INFO:teuthology.orchestra.run.smithi158.stdout: "down_at": 0, 2019-12-05T03:50:33.475 INFO:teuthology.orchestra.run.smithi158.stdout: "lost_at": 0, 2019-12-05T03:50:33.475 INFO:teuthology.orchestra.run.smithi158.stdout: "public_addrs": { 2019-12-05T03:50:33.476 INFO:teuthology.orchestra.run.smithi158.stdout: "addrvec": [ 2019-12-05T03:50:33.476 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.476 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v2", 2019-12-05T03:50:33.476 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:6808", 2019-12-05T03:50:33.476 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12193 2019-12-05T03:50:33.476 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.476 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.476 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:50:33.477 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:6809", 2019-12-05T03:50:33.477 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12193 2019-12-05T03:50:33.477 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.477 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.477 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.477 INFO:teuthology.orchestra.run.smithi158.stdout: "cluster_addrs": { 2019-12-05T03:50:33.477 INFO:teuthology.orchestra.run.smithi158.stdout: "addrvec": [ 2019-12-05T03:50:33.478 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.478 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v2", 2019-12-05T03:50:33.478 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:6810", 2019-12-05T03:50:33.478 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12193 2019-12-05T03:50:33.478 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.478 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.478 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:50:33.478 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:6811", 2019-12-05T03:50:33.479 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12193 2019-12-05T03:50:33.479 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.480 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.480 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.480 INFO:teuthology.orchestra.run.smithi158.stdout: "heartbeat_back_addrs": { 2019-12-05T03:50:33.480 INFO:teuthology.orchestra.run.smithi158.stdout: "addrvec": [ 2019-12-05T03:50:33.480 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.481 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v2", 2019-12-05T03:50:33.481 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:6814", 2019-12-05T03:50:33.481 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12193 2019-12-05T03:50:33.481 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.481 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.481 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:50:33.481 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:6815", 2019-12-05T03:50:33.482 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12193 2019-12-05T03:50:33.482 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.482 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.482 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.482 INFO:teuthology.orchestra.run.smithi158.stdout: "heartbeat_front_addrs": { 2019-12-05T03:50:33.482 INFO:teuthology.orchestra.run.smithi158.stdout: "addrvec": [ 2019-12-05T03:50:33.482 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.483 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v2", 2019-12-05T03:50:33.483 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:6812", 2019-12-05T03:50:33.483 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12193 2019-12-05T03:50:33.483 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.483 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.483 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:50:33.483 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:6813", 2019-12-05T03:50:33.483 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12193 2019-12-05T03:50:33.484 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.484 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.484 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.484 INFO:teuthology.orchestra.run.smithi158.stdout: "public_addr": "172.21.15.158:6809/12193", 2019-12-05T03:50:33.484 INFO:teuthology.orchestra.run.smithi158.stdout: "cluster_addr": "172.21.15.158:6811/12193", 2019-12-05T03:50:33.484 INFO:teuthology.orchestra.run.smithi158.stdout: "heartbeat_back_addr": "172.21.15.158:6815/12193", 2019-12-05T03:50:33.484 INFO:teuthology.orchestra.run.smithi158.stdout: "heartbeat_front_addr": "172.21.15.158:6813/12193", 2019-12-05T03:50:33.485 INFO:teuthology.orchestra.run.smithi158.stdout: "state": [ 2019-12-05T03:50:33.485 INFO:teuthology.orchestra.run.smithi158.stdout: "exists", 2019-12-05T03:50:33.485 INFO:teuthology.orchestra.run.smithi158.stdout: "up" 2019-12-05T03:50:33.485 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.485 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.485 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.485 INFO:teuthology.orchestra.run.smithi158.stdout: "osd": 2, 2019-12-05T03:50:33.486 INFO:teuthology.orchestra.run.smithi158.stdout: "uuid": "22680edd-6490-4ab0-bb15-0605830e4cfb", 2019-12-05T03:50:33.486 INFO:teuthology.orchestra.run.smithi158.stdout: "up": 1, 2019-12-05T03:50:33.486 INFO:teuthology.orchestra.run.smithi158.stdout: "in": 1, 2019-12-05T03:50:33.486 INFO:teuthology.orchestra.run.smithi158.stdout: "weight": 1, 2019-12-05T03:50:33.486 INFO:teuthology.orchestra.run.smithi158.stdout: "primary_affinity": 1, 2019-12-05T03:50:33.486 INFO:teuthology.orchestra.run.smithi158.stdout: "last_clean_begin": 0, 2019-12-05T03:50:33.487 INFO:teuthology.orchestra.run.smithi158.stdout: "last_clean_end": 0, 2019-12-05T03:50:33.487 INFO:teuthology.orchestra.run.smithi158.stdout: "up_from": 13, 2019-12-05T03:50:33.487 INFO:teuthology.orchestra.run.smithi158.stdout: "up_thru": 21, 2019-12-05T03:50:33.487 INFO:teuthology.orchestra.run.smithi158.stdout: "down_at": 0, 2019-12-05T03:50:33.488 INFO:teuthology.orchestra.run.smithi158.stdout: "lost_at": 0, 2019-12-05T03:50:33.488 INFO:teuthology.orchestra.run.smithi158.stdout: "public_addrs": { 2019-12-05T03:50:33.488 INFO:teuthology.orchestra.run.smithi158.stdout: "addrvec": [ 2019-12-05T03:50:33.488 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.488 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v2", 2019-12-05T03:50:33.488 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:6824", 2019-12-05T03:50:33.488 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12195 2019-12-05T03:50:33.489 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.489 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.489 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:50:33.489 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:6825", 2019-12-05T03:50:33.489 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12195 2019-12-05T03:50:33.490 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.490 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.490 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.491 INFO:teuthology.orchestra.run.smithi158.stdout: "cluster_addrs": { 2019-12-05T03:50:33.491 INFO:teuthology.orchestra.run.smithi158.stdout: "addrvec": [ 2019-12-05T03:50:33.491 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.491 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v2", 2019-12-05T03:50:33.491 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:6826", 2019-12-05T03:50:33.491 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12195 2019-12-05T03:50:33.491 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.492 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.492 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:50:33.492 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:6827", 2019-12-05T03:50:33.492 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12195 2019-12-05T03:50:33.492 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.493 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.493 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.493 INFO:teuthology.orchestra.run.smithi158.stdout: "heartbeat_back_addrs": { 2019-12-05T03:50:33.493 INFO:teuthology.orchestra.run.smithi158.stdout: "addrvec": [ 2019-12-05T03:50:33.493 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.493 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v2", 2019-12-05T03:50:33.494 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:6830", 2019-12-05T03:50:33.494 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12195 2019-12-05T03:50:33.494 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.494 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.494 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:50:33.494 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:6831", 2019-12-05T03:50:33.494 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12195 2019-12-05T03:50:33.495 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.495 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.495 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.495 INFO:teuthology.orchestra.run.smithi158.stdout: "heartbeat_front_addrs": { 2019-12-05T03:50:33.495 INFO:teuthology.orchestra.run.smithi158.stdout: "addrvec": [ 2019-12-05T03:50:33.495 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.496 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v2", 2019-12-05T03:50:33.496 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:6828", 2019-12-05T03:50:33.496 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12195 2019-12-05T03:50:33.496 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.496 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.496 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:50:33.496 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:6829", 2019-12-05T03:50:33.497 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12195 2019-12-05T03:50:33.497 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.497 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.497 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.497 INFO:teuthology.orchestra.run.smithi158.stdout: "public_addr": "172.21.15.158:6825/12195", 2019-12-05T03:50:33.497 INFO:teuthology.orchestra.run.smithi158.stdout: "cluster_addr": "172.21.15.158:6827/12195", 2019-12-05T03:50:33.497 INFO:teuthology.orchestra.run.smithi158.stdout: "heartbeat_back_addr": "172.21.15.158:6831/12195", 2019-12-05T03:50:33.497 INFO:teuthology.orchestra.run.smithi158.stdout: "heartbeat_front_addr": "172.21.15.158:6829/12195", 2019-12-05T03:50:33.498 INFO:teuthology.orchestra.run.smithi158.stdout: "state": [ 2019-12-05T03:50:33.498 INFO:teuthology.orchestra.run.smithi158.stdout: "exists", 2019-12-05T03:50:33.498 INFO:teuthology.orchestra.run.smithi158.stdout: "up" 2019-12-05T03:50:33.498 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.498 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.498 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.498 INFO:teuthology.orchestra.run.smithi158.stdout: "osd": 3, 2019-12-05T03:50:33.499 INFO:teuthology.orchestra.run.smithi158.stdout: "uuid": "7ec999ee-ace8-4ccb-a4f9-6f5d313bbbd2", 2019-12-05T03:50:33.499 INFO:teuthology.orchestra.run.smithi158.stdout: "up": 1, 2019-12-05T03:50:33.499 INFO:teuthology.orchestra.run.smithi158.stdout: "in": 1, 2019-12-05T03:50:33.499 INFO:teuthology.orchestra.run.smithi158.stdout: "weight": 1, 2019-12-05T03:50:33.499 INFO:teuthology.orchestra.run.smithi158.stdout: "primary_affinity": 1, 2019-12-05T03:50:33.499 INFO:teuthology.orchestra.run.smithi158.stdout: "last_clean_begin": 0, 2019-12-05T03:50:33.499 INFO:teuthology.orchestra.run.smithi158.stdout: "last_clean_end": 0, 2019-12-05T03:50:33.500 INFO:teuthology.orchestra.run.smithi158.stdout: "up_from": 13, 2019-12-05T03:50:33.500 INFO:teuthology.orchestra.run.smithi158.stdout: "up_thru": 18, 2019-12-05T03:50:33.501 INFO:teuthology.orchestra.run.smithi158.stdout: "down_at": 0, 2019-12-05T03:50:33.501 INFO:teuthology.orchestra.run.smithi158.stdout: "lost_at": 0, 2019-12-05T03:50:33.501 INFO:teuthology.orchestra.run.smithi158.stdout: "public_addrs": { 2019-12-05T03:50:33.501 INFO:teuthology.orchestra.run.smithi158.stdout: "addrvec": [ 2019-12-05T03:50:33.501 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.501 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v2", 2019-12-05T03:50:33.502 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:6816", 2019-12-05T03:50:33.502 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12194 2019-12-05T03:50:33.502 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.502 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.502 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:50:33.502 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:6817", 2019-12-05T03:50:33.502 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12194 2019-12-05T03:50:33.503 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.503 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.503 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.503 INFO:teuthology.orchestra.run.smithi158.stdout: "cluster_addrs": { 2019-12-05T03:50:33.503 INFO:teuthology.orchestra.run.smithi158.stdout: "addrvec": [ 2019-12-05T03:50:33.503 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.503 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v2", 2019-12-05T03:50:33.503 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:6818", 2019-12-05T03:50:33.504 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12194 2019-12-05T03:50:33.504 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.504 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.504 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:50:33.504 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:6819", 2019-12-05T03:50:33.504 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12194 2019-12-05T03:50:33.504 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.505 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.505 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.505 INFO:teuthology.orchestra.run.smithi158.stdout: "heartbeat_back_addrs": { 2019-12-05T03:50:33.505 INFO:teuthology.orchestra.run.smithi158.stdout: "addrvec": [ 2019-12-05T03:50:33.505 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.505 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v2", 2019-12-05T03:50:33.505 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:6822", 2019-12-05T03:50:33.506 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12194 2019-12-05T03:50:33.506 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.506 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.506 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:50:33.506 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:6823", 2019-12-05T03:50:33.506 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12194 2019-12-05T03:50:33.506 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.507 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.507 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.507 INFO:teuthology.orchestra.run.smithi158.stdout: "heartbeat_front_addrs": { 2019-12-05T03:50:33.507 INFO:teuthology.orchestra.run.smithi158.stdout: "addrvec": [ 2019-12-05T03:50:33.507 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.507 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v2", 2019-12-05T03:50:33.507 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:6820", 2019-12-05T03:50:33.508 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12194 2019-12-05T03:50:33.508 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.508 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.508 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:50:33.508 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:6821", 2019-12-05T03:50:33.508 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12194 2019-12-05T03:50:33.508 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.508 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.509 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.509 INFO:teuthology.orchestra.run.smithi158.stdout: "public_addr": "172.21.15.158:6817/12194", 2019-12-05T03:50:33.509 INFO:teuthology.orchestra.run.smithi158.stdout: "cluster_addr": "172.21.15.158:6819/12194", 2019-12-05T03:50:33.509 INFO:teuthology.orchestra.run.smithi158.stdout: "heartbeat_back_addr": "172.21.15.158:6823/12194", 2019-12-05T03:50:33.509 INFO:teuthology.orchestra.run.smithi158.stdout: "heartbeat_front_addr": "172.21.15.158:6821/12194", 2019-12-05T03:50:33.509 INFO:teuthology.orchestra.run.smithi158.stdout: "state": [ 2019-12-05T03:50:33.509 INFO:teuthology.orchestra.run.smithi158.stdout: "exists", 2019-12-05T03:50:33.510 INFO:teuthology.orchestra.run.smithi158.stdout: "up" 2019-12-05T03:50:33.510 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.510 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.511 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.511 INFO:teuthology.orchestra.run.smithi158.stdout: "osd": 4, 2019-12-05T03:50:33.511 INFO:teuthology.orchestra.run.smithi158.stdout: "uuid": "186e69c4-b69f-4dd1-bb8f-faf759c60484", 2019-12-05T03:50:33.511 INFO:teuthology.orchestra.run.smithi158.stdout: "up": 1, 2019-12-05T03:50:33.511 INFO:teuthology.orchestra.run.smithi158.stdout: "in": 1, 2019-12-05T03:50:33.512 INFO:teuthology.orchestra.run.smithi158.stdout: "weight": 1, 2019-12-05T03:50:33.512 INFO:teuthology.orchestra.run.smithi158.stdout: "primary_affinity": 1, 2019-12-05T03:50:33.512 INFO:teuthology.orchestra.run.smithi158.stdout: "last_clean_begin": 0, 2019-12-05T03:50:33.512 INFO:teuthology.orchestra.run.smithi158.stdout: "last_clean_end": 0, 2019-12-05T03:50:33.512 INFO:teuthology.orchestra.run.smithi158.stdout: "up_from": 13, 2019-12-05T03:50:33.512 INFO:teuthology.orchestra.run.smithi158.stdout: "up_thru": 21, 2019-12-05T03:50:33.512 INFO:teuthology.orchestra.run.smithi158.stdout: "down_at": 0, 2019-12-05T03:50:33.513 INFO:teuthology.orchestra.run.smithi158.stdout: "lost_at": 0, 2019-12-05T03:50:33.513 INFO:teuthology.orchestra.run.smithi158.stdout: "public_addrs": { 2019-12-05T03:50:33.513 INFO:teuthology.orchestra.run.smithi158.stdout: "addrvec": [ 2019-12-05T03:50:33.513 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.513 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v2", 2019-12-05T03:50:33.513 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.96:6802", 2019-12-05T03:50:33.513 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12460 2019-12-05T03:50:33.514 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.514 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.514 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:50:33.514 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.96:6803", 2019-12-05T03:50:33.514 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12460 2019-12-05T03:50:33.514 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.514 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.515 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.515 INFO:teuthology.orchestra.run.smithi158.stdout: "cluster_addrs": { 2019-12-05T03:50:33.515 INFO:teuthology.orchestra.run.smithi158.stdout: "addrvec": [ 2019-12-05T03:50:33.515 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.515 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v2", 2019-12-05T03:50:33.515 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.96:6804", 2019-12-05T03:50:33.515 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12460 2019-12-05T03:50:33.515 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.516 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.516 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:50:33.516 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.96:6805", 2019-12-05T03:50:33.516 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12460 2019-12-05T03:50:33.516 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.516 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.516 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.517 INFO:teuthology.orchestra.run.smithi158.stdout: "heartbeat_back_addrs": { 2019-12-05T03:50:33.517 INFO:teuthology.orchestra.run.smithi158.stdout: "addrvec": [ 2019-12-05T03:50:33.517 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.517 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v2", 2019-12-05T03:50:33.517 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.96:6808", 2019-12-05T03:50:33.517 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12460 2019-12-05T03:50:33.517 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.517 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.518 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:50:33.518 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.96:6809", 2019-12-05T03:50:33.518 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12460 2019-12-05T03:50:33.518 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.518 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.518 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.518 INFO:teuthology.orchestra.run.smithi158.stdout: "heartbeat_front_addrs": { 2019-12-05T03:50:33.519 INFO:teuthology.orchestra.run.smithi158.stdout: "addrvec": [ 2019-12-05T03:50:33.519 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.519 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v2", 2019-12-05T03:50:33.519 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.96:6806", 2019-12-05T03:50:33.519 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12460 2019-12-05T03:50:33.519 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.519 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.520 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:50:33.520 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.96:6807", 2019-12-05T03:50:33.520 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12460 2019-12-05T03:50:33.520 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.521 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.521 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.521 INFO:teuthology.orchestra.run.smithi158.stdout: "public_addr": "172.21.15.96:6803/12460", 2019-12-05T03:50:33.521 INFO:teuthology.orchestra.run.smithi158.stdout: "cluster_addr": "172.21.15.96:6805/12460", 2019-12-05T03:50:33.522 INFO:teuthology.orchestra.run.smithi158.stdout: "heartbeat_back_addr": "172.21.15.96:6809/12460", 2019-12-05T03:50:33.522 INFO:teuthology.orchestra.run.smithi158.stdout: "heartbeat_front_addr": "172.21.15.96:6807/12460", 2019-12-05T03:50:33.522 INFO:teuthology.orchestra.run.smithi158.stdout: "state": [ 2019-12-05T03:50:33.522 INFO:teuthology.orchestra.run.smithi158.stdout: "exists", 2019-12-05T03:50:33.522 INFO:teuthology.orchestra.run.smithi158.stdout: "up" 2019-12-05T03:50:33.522 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.522 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.523 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.523 INFO:teuthology.orchestra.run.smithi158.stdout: "osd": 5, 2019-12-05T03:50:33.523 INFO:teuthology.orchestra.run.smithi158.stdout: "uuid": "86b658b2-8b40-4cea-8163-305a3982758b", 2019-12-05T03:50:33.523 INFO:teuthology.orchestra.run.smithi158.stdout: "up": 1, 2019-12-05T03:50:33.523 INFO:teuthology.orchestra.run.smithi158.stdout: "in": 1, 2019-12-05T03:50:33.523 INFO:teuthology.orchestra.run.smithi158.stdout: "weight": 1, 2019-12-05T03:50:33.523 INFO:teuthology.orchestra.run.smithi158.stdout: "primary_affinity": 1, 2019-12-05T03:50:33.524 INFO:teuthology.orchestra.run.smithi158.stdout: "last_clean_begin": 0, 2019-12-05T03:50:33.524 INFO:teuthology.orchestra.run.smithi158.stdout: "last_clean_end": 0, 2019-12-05T03:50:33.524 INFO:teuthology.orchestra.run.smithi158.stdout: "up_from": 13, 2019-12-05T03:50:33.524 INFO:teuthology.orchestra.run.smithi158.stdout: "up_thru": 21, 2019-12-05T03:50:33.524 INFO:teuthology.orchestra.run.smithi158.stdout: "down_at": 0, 2019-12-05T03:50:33.524 INFO:teuthology.orchestra.run.smithi158.stdout: "lost_at": 0, 2019-12-05T03:50:33.524 INFO:teuthology.orchestra.run.smithi158.stdout: "public_addrs": { 2019-12-05T03:50:33.525 INFO:teuthology.orchestra.run.smithi158.stdout: "addrvec": [ 2019-12-05T03:50:33.525 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.525 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v2", 2019-12-05T03:50:33.525 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.96:6810", 2019-12-05T03:50:33.525 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12461 2019-12-05T03:50:33.525 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.525 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.525 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:50:33.526 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.96:6811", 2019-12-05T03:50:33.526 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12461 2019-12-05T03:50:33.526 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.526 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.526 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.527 INFO:teuthology.orchestra.run.smithi158.stdout: "cluster_addrs": { 2019-12-05T03:50:33.527 INFO:teuthology.orchestra.run.smithi158.stdout: "addrvec": [ 2019-12-05T03:50:33.527 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.527 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v2", 2019-12-05T03:50:33.527 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.96:6812", 2019-12-05T03:50:33.527 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12461 2019-12-05T03:50:33.528 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.528 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.528 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:50:33.528 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.96:6813", 2019-12-05T03:50:33.528 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12461 2019-12-05T03:50:33.528 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.528 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.529 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.529 INFO:teuthology.orchestra.run.smithi158.stdout: "heartbeat_back_addrs": { 2019-12-05T03:50:33.529 INFO:teuthology.orchestra.run.smithi158.stdout: "addrvec": [ 2019-12-05T03:50:33.529 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.529 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v2", 2019-12-05T03:50:33.529 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.96:6816", 2019-12-05T03:50:33.529 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12461 2019-12-05T03:50:33.530 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.530 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.530 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:50:33.530 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.96:6817", 2019-12-05T03:50:33.530 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12461 2019-12-05T03:50:33.530 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.530 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.531 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.531 INFO:teuthology.orchestra.run.smithi158.stdout: "heartbeat_front_addrs": { 2019-12-05T03:50:33.532 INFO:teuthology.orchestra.run.smithi158.stdout: "addrvec": [ 2019-12-05T03:50:33.532 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.532 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v2", 2019-12-05T03:50:33.532 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.96:6814", 2019-12-05T03:50:33.532 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12461 2019-12-05T03:50:33.532 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.532 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.533 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:50:33.533 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.96:6815", 2019-12-05T03:50:33.533 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12461 2019-12-05T03:50:33.533 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.533 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.533 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.533 INFO:teuthology.orchestra.run.smithi158.stdout: "public_addr": "172.21.15.96:6811/12461", 2019-12-05T03:50:33.534 INFO:teuthology.orchestra.run.smithi158.stdout: "cluster_addr": "172.21.15.96:6813/12461", 2019-12-05T03:50:33.534 INFO:teuthology.orchestra.run.smithi158.stdout: "heartbeat_back_addr": "172.21.15.96:6817/12461", 2019-12-05T03:50:33.534 INFO:teuthology.orchestra.run.smithi158.stdout: "heartbeat_front_addr": "172.21.15.96:6815/12461", 2019-12-05T03:50:33.534 INFO:teuthology.orchestra.run.smithi158.stdout: "state": [ 2019-12-05T03:50:33.534 INFO:teuthology.orchestra.run.smithi158.stdout: "exists", 2019-12-05T03:50:33.534 INFO:teuthology.orchestra.run.smithi158.stdout: "up" 2019-12-05T03:50:33.534 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.534 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.535 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.535 INFO:teuthology.orchestra.run.smithi158.stdout: "osd": 6, 2019-12-05T03:50:33.535 INFO:teuthology.orchestra.run.smithi158.stdout: "uuid": "bdadaea8-9296-4788-bc59-d9c9eb8defdf", 2019-12-05T03:50:33.535 INFO:teuthology.orchestra.run.smithi158.stdout: "up": 1, 2019-12-05T03:50:33.535 INFO:teuthology.orchestra.run.smithi158.stdout: "in": 1, 2019-12-05T03:50:33.535 INFO:teuthology.orchestra.run.smithi158.stdout: "weight": 1, 2019-12-05T03:50:33.535 INFO:teuthology.orchestra.run.smithi158.stdout: "primary_affinity": 1, 2019-12-05T03:50:33.536 INFO:teuthology.orchestra.run.smithi158.stdout: "last_clean_begin": 0, 2019-12-05T03:50:33.536 INFO:teuthology.orchestra.run.smithi158.stdout: "last_clean_end": 0, 2019-12-05T03:50:33.536 INFO:teuthology.orchestra.run.smithi158.stdout: "up_from": 13, 2019-12-05T03:50:33.536 INFO:teuthology.orchestra.run.smithi158.stdout: "up_thru": 21, 2019-12-05T03:50:33.536 INFO:teuthology.orchestra.run.smithi158.stdout: "down_at": 0, 2019-12-05T03:50:33.536 INFO:teuthology.orchestra.run.smithi158.stdout: "lost_at": 0, 2019-12-05T03:50:33.536 INFO:teuthology.orchestra.run.smithi158.stdout: "public_addrs": { 2019-12-05T03:50:33.537 INFO:teuthology.orchestra.run.smithi158.stdout: "addrvec": [ 2019-12-05T03:50:33.537 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.537 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v2", 2019-12-05T03:50:33.537 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.96:6826", 2019-12-05T03:50:33.537 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12463 2019-12-05T03:50:33.537 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.537 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.537 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:50:33.538 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.96:6827", 2019-12-05T03:50:33.538 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12463 2019-12-05T03:50:33.538 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.538 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.538 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.538 INFO:teuthology.orchestra.run.smithi158.stdout: "cluster_addrs": { 2019-12-05T03:50:33.538 INFO:teuthology.orchestra.run.smithi158.stdout: "addrvec": [ 2019-12-05T03:50:33.539 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.539 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v2", 2019-12-05T03:50:33.539 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.96:6828", 2019-12-05T03:50:33.539 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12463 2019-12-05T03:50:33.539 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.539 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.539 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:50:33.539 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.96:6829", 2019-12-05T03:50:33.540 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12463 2019-12-05T03:50:33.540 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.540 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.540 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.540 INFO:teuthology.orchestra.run.smithi158.stdout: "heartbeat_back_addrs": { 2019-12-05T03:50:33.540 INFO:teuthology.orchestra.run.smithi158.stdout: "addrvec": [ 2019-12-05T03:50:33.540 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.541 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v2", 2019-12-05T03:50:33.541 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.96:6832", 2019-12-05T03:50:33.541 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12463 2019-12-05T03:50:33.541 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.542 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.542 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:50:33.544 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.96:6833", 2019-12-05T03:50:33.544 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12463 2019-12-05T03:50:33.545 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.545 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.545 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.545 INFO:teuthology.orchestra.run.smithi158.stdout: "heartbeat_front_addrs": { 2019-12-05T03:50:33.545 INFO:teuthology.orchestra.run.smithi158.stdout: "addrvec": [ 2019-12-05T03:50:33.545 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.545 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v2", 2019-12-05T03:50:33.546 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.96:6830", 2019-12-05T03:50:33.546 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12463 2019-12-05T03:50:33.546 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.546 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.546 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:50:33.546 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.96:6831", 2019-12-05T03:50:33.546 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12463 2019-12-05T03:50:33.547 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.547 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.547 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.547 INFO:teuthology.orchestra.run.smithi158.stdout: "public_addr": "172.21.15.96:6827/12463", 2019-12-05T03:50:33.547 INFO:teuthology.orchestra.run.smithi158.stdout: "cluster_addr": "172.21.15.96:6829/12463", 2019-12-05T03:50:33.547 INFO:teuthology.orchestra.run.smithi158.stdout: "heartbeat_back_addr": "172.21.15.96:6833/12463", 2019-12-05T03:50:33.547 INFO:teuthology.orchestra.run.smithi158.stdout: "heartbeat_front_addr": "172.21.15.96:6831/12463", 2019-12-05T03:50:33.547 INFO:teuthology.orchestra.run.smithi158.stdout: "state": [ 2019-12-05T03:50:33.548 INFO:teuthology.orchestra.run.smithi158.stdout: "exists", 2019-12-05T03:50:33.548 INFO:teuthology.orchestra.run.smithi158.stdout: "up" 2019-12-05T03:50:33.548 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.548 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.548 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.548 INFO:teuthology.orchestra.run.smithi158.stdout: "osd": 7, 2019-12-05T03:50:33.549 INFO:teuthology.orchestra.run.smithi158.stdout: "uuid": "c6d71846-d68e-430f-ab72-0fb8ea4bf640", 2019-12-05T03:50:33.549 INFO:teuthology.orchestra.run.smithi158.stdout: "up": 1, 2019-12-05T03:50:33.549 INFO:teuthology.orchestra.run.smithi158.stdout: "in": 1, 2019-12-05T03:50:33.549 INFO:teuthology.orchestra.run.smithi158.stdout: "weight": 1, 2019-12-05T03:50:33.549 INFO:teuthology.orchestra.run.smithi158.stdout: "primary_affinity": 1, 2019-12-05T03:50:33.549 INFO:teuthology.orchestra.run.smithi158.stdout: "last_clean_begin": 0, 2019-12-05T03:50:33.549 INFO:teuthology.orchestra.run.smithi158.stdout: "last_clean_end": 0, 2019-12-05T03:50:33.549 INFO:teuthology.orchestra.run.smithi158.stdout: "up_from": 13, 2019-12-05T03:50:33.550 INFO:teuthology.orchestra.run.smithi158.stdout: "up_thru": 18, 2019-12-05T03:50:33.550 INFO:teuthology.orchestra.run.smithi158.stdout: "down_at": 0, 2019-12-05T03:50:33.550 INFO:teuthology.orchestra.run.smithi158.stdout: "lost_at": 0, 2019-12-05T03:50:33.550 INFO:teuthology.orchestra.run.smithi158.stdout: "public_addrs": { 2019-12-05T03:50:33.550 INFO:teuthology.orchestra.run.smithi158.stdout: "addrvec": [ 2019-12-05T03:50:33.550 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.550 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v2", 2019-12-05T03:50:33.551 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.96:6818", 2019-12-05T03:50:33.551 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12462 2019-12-05T03:50:33.551 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.551 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.551 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:50:33.551 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.96:6819", 2019-12-05T03:50:33.552 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12462 2019-12-05T03:50:33.552 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.552 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.552 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.552 INFO:teuthology.orchestra.run.smithi158.stdout: "cluster_addrs": { 2019-12-05T03:50:33.552 INFO:teuthology.orchestra.run.smithi158.stdout: "addrvec": [ 2019-12-05T03:50:33.553 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.553 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v2", 2019-12-05T03:50:33.553 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.96:6820", 2019-12-05T03:50:33.553 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12462 2019-12-05T03:50:33.553 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.553 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.553 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:50:33.554 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.96:6821", 2019-12-05T03:50:33.554 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12462 2019-12-05T03:50:33.554 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.554 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.554 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.554 INFO:teuthology.orchestra.run.smithi158.stdout: "heartbeat_back_addrs": { 2019-12-05T03:50:33.554 INFO:teuthology.orchestra.run.smithi158.stdout: "addrvec": [ 2019-12-05T03:50:33.555 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.555 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v2", 2019-12-05T03:50:33.555 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.96:6824", 2019-12-05T03:50:33.555 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12462 2019-12-05T03:50:33.555 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.555 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.555 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:50:33.556 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.96:6825", 2019-12-05T03:50:33.556 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12462 2019-12-05T03:50:33.556 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.556 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.556 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.556 INFO:teuthology.orchestra.run.smithi158.stdout: "heartbeat_front_addrs": { 2019-12-05T03:50:33.556 INFO:teuthology.orchestra.run.smithi158.stdout: "addrvec": [ 2019-12-05T03:50:33.557 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.557 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v2", 2019-12-05T03:50:33.557 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.96:6822", 2019-12-05T03:50:33.557 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12462 2019-12-05T03:50:33.557 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.557 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.557 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:50:33.558 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.96:6823", 2019-12-05T03:50:33.558 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 12462 2019-12-05T03:50:33.558 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.558 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.558 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.558 INFO:teuthology.orchestra.run.smithi158.stdout: "public_addr": "172.21.15.96:6819/12462", 2019-12-05T03:50:33.558 INFO:teuthology.orchestra.run.smithi158.stdout: "cluster_addr": "172.21.15.96:6821/12462", 2019-12-05T03:50:33.559 INFO:teuthology.orchestra.run.smithi158.stdout: "heartbeat_back_addr": "172.21.15.96:6825/12462", 2019-12-05T03:50:33.559 INFO:teuthology.orchestra.run.smithi158.stdout: "heartbeat_front_addr": "172.21.15.96:6823/12462", 2019-12-05T03:50:33.559 INFO:teuthology.orchestra.run.smithi158.stdout: "state": [ 2019-12-05T03:50:33.559 INFO:teuthology.orchestra.run.smithi158.stdout: "exists", 2019-12-05T03:50:33.559 INFO:teuthology.orchestra.run.smithi158.stdout: "up" 2019-12-05T03:50:33.559 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:33.559 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.560 INFO:teuthology.orchestra.run.smithi158.stdout: ], 2019-12-05T03:50:33.560 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_xinfo": [ 2019-12-05T03:50:33.560 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.560 INFO:teuthology.orchestra.run.smithi158.stdout: "osd": 0, 2019-12-05T03:50:33.560 INFO:teuthology.orchestra.run.smithi158.stdout: "down_stamp": "0.000000", 2019-12-05T03:50:33.560 INFO:teuthology.orchestra.run.smithi158.stdout: "laggy_probability": 0, 2019-12-05T03:50:33.560 INFO:teuthology.orchestra.run.smithi158.stdout: "laggy_interval": 0, 2019-12-05T03:50:33.560 INFO:teuthology.orchestra.run.smithi158.stdout: "features": 4540138292836696063, 2019-12-05T03:50:33.561 INFO:teuthology.orchestra.run.smithi158.stdout: "old_weight": 0, 2019-12-05T03:50:33.561 INFO:teuthology.orchestra.run.smithi158.stdout: "last_purged_snaps_scrub": "2019-12-05T03:49:46.875762+0000", 2019-12-05T03:50:33.561 INFO:teuthology.orchestra.run.smithi158.stdout: "dead_epoch": 0 2019-12-05T03:50:33.561 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.561 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.561 INFO:teuthology.orchestra.run.smithi158.stdout: "osd": 1, 2019-12-05T03:50:33.561 INFO:teuthology.orchestra.run.smithi158.stdout: "down_stamp": "0.000000", 2019-12-05T03:50:33.562 INFO:teuthology.orchestra.run.smithi158.stdout: "laggy_probability": 0, 2019-12-05T03:50:33.562 INFO:teuthology.orchestra.run.smithi158.stdout: "laggy_interval": 0, 2019-12-05T03:50:33.562 INFO:teuthology.orchestra.run.smithi158.stdout: "features": 4540138292836696063, 2019-12-05T03:50:33.562 INFO:teuthology.orchestra.run.smithi158.stdout: "old_weight": 0, 2019-12-05T03:50:33.562 INFO:teuthology.orchestra.run.smithi158.stdout: "last_purged_snaps_scrub": "2019-12-05T03:49:46.900817+0000", 2019-12-05T03:50:33.563 INFO:teuthology.orchestra.run.smithi158.stdout: "dead_epoch": 0 2019-12-05T03:50:33.563 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.563 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.563 INFO:teuthology.orchestra.run.smithi158.stdout: "osd": 2, 2019-12-05T03:50:33.563 INFO:teuthology.orchestra.run.smithi158.stdout: "down_stamp": "0.000000", 2019-12-05T03:50:33.563 INFO:teuthology.orchestra.run.smithi158.stdout: "laggy_probability": 0, 2019-12-05T03:50:33.563 INFO:teuthology.orchestra.run.smithi158.stdout: "laggy_interval": 0, 2019-12-05T03:50:33.564 INFO:teuthology.orchestra.run.smithi158.stdout: "features": 4540138292836696063, 2019-12-05T03:50:33.564 INFO:teuthology.orchestra.run.smithi158.stdout: "old_weight": 0, 2019-12-05T03:50:33.564 INFO:teuthology.orchestra.run.smithi158.stdout: "last_purged_snaps_scrub": "2019-12-05T03:49:47.210347+0000", 2019-12-05T03:50:33.564 INFO:teuthology.orchestra.run.smithi158.stdout: "dead_epoch": 0 2019-12-05T03:50:33.564 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.564 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.564 INFO:teuthology.orchestra.run.smithi158.stdout: "osd": 3, 2019-12-05T03:50:33.565 INFO:teuthology.orchestra.run.smithi158.stdout: "down_stamp": "0.000000", 2019-12-05T03:50:33.565 INFO:teuthology.orchestra.run.smithi158.stdout: "laggy_probability": 0, 2019-12-05T03:50:33.565 INFO:teuthology.orchestra.run.smithi158.stdout: "laggy_interval": 0, 2019-12-05T03:50:33.565 INFO:teuthology.orchestra.run.smithi158.stdout: "features": 4540138292836696063, 2019-12-05T03:50:33.565 INFO:teuthology.orchestra.run.smithi158.stdout: "old_weight": 0, 2019-12-05T03:50:33.565 INFO:teuthology.orchestra.run.smithi158.stdout: "last_purged_snaps_scrub": "2019-12-05T03:49:47.133973+0000", 2019-12-05T03:50:33.565 INFO:teuthology.orchestra.run.smithi158.stdout: "dead_epoch": 0 2019-12-05T03:50:33.566 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.566 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.566 INFO:teuthology.orchestra.run.smithi158.stdout: "osd": 4, 2019-12-05T03:50:33.566 INFO:teuthology.orchestra.run.smithi158.stdout: "down_stamp": "0.000000", 2019-12-05T03:50:33.566 INFO:teuthology.orchestra.run.smithi158.stdout: "laggy_probability": 0, 2019-12-05T03:50:33.566 INFO:teuthology.orchestra.run.smithi158.stdout: "laggy_interval": 0, 2019-12-05T03:50:33.566 INFO:teuthology.orchestra.run.smithi158.stdout: "features": 4540138292836696063, 2019-12-05T03:50:33.567 INFO:teuthology.orchestra.run.smithi158.stdout: "old_weight": 0, 2019-12-05T03:50:33.567 INFO:teuthology.orchestra.run.smithi158.stdout: "last_purged_snaps_scrub": "2019-12-05T03:49:46.864697+0000", 2019-12-05T03:50:33.567 INFO:teuthology.orchestra.run.smithi158.stdout: "dead_epoch": 0 2019-12-05T03:50:33.567 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.567 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.567 INFO:teuthology.orchestra.run.smithi158.stdout: "osd": 5, 2019-12-05T03:50:33.567 INFO:teuthology.orchestra.run.smithi158.stdout: "down_stamp": "0.000000", 2019-12-05T03:50:33.567 INFO:teuthology.orchestra.run.smithi158.stdout: "laggy_probability": 0, 2019-12-05T03:50:33.568 INFO:teuthology.orchestra.run.smithi158.stdout: "laggy_interval": 0, 2019-12-05T03:50:33.568 INFO:teuthology.orchestra.run.smithi158.stdout: "features": 4540138292836696063, 2019-12-05T03:50:33.568 INFO:teuthology.orchestra.run.smithi158.stdout: "old_weight": 0, 2019-12-05T03:50:33.568 INFO:teuthology.orchestra.run.smithi158.stdout: "last_purged_snaps_scrub": "2019-12-05T03:49:47.131015+0000", 2019-12-05T03:50:33.568 INFO:teuthology.orchestra.run.smithi158.stdout: "dead_epoch": 0 2019-12-05T03:50:33.568 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.568 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.569 INFO:teuthology.orchestra.run.smithi158.stdout: "osd": 6, 2019-12-05T03:50:33.569 INFO:teuthology.orchestra.run.smithi158.stdout: "down_stamp": "0.000000", 2019-12-05T03:50:33.569 INFO:teuthology.orchestra.run.smithi158.stdout: "laggy_probability": 0, 2019-12-05T03:50:33.569 INFO:teuthology.orchestra.run.smithi158.stdout: "laggy_interval": 0, 2019-12-05T03:50:33.569 INFO:teuthology.orchestra.run.smithi158.stdout: "features": 4540138292836696063, 2019-12-05T03:50:33.569 INFO:teuthology.orchestra.run.smithi158.stdout: "old_weight": 0, 2019-12-05T03:50:33.569 INFO:teuthology.orchestra.run.smithi158.stdout: "last_purged_snaps_scrub": "2019-12-05T03:49:47.237225+0000", 2019-12-05T03:50:33.570 INFO:teuthology.orchestra.run.smithi158.stdout: "dead_epoch": 0 2019-12-05T03:50:33.570 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.570 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:33.570 INFO:teuthology.orchestra.run.smithi158.stdout: "osd": 7, 2019-12-05T03:50:33.570 INFO:teuthology.orchestra.run.smithi158.stdout: "down_stamp": "0.000000", 2019-12-05T03:50:33.570 INFO:teuthology.orchestra.run.smithi158.stdout: "laggy_probability": 0, 2019-12-05T03:50:33.570 INFO:teuthology.orchestra.run.smithi158.stdout: "laggy_interval": 0, 2019-12-05T03:50:33.571 INFO:teuthology.orchestra.run.smithi158.stdout: "features": 4540138292836696063, 2019-12-05T03:50:33.571 INFO:teuthology.orchestra.run.smithi158.stdout: "old_weight": 0, 2019-12-05T03:50:33.571 INFO:teuthology.orchestra.run.smithi158.stdout: "last_purged_snaps_scrub": "2019-12-05T03:49:47.154377+0000", 2019-12-05T03:50:33.571 INFO:teuthology.orchestra.run.smithi158.stdout: "dead_epoch": 0 2019-12-05T03:50:33.571 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.571 INFO:teuthology.orchestra.run.smithi158.stdout: ], 2019-12-05T03:50:33.571 INFO:teuthology.orchestra.run.smithi158.stdout: "pg_upmap": [], 2019-12-05T03:50:33.571 INFO:teuthology.orchestra.run.smithi158.stdout: "pg_upmap_items": [], 2019-12-05T03:50:33.572 INFO:teuthology.orchestra.run.smithi158.stdout: "pg_temp": [], 2019-12-05T03:50:33.572 INFO:teuthology.orchestra.run.smithi158.stdout: "primary_temp": [], 2019-12-05T03:50:33.572 INFO:teuthology.orchestra.run.smithi158.stdout: "blacklist": { 2019-12-05T03:50:33.572 INFO:teuthology.orchestra.run.smithi158.stdout: "172.21.15.96:6835/3636871068": "2019-12-06T03:50:32.028609+0000", 2019-12-05T03:50:33.572 INFO:teuthology.orchestra.run.smithi158.stdout: "172.21.15.96:6834/3636871068": "2019-12-06T03:50:32.028609+0000" 2019-12-05T03:50:33.573 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.573 INFO:teuthology.orchestra.run.smithi158.stdout: "erasure_code_profiles": { 2019-12-05T03:50:33.573 INFO:teuthology.orchestra.run.smithi158.stdout: "cephfs_data": { 2019-12-05T03:50:33.573 INFO:teuthology.orchestra.run.smithi158.stdout: "crush-device-class": "", 2019-12-05T03:50:33.573 INFO:teuthology.orchestra.run.smithi158.stdout: "crush-failure-domain": "osd", 2019-12-05T03:50:33.573 INFO:teuthology.orchestra.run.smithi158.stdout: "crush-root": "default", 2019-12-05T03:50:33.573 INFO:teuthology.orchestra.run.smithi158.stdout: "jerasure-per-chunk-alignment": "false", 2019-12-05T03:50:33.574 INFO:teuthology.orchestra.run.smithi158.stdout: "k": "2", 2019-12-05T03:50:33.574 INFO:teuthology.orchestra.run.smithi158.stdout: "m": "2", 2019-12-05T03:50:33.574 INFO:teuthology.orchestra.run.smithi158.stdout: "plugin": "jerasure", 2019-12-05T03:50:33.574 INFO:teuthology.orchestra.run.smithi158.stdout: "ruleset-failure-domain": "osd", 2019-12-05T03:50:33.574 INFO:teuthology.orchestra.run.smithi158.stdout: "technique": "reed_sol_van", 2019-12-05T03:50:33.574 INFO:teuthology.orchestra.run.smithi158.stdout: "w": "8" 2019-12-05T03:50:33.574 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.575 INFO:teuthology.orchestra.run.smithi158.stdout: "default": { 2019-12-05T03:50:33.575 INFO:teuthology.orchestra.run.smithi158.stdout: "crush-failure-domain": "osd", 2019-12-05T03:50:33.575 INFO:teuthology.orchestra.run.smithi158.stdout: "k": "2", 2019-12-05T03:50:33.575 INFO:teuthology.orchestra.run.smithi158.stdout: "m": "1", 2019-12-05T03:50:33.575 INFO:teuthology.orchestra.run.smithi158.stdout: "plugin": "jerasure", 2019-12-05T03:50:33.575 INFO:teuthology.orchestra.run.smithi158.stdout: "ruleset-failure-domain": "osd", 2019-12-05T03:50:33.575 INFO:teuthology.orchestra.run.smithi158.stdout: "technique": "reed_sol_van" 2019-12-05T03:50:33.576 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:33.576 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:33.576 INFO:teuthology.orchestra.run.smithi158.stdout: "removed_snaps_queue": [], 2019-12-05T03:50:33.576 INFO:teuthology.orchestra.run.smithi158.stdout: "new_removed_snaps": [], 2019-12-05T03:50:33.576 INFO:teuthology.orchestra.run.smithi158.stdout: "new_purged_snaps": [], 2019-12-05T03:50:33.576 INFO:teuthology.orchestra.run.smithi158.stdout: "crush_node_flags": {}, 2019-12-05T03:50:33.576 INFO:teuthology.orchestra.run.smithi158.stdout: "device_class_flags": {} 2019-12-05T03:50:33.577 INFO:teuthology.orchestra.run.smithi158.stdout:} 2019-12-05T03:50:33.579 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.408+0000 7f408556f700 1 -- 172.21.15.158:0/3656952121 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f406403b280 msgr2=0x7f406403d790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:33.579 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.408+0000 7f408556f700 1 --2- 172.21.15.158:0/3656952121 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f406403b280 0x7f406403d790 crc :-1 s=READY pgs=128 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:33.579 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.408+0000 7f408556f700 1 -- 172.21.15.158:0/3656952121 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f408013c2c0 msgr2=0x7f408013c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:33.579 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.408+0000 7f408556f700 1 --2- 172.21.15.158:0/3656952121 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f408013c2c0 0x7f408013c6f0 secure :-1 s=READY pgs=274 cs=0 l=1 rx=0x7f40800af7d0 tx=0x7f4078010cf0).stop 2019-12-05T03:50:33.579 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.408+0000 7f408556f700 1 -- 172.21.15.158:0/3656952121 shutdown_connections 2019-12-05T03:50:33.580 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.408+0000 7f408556f700 1 --2- 172.21.15.158:0/3656952121 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f406403b280 0x7f406403d790 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:33.580 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.408+0000 7f408556f700 1 --2- 172.21.15.158:0/3656952121 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f408013c2c0 0x7f408013c6f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:33.580 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.408+0000 7f408556f700 1 --2- 172.21.15.158:0/3656952121 >> v2:172.21.15.96:3300/0 conn(0x7f408007e070 0x7f408005f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:33.580 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.408+0000 7f408556f700 1 -- 172.21.15.158:0/3656952121 shutdown_connections 2019-12-05T03:50:33.580 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.408+0000 7f408556f700 1 -- 172.21.15.158:0/3656952121 wait complete. 2019-12-05T03:50:33.580 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.408+0000 7f408556f700 1 -- 172.21.15.158:0/3656952121 >> 172.21.15.158:0/3656952121 conn(0x7f408009cf60 msgr2=0x7f40801558c0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:33.581 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-12-05T03:50:33.685 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.672+0000 7f474c652700 1 Processor -- start 2019-12-05T03:50:33.685 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.672+0000 7f474c652700 1 -- start start 2019-12-05T03:50:33.685 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.676+0000 7f474c652700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f474409cf50 0x7f474409a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:33.685 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.676+0000 7f474c652700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f474405a730 0x7f4744151450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:33.686 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.676+0000 7f474c652700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47440acca0 con 0x7f47441519a0 2019-12-05T03:50:33.686 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.676+0000 7f474c652700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47440b1720 con 0x7f474409cf50 2019-12-05T03:50:33.686 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.676+0000 7f474c652700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47440b19c0 con 0x7f474405a730 2019-12-05T03:50:33.686 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.676+0000 7f474a3ee700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f474405a730 0x7f4744151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:33.686 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.676+0000 7f474b3f0700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f47441519a0 0x7f47440b52d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49380/0 (socket says 172.21.15.158:49380) 2019-12-05T03:50:33.686 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.676+0000 7f474b3f0700 1 -- 172.21.15.158:0/548615998 learned_addr learned my addr 172.21.15.158:0/548615998 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:33.687 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.676+0000 7f474abef700 1 --2- 172.21.15.158:0/548615998 >> v2:172.21.15.96:3300/0 conn(0x7f474409cf50 0x7f474409a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:33.687 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.676+0000 7f474a3ee700 1 -- 172.21.15.158:0/548615998 >> v2:172.21.15.96:3300/0 conn(0x7f474409cf50 msgr2=0x7f474409a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:33.687 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.676+0000 7f474a3ee700 1 --2- 172.21.15.158:0/548615998 >> v2:172.21.15.96:3300/0 conn(0x7f474409cf50 0x7f474409a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:33.687 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.676+0000 7f474a3ee700 1 -- 172.21.15.158:0/548615998 >> v1:172.21.15.158:6789/0 conn(0x7f47441519a0 legacy=0x7f47440b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:33.687 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.676+0000 7f4749bed700 1 -- 172.21.15.158:0/548615998 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 444879481 0 0) 0x7f47440acca0 con 0x7f47441519a0 2019-12-05T03:50:33.688 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.676+0000 7f474a3ee700 1 -- 172.21.15.158:0/548615998 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f474405ab60 con 0x7f474405a730 2019-12-05T03:50:33.688 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.676+0000 7f474abef700 1 --2- 172.21.15.158:0/548615998 >> v2:172.21.15.96:3300/0 conn(0x7f474409cf50 0x7f474409a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-12-05T03:50:33.688 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.676+0000 7f474a3ee700 1 --2- 172.21.15.158:0/548615998 >> v2:172.21.15.158:3300/0 conn(0x7f474405a730 0x7f4744151450 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4734002f30 tx=0x7f473400fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:33.688 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.676+0000 7f474a3ee700 1 --2- 172.21.15.158:0/548615998 >> v2:172.21.15.158:3300/0 conn(0x7f474405a730 0x7f4744151450 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4734002f30 tx=0x7f473400fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:33.689 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.676+0000 7f474a3ee700 1 --2- 172.21.15.158:0/548615998 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f474405a730 0x7f4744151450 secure :-1 s=READY pgs=276 cs=0 l=1 rx=0x7f4734002f30 tx=0x7f473400fc70).ready entity=mon.1 client_cookie=4b2fa8101ec81858 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:33.689 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.676+0000 7f474a3ee700 1 --2- 172.21.15.158:0/548615998 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f474405a730 0x7f4744151450 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7f4734002f30 tx=0x7f473400fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:33.689 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.676+0000 7f4749bed700 1 -- 172.21.15.158:0/548615998 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47340112b0 con 0x7f474405a730 2019-12-05T03:50:33.689 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.676+0000 7f474a3ee700 1 --2- 172.21.15.158:0/548615998 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f474405a730 0x7f4744151450 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7f4734002f30 tx=0x7f473400fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:33.689 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.676+0000 7f474a3ee700 1 --2- 172.21.15.158:0/548615998 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f474405a730 0x7f4744151450 secure :-1 s=THROTTLE_DONE pgs=276 cs=0 l=1 rx=0x7f4734002f30 tx=0x7f473400fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:33.689 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.676+0000 7f4749bed700 1 -- 172.21.15.158:0/548615998 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4734008ad0 con 0x7f474405a730 2019-12-05T03:50:33.690 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.676+0000 7f4749bed700 1 -- 172.21.15.158:0/548615998 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4734011890 con 0x7f474405a730 2019-12-05T03:50:33.690 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.676+0000 7f474c652700 1 -- 172.21.15.158:0/548615998 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f474405a730 msgr2=0x7f4744151450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:33.690 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.676+0000 7f474c652700 1 --2- 172.21.15.158:0/548615998 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f474405a730 0x7f4744151450 secure :-1 s=READY pgs=276 cs=0 l=1 rx=0x7f4734002f30 tx=0x7f473400fc70).stop 2019-12-05T03:50:33.690 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.676+0000 7f474c652700 1 -- 172.21.15.158:0/548615998 shutdown_connections 2019-12-05T03:50:33.690 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.676+0000 7f474c652700 1 --2- 172.21.15.158:0/548615998 >> v2:172.21.15.96:3300/0 conn(0x7f474409cf50 0x7f474409a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:33.690 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.676+0000 7f474c652700 1 --2- 172.21.15.158:0/548615998 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f474405a730 0x7f4744151450 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:33.691 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.676+0000 7f474c652700 1 -- 172.21.15.158:0/548615998 shutdown_connections 2019-12-05T03:50:33.691 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.676+0000 7f474c652700 1 -- 172.21.15.158:0/548615998 wait complete. 2019-12-05T03:50:33.691 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.676+0000 7f474c652700 1 -- 172.21.15.158:0/548615998 >> 172.21.15.158:0/548615998 conn(0x7f47440b7e50 msgr2=0x7f47440b3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:33.696 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.680+0000 7f474c652700 1 Processor -- start 2019-12-05T03:50:33.697 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.680+0000 7f474c652700 1 -- start start 2019-12-05T03:50:33.697 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.680+0000 7f474c652700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f47441401a0 0x7f474409ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:33.697 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.680+0000 7f474c652700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f474407b780 con 0x7f474413bf60 2019-12-05T03:50:33.697 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.680+0000 7f474c652700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f474412d090 con 0x7f4744154d20 2019-12-05T03:50:33.697 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.680+0000 7f474c652700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f474413f9c0 con 0x7f47441401a0 2019-12-05T03:50:33.697 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.680+0000 7f474a3ee700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f4744154d20 0x7f474407af80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49386/0 (socket says 172.21.15.158:49386) 2019-12-05T03:50:33.698 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.680+0000 7f474a3ee700 1 -- 172.21.15.158:0/2474144031 learned_addr learned my addr 172.21.15.158:0/2474144031 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:33.698 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.680+0000 7f474abef700 1 --2- 172.21.15.158:0/2474144031 >> v2:172.21.15.96:3300/0 conn(0x7f47441401a0 0x7f474409ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:33.698 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.680+0000 7f473b7fe700 1 -- 172.21.15.158:0/2474144031 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2937549588 0 0) 0x7f474412d090 con 0x7f4744154d20 2019-12-05T03:50:33.698 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.680+0000 7f473b7fe700 1 -- 172.21.15.158:0/2474144031 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f472c0030b0 con 0x7f4744154d20 2019-12-05T03:50:33.698 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.680+0000 7f473b7fe700 1 -- 172.21.15.158:0/2474144031 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1251494184 0 0) 0x7f472c0030b0 con 0x7f4744154d20 2019-12-05T03:50:33.698 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.680+0000 7f473b7fe700 1 -- 172.21.15.158:0/2474144031 --> v1:172.21.15.158:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f474412d090 con 0x7f4744154d20 2019-12-05T03:50:33.699 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.680+0000 7f473b7fe700 1 -- 172.21.15.158:0/2474144031 <== mon.1 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 828730332 0 0) 0x7f47340112b0 con 0x7f4744154d20 2019-12-05T03:50:33.699 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.680+0000 7f473b7fe700 1 -- 172.21.15.158:0/2474144031 >> v2:172.21.15.96:3300/0 conn(0x7f47441401a0 msgr2=0x7f474409ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:33.699 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.680+0000 7f473b7fe700 1 --2- 172.21.15.158:0/2474144031 >> v2:172.21.15.96:3300/0 conn(0x7f47441401a0 0x7f474409ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:33.699 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.680+0000 7f473b7fe700 1 -- 172.21.15.158:0/2474144031 >> v1:172.21.15.158:6789/0 conn(0x7f4744154d20 legacy=0x7f474407af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:33.699 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.680+0000 7f473b7fe700 1 -- 172.21.15.158:0/2474144031 >> v1:172.21.15.96:6789/0 conn(0x7f474413bf60 legacy=0x7f474413c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:33.699 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.680+0000 7f473b7fe700 1 --2- 172.21.15.158:0/2474144031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f472c0038a0 0x7f472c003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:33.700 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.680+0000 7f473b7fe700 1 --2- 172.21.15.158:0/2474144031 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f472c004420 0x7f472c004850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:33.700 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.680+0000 7f473b7fe700 1 --2- 172.21.15.158:0/2474144031 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f472c004e70 0x7f472c00b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:33.700 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.680+0000 7f473b7fe700 1 -- 172.21.15.158:0/2474144031 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f474413f9c0 con 0x7f472c0038a0 2019-12-05T03:50:33.700 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.680+0000 7f473b7fe700 1 -- 172.21.15.158:0/2474144031 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472c00bc70 con 0x7f472c004420 2019-12-05T03:50:33.701 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.680+0000 7f473b7fe700 1 -- 172.21.15.158:0/2474144031 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472c00beb0 con 0x7f472c004e70 2019-12-05T03:50:33.701 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.680+0000 7f474a3ee700 1 --2- 172.21.15.158:0/2474144031 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f472c004420 0x7f472c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:33.701 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.680+0000 7f474abef700 1 --2- 172.21.15.158:0/2474144031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f472c0038a0 0x7f472c003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:33.701 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.680+0000 7f474b3f0700 1 --2- 172.21.15.158:0/2474144031 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f472c004e70 0x7f472c00b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:33.702 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.680+0000 7f474a3ee700 1 -- 172.21.15.158:0/2474144031 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f472c004e70 msgr2=0x7f472c00b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:33.702 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.680+0000 7f474a3ee700 1 --2- 172.21.15.158:0/2474144031 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f472c004e70 0x7f472c00b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:33.702 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.680+0000 7f474a3ee700 1 -- 172.21.15.158:0/2474144031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f472c0038a0 msgr2=0x7f472c003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:33.702 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.680+0000 7f474a3ee700 1 --2- 172.21.15.158:0/2474144031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f472c0038a0 0x7f472c003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:33.702 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.680+0000 7f474a3ee700 1 -- 172.21.15.158:0/2474144031 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f474413f520 con 0x7f472c004420 2019-12-05T03:50:33.702 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.680+0000 7f474b3f0700 1 --2- 172.21.15.158:0/2474144031 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f472c004e70 0x7f472c00b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-12-05T03:50:33.702 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.680+0000 7f474c652700 1 -- 172.21.15.158:0/2474144031 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f474413cb90 con 0x7f472c004420 2019-12-05T03:50:33.703 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.680+0000 7f474a3ee700 1 --2- 172.21.15.158:0/2474144031 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f472c004420 0x7f472c004850 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f47340081d0 tx=0x7f473400a1e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:33.703 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.680+0000 7f474b3f0700 1 -- 172.21.15.158:0/2474144031 reap_dead start 2019-12-05T03:50:33.703 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.684+0000 7f474c652700 1 -- 172.21.15.158:0/2474144031 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f474413cef0 con 0x7f472c004420 2019-12-05T03:50:33.703 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.684+0000 7f474a3ee700 1 --2- 172.21.15.158:0/2474144031 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f472c004420 0x7f472c004850 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f47340081d0 tx=0x7f473400a1e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:33.703 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.684+0000 7f474a3ee700 1 --2- 172.21.15.158:0/2474144031 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f472c004420 0x7f472c004850 secure :-1 s=READY pgs=278 cs=0 l=1 rx=0x7f47340081d0 tx=0x7f473400a1e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:33.703 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.684+0000 7f474a3ee700 1 --2- 172.21.15.158:0/2474144031 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f472c004420 0x7f472c004850 secure :-1 s=THROTTLE_DONE pgs=278 cs=0 l=1 rx=0x7f47340081d0 tx=0x7f473400a1e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:33.704 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.684+0000 7f474a3ee700 1 --2- 172.21.15.158:0/2474144031 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f472c004420 0x7f472c004850 secure :-1 s=THROTTLE_DONE pgs=278 cs=0 l=1 rx=0x7f47340081d0 tx=0x7f473400a1e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:33.704 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.684+0000 7f473b7fe700 1 -- 172.21.15.158:0/2474144031 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f473400a630 con 0x7f472c004420 2019-12-05T03:50:33.704 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.684+0000 7f474a3ee700 1 --2- 172.21.15.158:0/2474144031 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f472c004420 0x7f472c004850 secure :-1 s=THROTTLE_DONE pgs=278 cs=0 l=1 rx=0x7f47340081d0 tx=0x7f473400a1e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:33.704 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.684+0000 7f473b7fe700 1 -- 172.21.15.158:0/2474144031 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4734007150 con 0x7f472c004420 2019-12-05T03:50:33.704 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.684+0000 7f473b7fe700 1 -- 172.21.15.158:0/2474144031 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f473400ac50 con 0x7f472c004420 2019-12-05T03:50:33.704 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.684+0000 7f474a3ee700 1 --2- 172.21.15.158:0/2474144031 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f472c004420 0x7f472c004850 secure :-1 s=THROTTLE_DONE pgs=278 cs=0 l=1 rx=0x7f47340081d0 tx=0x7f473400a1e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:33.705 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.684+0000 7f473b7fe700 1 -- 172.21.15.158:0/2474144031 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f4734005540 con 0x7f472c004420 2019-12-05T03:50:33.705 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.684+0000 7f474a3ee700 1 --2- 172.21.15.158:0/2474144031 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f472c004420 0x7f472c004850 secure :-1 s=THROTTLE_DONE pgs=278 cs=0 l=1 rx=0x7f47340081d0 tx=0x7f473400a1e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:33.705 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.684+0000 7f473b7fe700 1 --2- 172.21.15.158:0/2474144031 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f472c03e940 0x7f472c040e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:33.705 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.684+0000 7f473b7fe700 1 -- 172.21.15.158:0/2474144031 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6117+0+0 (secure 0 0 0) 0x7f473404c4b0 con 0x7f472c004420 2019-12-05T03:50:33.705 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.684+0000 7f474abef700 1 --2- 172.21.15.158:0/2474144031 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f472c03e940 0x7f472c040e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:33.705 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.684+0000 7f474abef700 1 --2- 172.21.15.158:0/2474144031 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f472c03e940 0x7f472c040e50 crc :-1 s=READY pgs=129 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:33.706 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.688+0000 7f474c652700 1 -- 172.21.15.158:0/2474144031 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4720003200 con 0x7f472c004420 2019-12-05T03:50:33.706 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.692+0000 7f474a3ee700 1 --2- 172.21.15.158:0/2474144031 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f472c004420 0x7f472c004850 secure :-1 s=THROTTLE_DONE pgs=278 cs=0 l=1 rx=0x7f47340081d0 tx=0x7f473400a1e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:33.706 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.692+0000 7f473b7fe700 1 -- 172.21.15.158:0/2474144031 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f4734033550 con 0x7f472c004420 2019-12-05T03:50:33.867 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.860+0000 7f474c652700 1 -- 172.21.15.158:0/2474144031 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4720003630 con 0x7f472c004420 2019-12-05T03:50:33.868 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.860+0000 7f474a3ee700 1 --2- 172.21.15.158:0/2474144031 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f472c004420 0x7f472c004850 secure :-1 s=THROTTLE_DONE pgs=278 cs=0 l=1 rx=0x7f47340081d0 tx=0x7f473400a1e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:33.868 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.860+0000 7f473b7fe700 1 -- 172.21.15.158:0/2474144031 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+1423 (secure 0 0 0) 0x7f47340337b0 con 0x7f472c004420 2019-12-05T03:50:33.868 INFO:teuthology.orchestra.run.smithi158.stderr:dumped fsmap epoch 7 2019-12-05T03:50:33.869 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:33.869 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-12-05T03:50:01.249656+0000","modified":"2019-12-05T03:50:32.982155+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2019-12-05T03:50:33.871 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.864+0000 7f474c652700 1 -- 172.21.15.158:0/2474144031 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f472c03e940 msgr2=0x7f472c040e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:33.871 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.864+0000 7f474c652700 1 --2- 172.21.15.158:0/2474144031 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f472c03e940 0x7f472c040e50 crc :-1 s=READY pgs=129 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:33.871 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.864+0000 7f474c652700 1 -- 172.21.15.158:0/2474144031 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f472c004420 msgr2=0x7f472c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:33.871 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.864+0000 7f474c652700 1 --2- 172.21.15.158:0/2474144031 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f472c004420 0x7f472c004850 secure :-1 s=READY pgs=278 cs=0 l=1 rx=0x7f47340081d0 tx=0x7f473400a1e0).stop 2019-12-05T03:50:33.872 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.864+0000 7f474c652700 1 -- 172.21.15.158:0/2474144031 shutdown_connections 2019-12-05T03:50:33.872 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.864+0000 7f474c652700 1 --2- 172.21.15.158:0/2474144031 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f472c03e940 0x7f472c040e50 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:33.872 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.864+0000 7f474c652700 1 --2- 172.21.15.158:0/2474144031 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f472c004420 0x7f472c004850 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:33.872 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.864+0000 7f474c652700 1 -- 172.21.15.158:0/2474144031 shutdown_connections 2019-12-05T03:50:33.872 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.864+0000 7f474c652700 1 -- 172.21.15.158:0/2474144031 wait complete. 2019-12-05T03:50:33.872 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.864+0000 7f474c652700 1 -- 172.21.15.158:0/2474144031 >> 172.21.15.158:0/2474144031 conn(0x7f47440b49b0 msgr2=0x7f4744155b40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:33.886 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2019-12-05T03:50:33.986 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.972+0000 7f48a0c9c700 1 Processor -- start 2019-12-05T03:50:33.986 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.972+0000 7f48a0c9c700 1 -- start start 2019-12-05T03:50:33.986 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.976+0000 7f48a0c9c700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f489c09cf60 0x7f489c09a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:33.986 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.976+0000 7f48a0c9c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f489c05a740 0x7f489c151460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:33.986 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.976+0000 7f48a0c9c700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f489c0accb0 con 0x7f489c1519b0 2019-12-05T03:50:33.987 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.976+0000 7f48a0c9c700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f489c0b1730 con 0x7f489c05a740 2019-12-05T03:50:33.987 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.976+0000 7f48a0c9c700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f489c0b19d0 con 0x7f489c09cf60 2019-12-05T03:50:33.987 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.976+0000 7f489259c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f489c05a740 0x7f489c151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:33.987 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.976+0000 7f489259c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f489c05a740 0x7f489c151460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54618/0 (socket says 172.21.15.158:54618) 2019-12-05T03:50:33.987 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.976+0000 7f489259c700 1 -- 172.21.15.158:0/3600789287 learned_addr learned my addr 172.21.15.158:0/3600789287 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:33.988 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.976+0000 7f489ad9d700 1 --2- 172.21.15.158:0/3600789287 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f489c09cf60 0x7f489c09a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:33.988 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.976+0000 7f489259c700 1 -- 172.21.15.158:0/3600789287 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f489c09cf60 msgr2=0x7f489c09a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:33.988 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.976+0000 7f489259c700 1 --2- 172.21.15.158:0/3600789287 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f489c09cf60 0x7f489c09a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:33.988 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.976+0000 7f489259c700 1 -- 172.21.15.158:0/3600789287 >> v1:172.21.15.96:6789/0 conn(0x7f489c1519b0 legacy=0x7f489c0b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:33.988 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.976+0000 7f489259c700 1 -- 172.21.15.158:0/3600789287 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f489c05ab70 con 0x7f489c05a740 2019-12-05T03:50:33.989 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.976+0000 7f489259c700 1 --2- 172.21.15.158:0/3600789287 >> v2:172.21.15.158:3300/0 conn(0x7f489c05a740 0x7f489c151460 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f489c0b18f0 tx=0x7f488400fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:33.989 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.976+0000 7f489259c700 1 --2- 172.21.15.158:0/3600789287 >> v2:172.21.15.158:3300/0 conn(0x7f489c05a740 0x7f489c151460 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f489c0b18f0 tx=0x7f488400fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:33.989 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.976+0000 7f489259c700 1 --2- 172.21.15.158:0/3600789287 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f489c05a740 0x7f489c151460 secure :-1 s=READY pgs=279 cs=0 l=1 rx=0x7f489c0b18f0 tx=0x7f488400fd30).ready entity=mon.1 client_cookie=4838d6edf66b3b7a server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:33.989 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.976+0000 7f489259c700 1 --2- 172.21.15.158:0/3600789287 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f489c05a740 0x7f489c151460 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7f489c0b18f0 tx=0x7f488400fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:33.989 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.976+0000 7f489259c700 1 --2- 172.21.15.158:0/3600789287 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f489c05a740 0x7f489c151460 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7f489c0b18f0 tx=0x7f488400fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:33.989 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.976+0000 7f489a59c700 1 -- 172.21.15.158:0/3600789287 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48840113b0 con 0x7f489c05a740 2019-12-05T03:50:33.989 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.976+0000 7f489259c700 1 --2- 172.21.15.158:0/3600789287 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f489c05a740 0x7f489c151460 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7f489c0b18f0 tx=0x7f488400fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:33.990 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.976+0000 7f489a59c700 1 -- 172.21.15.158:0/3600789287 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4884008bb0 con 0x7f489c05a740 2019-12-05T03:50:33.990 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.976+0000 7f489a59c700 1 -- 172.21.15.158:0/3600789287 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4884011990 con 0x7f489c05a740 2019-12-05T03:50:33.990 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.976+0000 7f48a0c9c700 1 -- 172.21.15.158:0/3600789287 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f489c05a740 msgr2=0x7f489c151460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:33.990 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.976+0000 7f48a0c9c700 1 --2- 172.21.15.158:0/3600789287 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f489c05a740 0x7f489c151460 secure :-1 s=READY pgs=279 cs=0 l=1 rx=0x7f489c0b18f0 tx=0x7f488400fd30).stop 2019-12-05T03:50:33.990 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.976+0000 7f48a0c9c700 1 -- 172.21.15.158:0/3600789287 shutdown_connections 2019-12-05T03:50:33.990 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.976+0000 7f48a0c9c700 1 --2- 172.21.15.158:0/3600789287 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f489c09cf60 0x7f489c09a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:33.990 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.976+0000 7f48a0c9c700 1 --2- 172.21.15.158:0/3600789287 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f489c05a740 0x7f489c151460 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:33.991 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.976+0000 7f48a0c9c700 1 -- 172.21.15.158:0/3600789287 shutdown_connections 2019-12-05T03:50:33.991 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.976+0000 7f48a0c9c700 1 -- 172.21.15.158:0/3600789287 wait complete. 2019-12-05T03:50:33.991 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.976+0000 7f48a0c9c700 1 -- 172.21.15.158:0/3600789287 >> 172.21.15.158:0/3600789287 conn(0x7f489c0b7e60 msgr2=0x7f489c0b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:33.992 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.980+0000 7f48a0c9c700 1 Processor -- start 2019-12-05T03:50:33.992 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.980+0000 7f48a0c9c700 1 -- start start 2019-12-05T03:50:33.992 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.980+0000 7f48a0c9c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f489c06e6d0 0x7f489c153440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:33.992 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.980+0000 7f48a0c9c700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f489c09beb0 0x7f489c07ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:33.996 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.980+0000 7f48a0c9c700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f489c09bb70 con 0x7f489c0b1da0 2019-12-05T03:50:33.996 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.980+0000 7f48a0c9c700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f489c09ae40 con 0x7f489c06e6d0 2019-12-05T03:50:33.996 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.980+0000 7f48a0c9c700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f489c09b0e0 con 0x7f489c09beb0 2019-12-05T03:50:33.997 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.980+0000 7f489ad9d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f489c06e6d0 0x7f489c153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:33.997 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.980+0000 7f489ad9d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f489c06e6d0 0x7f489c153440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54622/0 (socket says 172.21.15.158:54622) 2019-12-05T03:50:33.997 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.980+0000 7f489ad9d700 1 -- 172.21.15.158:0/1603817728 learned_addr learned my addr 172.21.15.158:0/1603817728 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:33.997 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.980+0000 7f489b59e700 1 --1- 172.21.15.158:0/1603817728 >> v1:172.21.15.158:6789/0 conn(0x7f489c0b1da0 0x7f489c07c480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49404/0 (socket says 172.21.15.158:49404) 2019-12-05T03:50:33.997 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.980+0000 7f489259c700 1 --2- 172.21.15.158:0/1603817728 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f489c09beb0 0x7f489c07ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:33.998 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.984+0000 7f489ad9d700 1 -- 172.21.15.158:0/1603817728 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f489c09beb0 msgr2=0x7f489c07ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:33.998 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.984+0000 7f489ad9d700 1 --2- 172.21.15.158:0/1603817728 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f489c09beb0 0x7f489c07ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:33.998 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.984+0000 7f489ad9d700 1 -- 172.21.15.158:0/1603817728 >> v1:172.21.15.158:6789/0 conn(0x7f489c0b1da0 legacy=0x7f489c07c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:33.998 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.984+0000 7f489ad9d700 1 -- 172.21.15.158:0/1603817728 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f489c0b21d0 con 0x7f489c06e6d0 2019-12-05T03:50:33.998 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.984+0000 7f489ad9d700 1 --2- 172.21.15.158:0/1603817728 >> v2:172.21.15.158:3300/0 conn(0x7f489c06e6d0 0x7f489c153440 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f489c09b000 tx=0x7f488c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:33.999 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.984+0000 7f489ad9d700 1 --2- 172.21.15.158:0/1603817728 >> v2:172.21.15.158:3300/0 conn(0x7f489c06e6d0 0x7f489c153440 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f489c09b000 tx=0x7f488c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:33.999 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.984+0000 7f489ad9d700 1 --2- 172.21.15.158:0/1603817728 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f489c06e6d0 0x7f489c153440 secure :-1 s=READY pgs=281 cs=0 l=1 rx=0x7f489c09b000 tx=0x7f488c010ac0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:33.999 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.984+0000 7f489ad9d700 1 --2- 172.21.15.158:0/1603817728 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f489c06e6d0 0x7f489c153440 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7f489c09b000 tx=0x7f488c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:33.999 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.984+0000 7f4893fff700 1 -- 172.21.15.158:0/1603817728 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f488c005930 con 0x7f489c06e6d0 2019-12-05T03:50:33.999 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.984+0000 7f489ad9d700 1 --2- 172.21.15.158:0/1603817728 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f489c06e6d0 0x7f489c153440 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7f489c09b000 tx=0x7f488c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:33.999 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.984+0000 7f4893fff700 1 -- 172.21.15.158:0/1603817728 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488c007160 con 0x7f489c06e6d0 2019-12-05T03:50:34.000 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.984+0000 7f489ad9d700 1 --2- 172.21.15.158:0/1603817728 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f489c06e6d0 0x7f489c153440 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7f489c09b000 tx=0x7f488c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:34.000 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.984+0000 7f48a0c9c700 1 -- 172.21.15.158:0/1603817728 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f489c0b24a0 con 0x7f489c06e6d0 2019-12-05T03:50:34.000 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.984+0000 7f4893fff700 1 -- 172.21.15.158:0/1603817728 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f488c012100 con 0x7f489c06e6d0 2019-12-05T03:50:34.000 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.984+0000 7f48a0c9c700 1 -- 172.21.15.158:0/1603817728 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f489c07ce20 con 0x7f489c06e6d0 2019-12-05T03:50:34.000 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.984+0000 7f489ad9d700 1 --2- 172.21.15.158:0/1603817728 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f489c06e6d0 0x7f489c153440 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7f489c09b000 tx=0x7f488c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:34.000 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.988+0000 7f4893fff700 1 -- 172.21.15.158:0/1603817728 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f488c007ae0 con 0x7f489c06e6d0 2019-12-05T03:50:34.001 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.988+0000 7f489ad9d700 1 --2- 172.21.15.158:0/1603817728 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f489c06e6d0 0x7f489c153440 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7f489c09b000 tx=0x7f488c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:34.001 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.988+0000 7f4893fff700 1 --2- 172.21.15.158:0/1603817728 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f488003ac70 0x7f488003d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:34.001 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.988+0000 7f4893fff700 1 -- 172.21.15.158:0/1603817728 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6117+0+0 (secure 0 0 0) 0x7f488c04add0 con 0x7f489c06e6d0 2019-12-05T03:50:34.001 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.988+0000 7f489259c700 1 --2- 172.21.15.158:0/1603817728 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f488003ac70 0x7f488003d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:34.001 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.988+0000 7f489259c700 1 --2- 172.21.15.158:0/1603817728 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f488003ac70 0x7f488003d180 crc :-1 s=READY pgs=130 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:34.002 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.988+0000 7f48a0c9c700 1 -- 172.21.15.158:0/1603817728 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f489c0554e0 con 0x7f489c06e6d0 2019-12-05T03:50:34.002 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.996+0000 7f489ad9d700 1 --2- 172.21.15.158:0/1603817728 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f489c06e6d0 0x7f489c153440 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7f489c09b000 tx=0x7f488c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:34.003 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:33.996+0000 7f4893fff700 1 -- 172.21.15.158:0/1603817728 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f488c031e50 con 0x7f489c06e6d0 2019-12-05T03:50:34.151 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:34.144+0000 7f48a0c9c700 1 -- 172.21.15.158:0/1603817728 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f489c125030 con 0x7f489c06e6d0 2019-12-05T03:50:35.007 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.000+0000 7f489ad9d700 1 --2- 172.21.15.158:0/1603817728 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f489c06e6d0 0x7f489c153440 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7f489c09b000 tx=0x7f488c010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:35.008 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.000+0000 7f4893fff700 1 -- 172.21.15.158:0/1603817728 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f488c0320b0 con 0x7f489c06e6d0 2019-12-05T03:50:35.017 INFO:teuthology.orchestra.run.smithi158.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2019-12-05T03:50:35.021 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.012+0000 7f48a0c9c700 1 -- 172.21.15.158:0/1603817728 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f488003ac70 msgr2=0x7f488003d180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:35.022 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.012+0000 7f48a0c9c700 1 --2- 172.21.15.158:0/1603817728 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f488003ac70 0x7f488003d180 crc :-1 s=READY pgs=130 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:35.022 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.012+0000 7f48a0c9c700 1 -- 172.21.15.158:0/1603817728 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f489c06e6d0 msgr2=0x7f489c153440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:35.022 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.012+0000 7f48a0c9c700 1 --2- 172.21.15.158:0/1603817728 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f489c06e6d0 0x7f489c153440 secure :-1 s=READY pgs=281 cs=0 l=1 rx=0x7f489c09b000 tx=0x7f488c010ac0).stop 2019-12-05T03:50:35.022 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.012+0000 7f48a0c9c700 1 -- 172.21.15.158:0/1603817728 shutdown_connections 2019-12-05T03:50:35.022 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.012+0000 7f48a0c9c700 1 --2- 172.21.15.158:0/1603817728 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f488003ac70 0x7f488003d180 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:35.022 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.012+0000 7f48a0c9c700 1 --2- 172.21.15.158:0/1603817728 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f489c06e6d0 0x7f489c153440 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:35.023 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.016+0000 7f48a0c9c700 1 --2- 172.21.15.158:0/1603817728 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f489c09beb0 0x7f489c07ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:35.023 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.016+0000 7f48a0c9c700 1 -- 172.21.15.158:0/1603817728 shutdown_connections 2019-12-05T03:50:35.023 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.016+0000 7f48a0c9c700 1 -- 172.21.15.158:0/1603817728 wait complete. 2019-12-05T03:50:35.023 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.016+0000 7f48a0c9c700 1 -- 172.21.15.158:0/1603817728 >> 172.21.15.158:0/1603817728 conn(0x7f489c155390 msgr2=0x7f489c07da20 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:35.035 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-12-05T03:50:35.136 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.120+0000 7f6d39241700 1 Processor -- start 2019-12-05T03:50:35.136 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.124+0000 7f6d39241700 1 -- start start 2019-12-05T03:50:35.136 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.124+0000 7f6d39241700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d3409a320 0x7f6d3405a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:35.136 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.124+0000 7f6d39241700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f6d341553b0 0x7f6d341557e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:35.137 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.124+0000 7f6d39241700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d340accb0 con 0x7f6d3409cf60 2019-12-05T03:50:35.137 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.124+0000 7f6d39241700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d3409a750 con 0x7f6d341553b0 2019-12-05T03:50:35.137 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.124+0000 7f6d39241700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d340b1730 con 0x7f6d3409a320 2019-12-05T03:50:35.137 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.124+0000 7f6d38a40700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f6d341553b0 0x7f6d341557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:35.137 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.124+0000 7f6d32d9d700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d3409a320 0x7f6d3405a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:35.137 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.124+0000 7f6d3359e700 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f6d3409cf60 0x7f6d34151460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.158:44544/0 (socket says 172.21.15.158:44544) 2019-12-05T03:50:35.138 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.124+0000 7f6d3359e700 1 -- 172.21.15.158:0/2648214132 learned_addr learned my addr 172.21.15.158:0/2648214132 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:35.138 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.124+0000 7f6d3259c700 1 -- 172.21.15.158:0/2648214132 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2798344061 0 0) 0x7f6d340accb0 con 0x7f6d3409cf60 2019-12-05T03:50:35.138 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.124+0000 7f6d3259c700 1 -- 172.21.15.158:0/2648214132 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d200030b0 con 0x7f6d3409cf60 2019-12-05T03:50:35.138 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.124+0000 7f6d38a40700 1 -- 172.21.15.158:0/2648214132 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d3409a320 msgr2=0x7f6d3405a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:35.138 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.124+0000 7f6d38a40700 1 --2- 172.21.15.158:0/2648214132 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d3409a320 0x7f6d3405a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:35.138 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.124+0000 7f6d38a40700 1 -- 172.21.15.158:0/2648214132 >> v1:172.21.15.96:6789/0 conn(0x7f6d3409cf60 legacy=0x7f6d34151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:35.139 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.124+0000 7f6d38a40700 1 -- 172.21.15.158:0/2648214132 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d340b6980 con 0x7f6d341553b0 2019-12-05T03:50:35.139 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.124+0000 7f6d32d9d700 1 --2- 172.21.15.158:0/2648214132 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d3409a320 0x7f6d3405a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:50:35.139 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.124+0000 7f6d38a40700 1 --2- 172.21.15.158:0/2648214132 >> v2:172.21.15.158:3300/0 conn(0x7f6d341553b0 0x7f6d341557e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6d2c008b10 tx=0x7f6d2c00fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:35.139 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.124+0000 7f6d38a40700 1 --2- 172.21.15.158:0/2648214132 >> v2:172.21.15.158:3300/0 conn(0x7f6d341553b0 0x7f6d341557e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6d2c008b10 tx=0x7f6d2c00fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:35.139 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.124+0000 7f6d38a40700 1 --2- 172.21.15.158:0/2648214132 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d341553b0 0x7f6d341557e0 secure :-1 s=READY pgs=282 cs=0 l=1 rx=0x7f6d2c008b10 tx=0x7f6d2c00fff0).ready entity=mon.1 client_cookie=5a0da96405a285e0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:35.139 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.124+0000 7f6d38a40700 1 --2- 172.21.15.158:0/2648214132 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d341553b0 0x7f6d341557e0 secure :-1 s=THROTTLE_DONE pgs=282 cs=0 l=1 rx=0x7f6d2c008b10 tx=0x7f6d2c00fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:35.140 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.124+0000 7f6d3259c700 1 -- 172.21.15.158:0/2648214132 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d2c011a50 con 0x7f6d341553b0 2019-12-05T03:50:35.140 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.124+0000 7f6d38a40700 1 --2- 172.21.15.158:0/2648214132 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d341553b0 0x7f6d341557e0 secure :-1 s=THROTTLE_DONE pgs=282 cs=0 l=1 rx=0x7f6d2c008b10 tx=0x7f6d2c00fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:35.140 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.124+0000 7f6d38a40700 1 --2- 172.21.15.158:0/2648214132 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d341553b0 0x7f6d341557e0 secure :-1 s=THROTTLE_DONE pgs=282 cs=0 l=1 rx=0x7f6d2c008b10 tx=0x7f6d2c00fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:35.140 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.128+0000 7f6d3259c700 1 -- 172.21.15.158:0/2648214132 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2c011670 con 0x7f6d341553b0 2019-12-05T03:50:35.140 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.128+0000 7f6d3259c700 1 -- 172.21.15.158:0/2648214132 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d2c00a350 con 0x7f6d341553b0 2019-12-05T03:50:35.140 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.128+0000 7f6d39241700 1 -- 172.21.15.158:0/2648214132 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d341553b0 msgr2=0x7f6d341557e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:35.141 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.128+0000 7f6d39241700 1 --2- 172.21.15.158:0/2648214132 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d341553b0 0x7f6d341557e0 secure :-1 s=READY pgs=282 cs=0 l=1 rx=0x7f6d2c008b10 tx=0x7f6d2c00fff0).stop 2019-12-05T03:50:35.141 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.128+0000 7f6d39241700 1 -- 172.21.15.158:0/2648214132 shutdown_connections 2019-12-05T03:50:35.141 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.128+0000 7f6d39241700 1 --2- 172.21.15.158:0/2648214132 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d341553b0 0x7f6d341557e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:35.141 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.128+0000 7f6d39241700 1 --2- 172.21.15.158:0/2648214132 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6d3409a320 0x7f6d3405a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:35.141 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.128+0000 7f6d39241700 1 -- 172.21.15.158:0/2648214132 shutdown_connections 2019-12-05T03:50:35.141 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.128+0000 7f6d39241700 1 -- 172.21.15.158:0/2648214132 wait complete. 2019-12-05T03:50:35.141 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.128+0000 7f6d39241700 1 -- 172.21.15.158:0/2648214132 >> 172.21.15.158:0/2648214132 conn(0x7f6d340b7e60 msgr2=0x7f6d340b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:35.148 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.132+0000 7f6d39241700 1 Processor -- start 2019-12-05T03:50:35.148 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.132+0000 7f6d39241700 1 -- start start 2019-12-05T03:50:35.149 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.132+0000 7f6d39241700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f6d340b0e70 0x7f6d34150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:35.149 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.132+0000 7f6d39241700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6d34064450 0x7f6d3413bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:35.149 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.132+0000 7f6d39241700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d34064880 con 0x7f6d3412fc20 2019-12-05T03:50:35.149 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.132+0000 7f6d39241700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d34064ef0 con 0x7f6d34064450 2019-12-05T03:50:35.149 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.132+0000 7f6d39241700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d34065170 con 0x7f6d340b0e70 2019-12-05T03:50:35.149 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.132+0000 7f6d3359e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f6d340b0e70 0x7f6d34150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:35.149 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.132+0000 7f6d3359e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f6d340b0e70 0x7f6d34150b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54636/0 (socket says 172.21.15.158:54636) 2019-12-05T03:50:35.150 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.132+0000 7f6d32d9d700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f6d3412fc20 0x7f6d3409a910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49418/0 (socket says 172.21.15.158:49418) 2019-12-05T03:50:35.150 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.132+0000 7f6d3359e700 1 -- 172.21.15.158:0/921010562 learned_addr learned my addr 172.21.15.158:0/921010562 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:35.150 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.132+0000 7f6d38a40700 1 --2- 172.21.15.158:0/921010562 >> v2:172.21.15.96:3300/0 conn(0x7f6d34064450 0x7f6d3413bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:35.150 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.132+0000 7f6d3359e700 1 -- 172.21.15.158:0/921010562 >> v2:172.21.15.96:3300/0 conn(0x7f6d34064450 msgr2=0x7f6d3413bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:35.150 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.132+0000 7f6d3359e700 1 --2- 172.21.15.158:0/921010562 >> v2:172.21.15.96:3300/0 conn(0x7f6d34064450 0x7f6d3413bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:35.150 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.132+0000 7f6d3359e700 1 -- 172.21.15.158:0/921010562 >> v1:172.21.15.158:6789/0 conn(0x7f6d3412fc20 legacy=0x7f6d3409a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:35.150 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.132+0000 7f6d3359e700 1 -- 172.21.15.158:0/921010562 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d3413c420 con 0x7f6d340b0e70 2019-12-05T03:50:35.151 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.132+0000 7f6d2bfff700 1 -- 172.21.15.158:0/921010562 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3046503031 0 0) 0x7f6d34064880 con 0x7f6d3412fc20 2019-12-05T03:50:35.151 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.132+0000 7f6d3359e700 1 --2- 172.21.15.158:0/921010562 >> v2:172.21.15.158:3300/0 conn(0x7f6d340b0e70 0x7f6d34150b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6d24004370 tx=0x7f6d24010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:35.151 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.132+0000 7f6d3359e700 1 --2- 172.21.15.158:0/921010562 >> v2:172.21.15.158:3300/0 conn(0x7f6d340b0e70 0x7f6d34150b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6d24004370 tx=0x7f6d24010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:35.151 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.132+0000 7f6d3359e700 1 --2- 172.21.15.158:0/921010562 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d340b0e70 0x7f6d34150b70 secure :-1 s=READY pgs=284 cs=0 l=1 rx=0x7f6d24004370 tx=0x7f6d24010a00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:35.151 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.132+0000 7f6d3359e700 1 --2- 172.21.15.158:0/921010562 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d340b0e70 0x7f6d34150b70 secure :-1 s=THROTTLE_DONE pgs=284 cs=0 l=1 rx=0x7f6d24004370 tx=0x7f6d24010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:35.151 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.132+0000 7f6d2bfff700 1 -- 172.21.15.158:0/921010562 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d2400c9c0 con 0x7f6d340b0e70 2019-12-05T03:50:35.151 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.132+0000 7f6d3359e700 1 --2- 172.21.15.158:0/921010562 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d340b0e70 0x7f6d34150b70 secure :-1 s=THROTTLE_DONE pgs=284 cs=0 l=1 rx=0x7f6d24004370 tx=0x7f6d24010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:35.152 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.132+0000 7f6d3359e700 1 --2- 172.21.15.158:0/921010562 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d340b0e70 0x7f6d34150b70 secure :-1 s=THROTTLE_DONE pgs=284 cs=0 l=1 rx=0x7f6d24004370 tx=0x7f6d24010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:35.152 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.132+0000 7f6d2bfff700 1 -- 172.21.15.158:0/921010562 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d24010250 con 0x7f6d340b0e70 2019-12-05T03:50:35.152 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.132+0000 7f6d2bfff700 1 -- 172.21.15.158:0/921010562 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d2400d0c0 con 0x7f6d340b0e70 2019-12-05T03:50:35.152 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.132+0000 7f6d39241700 1 -- 172.21.15.158:0/921010562 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d3413c690 con 0x7f6d340b0e70 2019-12-05T03:50:35.152 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.132+0000 7f6d39241700 1 -- 172.21.15.158:0/921010562 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d3413cc10 con 0x7f6d340b0e70 2019-12-05T03:50:35.152 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.132+0000 7f6d3359e700 1 --2- 172.21.15.158:0/921010562 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d340b0e70 0x7f6d34150b70 secure :-1 s=THROTTLE_DONE pgs=284 cs=0 l=1 rx=0x7f6d24004370 tx=0x7f6d24010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:35.152 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.136+0000 7f6d2bfff700 1 -- 172.21.15.158:0/921010562 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f6d24005460 con 0x7f6d340b0e70 2019-12-05T03:50:35.153 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.136+0000 7f6d3359e700 1 --2- 172.21.15.158:0/921010562 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d340b0e70 0x7f6d34150b70 secure :-1 s=THROTTLE_DONE pgs=284 cs=0 l=1 rx=0x7f6d24004370 tx=0x7f6d24010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:35.153 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.136+0000 7f6d2bfff700 1 --2- 172.21.15.158:0/921010562 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f6d1803ad20 0x7f6d1803d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:35.153 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.136+0000 7f6d2bfff700 1 -- 172.21.15.158:0/921010562 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6117+0+0 (secure 0 0 0) 0x7f6d2404aaa0 con 0x7f6d340b0e70 2019-12-05T03:50:35.153 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.136+0000 7f6d32d9d700 1 --2- 172.21.15.158:0/921010562 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f6d1803ad20 0x7f6d1803d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:35.153 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.136+0000 7f6d32d9d700 1 --2- 172.21.15.158:0/921010562 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f6d1803ad20 0x7f6d1803d230 crc :-1 s=READY pgs=131 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:35.153 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.136+0000 7f6d39241700 1 -- 172.21.15.158:0/921010562 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d340554e0 con 0x7f6d340b0e70 2019-12-05T03:50:35.154 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.144+0000 7f6d3359e700 1 --2- 172.21.15.158:0/921010562 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d340b0e70 0x7f6d34150b70 secure :-1 s=THROTTLE_DONE pgs=284 cs=0 l=1 rx=0x7f6d24004370 tx=0x7f6d24010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:35.154 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.144+0000 7f6d2bfff700 1 -- 172.21.15.158:0/921010562 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f6d24031b20 con 0x7f6d340b0e70 2019-12-05T03:50:35.312 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.304+0000 7f6d39241700 1 -- 172.21.15.158:0/921010562 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d34066940 con 0x7f6d340b0e70 2019-12-05T03:50:35.313 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.308+0000 7f6d3359e700 1 --2- 172.21.15.158:0/921010562 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d340b0e70 0x7f6d34150b70 secure :-1 s=THROTTLE_DONE pgs=284 cs=0 l=1 rx=0x7f6d24004370 tx=0x7f6d24010a00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:35.313 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.308+0000 7f6d2bfff700 1 -- 172.21.15.158:0/921010562 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+1423 (secure 0 0 0) 0x7f6d24031d80 con 0x7f6d340b0e70 2019-12-05T03:50:35.314 INFO:teuthology.orchestra.run.smithi158.stderr:dumped fsmap epoch 8 2019-12-05T03:50:35.314 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:35.314 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":8,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-12-05T03:50:01.249656+0000","modified":"2019-12-05T03:50:34.993949+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2019-12-05T03:50:35.316 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.308+0000 7f6d39241700 1 -- 172.21.15.158:0/921010562 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f6d1803ad20 msgr2=0x7f6d1803d230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:35.316 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.308+0000 7f6d39241700 1 --2- 172.21.15.158:0/921010562 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f6d1803ad20 0x7f6d1803d230 crc :-1 s=READY pgs=131 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:35.317 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.308+0000 7f6d39241700 1 -- 172.21.15.158:0/921010562 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d340b0e70 msgr2=0x7f6d34150b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:35.317 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.308+0000 7f6d39241700 1 --2- 172.21.15.158:0/921010562 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d340b0e70 0x7f6d34150b70 secure :-1 s=READY pgs=284 cs=0 l=1 rx=0x7f6d24004370 tx=0x7f6d24010a00).stop 2019-12-05T03:50:35.317 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.308+0000 7f6d39241700 1 -- 172.21.15.158:0/921010562 shutdown_connections 2019-12-05T03:50:35.317 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.308+0000 7f6d39241700 1 --2- 172.21.15.158:0/921010562 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f6d1803ad20 0x7f6d1803d230 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:35.317 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.308+0000 7f6d39241700 1 --2- 172.21.15.158:0/921010562 >> v2:172.21.15.96:3300/0 conn(0x7f6d34064450 0x7f6d3413bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:35.317 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.308+0000 7f6d39241700 1 --2- 172.21.15.158:0/921010562 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f6d340b0e70 0x7f6d34150b70 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:35.317 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.308+0000 7f6d39241700 1 -- 172.21.15.158:0/921010562 shutdown_connections 2019-12-05T03:50:35.317 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.308+0000 7f6d39241700 1 -- 172.21.15.158:0/921010562 wait complete. 2019-12-05T03:50:35.318 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.308+0000 7f6d39241700 1 -- 172.21.15.158:0/921010562 >> 172.21.15.158:0/921010562 conn(0x7f6d34155fa0 msgr2=0x7f6d34153440 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:35.326 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2019-12-05T03:50:35.424 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.412+0000 7f5be3cda700 1 Processor -- start 2019-12-05T03:50:35.424 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.412+0000 7f5be3cda700 1 -- start start 2019-12-05T03:50:35.424 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.412+0000 7f5be3cda700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5bdc0b6f20 0x7f5bdc0988e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:35.425 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.412+0000 7f5be3cda700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5bdc098e30 0x7f5bdc1550d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:35.425 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.412+0000 7f5be3cda700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bdc155e20 con 0x7f5bdc0969c0 2019-12-05T03:50:35.425 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.412+0000 7f5be3cda700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bdc098230 con 0x7f5bdc098e30 2019-12-05T03:50:35.425 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.412+0000 7f5be3cda700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bdc0993b0 con 0x7f5bdc0b6f20 2019-12-05T03:50:35.425 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.416+0000 7f5be2277700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5bdc0b6f20 0x7f5bdc0988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:35.425 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.416+0000 7f5be2277700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5bdc0b6f20 0x7f5bdc0988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54648/0 (socket says 172.21.15.158:54648) 2019-12-05T03:50:35.425 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.416+0000 7f5be2277700 1 -- 172.21.15.158:0/1217468285 learned_addr learned my addr 172.21.15.158:0/1217468285 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:35.426 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.416+0000 7f5be1a76700 1 --2- 172.21.15.158:0/1217468285 >> v2:172.21.15.96:3300/0 conn(0x7f5bdc098e30 0x7f5bdc1550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:35.426 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.416+0000 7f5be2277700 1 -- 172.21.15.158:0/1217468285 >> v2:172.21.15.96:3300/0 conn(0x7f5bdc098e30 msgr2=0x7f5bdc1550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:35.426 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.416+0000 7f5be2277700 1 --2- 172.21.15.158:0/1217468285 >> v2:172.21.15.96:3300/0 conn(0x7f5bdc098e30 0x7f5bdc1550d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:35.426 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.416+0000 7f5be2277700 1 -- 172.21.15.158:0/1217468285 >> v1:172.21.15.96:6789/0 conn(0x7f5bdc0969c0 legacy=0x7f5bdc155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:35.426 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.416+0000 7f5be2277700 1 -- 172.21.15.158:0/1217468285 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bdc097eb0 con 0x7f5bdc0b6f20 2019-12-05T03:50:35.426 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.416+0000 7f5be2277700 1 --2- 172.21.15.158:0/1217468285 >> v2:172.21.15.158:3300/0 conn(0x7f5bdc0b6f20 0x7f5bdc0988e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5bd8008790 tx=0x7f5bd800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:35.426 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.416+0000 7f5be2277700 1 --2- 172.21.15.158:0/1217468285 >> v2:172.21.15.158:3300/0 conn(0x7f5bdc0b6f20 0x7f5bdc0988e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5bd8008790 tx=0x7f5bd800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:35.426 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.416+0000 7f5be2277700 1 --2- 172.21.15.158:0/1217468285 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5bdc0b6f20 0x7f5bdc0988e0 secure :-1 s=READY pgs=285 cs=0 l=1 rx=0x7f5bd8008790 tx=0x7f5bd800fd30).ready entity=mon.1 client_cookie=55ae833a919a3ce5 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:35.427 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.416+0000 7f5be2277700 1 --2- 172.21.15.158:0/1217468285 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5bdc0b6f20 0x7f5bdc0988e0 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7f5bd8008790 tx=0x7f5bd800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:35.427 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.416+0000 7f5be2277700 1 --2- 172.21.15.158:0/1217468285 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5bdc0b6f20 0x7f5bdc0988e0 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7f5bd8008790 tx=0x7f5bd800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:35.427 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.416+0000 7f5be1275700 1 -- 172.21.15.158:0/1217468285 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bd8011370 con 0x7f5bdc0b6f20 2019-12-05T03:50:35.427 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.416+0000 7f5be2277700 1 --2- 172.21.15.158:0/1217468285 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5bdc0b6f20 0x7f5bdc0988e0 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7f5bd8008790 tx=0x7f5bd800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:35.427 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.416+0000 7f5be1275700 1 -- 172.21.15.158:0/1217468285 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd8008bb0 con 0x7f5bdc0b6f20 2019-12-05T03:50:35.427 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.416+0000 7f5be1275700 1 -- 172.21.15.158:0/1217468285 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bd8011950 con 0x7f5bdc0b6f20 2019-12-05T03:50:35.427 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.416+0000 7f5be3cda700 1 -- 172.21.15.158:0/1217468285 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5bdc0b6f20 msgr2=0x7f5bdc0988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:35.428 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.416+0000 7f5be3cda700 1 --2- 172.21.15.158:0/1217468285 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5bdc0b6f20 0x7f5bdc0988e0 secure :-1 s=READY pgs=285 cs=0 l=1 rx=0x7f5bd8008790 tx=0x7f5bd800fd30).stop 2019-12-05T03:50:35.428 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.416+0000 7f5be3cda700 1 -- 172.21.15.158:0/1217468285 shutdown_connections 2019-12-05T03:50:35.428 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.416+0000 7f5be3cda700 1 --2- 172.21.15.158:0/1217468285 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5bdc0b6f20 0x7f5bdc0988e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:35.428 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.416+0000 7f5be3cda700 1 --2- 172.21.15.158:0/1217468285 >> v2:172.21.15.96:3300/0 conn(0x7f5bdc098e30 0x7f5bdc1550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:35.428 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.416+0000 7f5be3cda700 1 -- 172.21.15.158:0/1217468285 shutdown_connections 2019-12-05T03:50:35.428 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.416+0000 7f5be3cda700 1 -- 172.21.15.158:0/1217468285 wait complete. 2019-12-05T03:50:35.428 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.416+0000 7f5be3cda700 1 -- 172.21.15.158:0/1217468285 >> 172.21.15.158:0/1217468285 conn(0x7f5bdc05e370 msgr2=0x7f5bdc0b7370 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:35.433 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.420+0000 7f5be3cda700 1 Processor -- start 2019-12-05T03:50:35.433 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.420+0000 7f5be3cda700 1 -- start start 2019-12-05T03:50:35.433 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.420+0000 7f5be3cda700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5bdc09a9c0 0x7f5bdc0650b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:35.433 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.420+0000 7f5be3cda700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5bdc136b50 0x7f5bdc07a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:35.433 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.420+0000 7f5be3cda700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5bdc07abe0 0x7f5bdc13a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:35.433 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.420+0000 7f5be3cda700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bdc0b5b60 con 0x7f5bdc136b50 2019-12-05T03:50:35.434 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.420+0000 7f5be3cda700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bdc0b5390 con 0x7f5bdc07abe0 2019-12-05T03:50:35.434 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.420+0000 7f5be3cda700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bdc0b5620 con 0x7f5bdc09a9c0 2019-12-05T03:50:35.434 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.420+0000 7f5be2a78700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5bdc07abe0 0x7f5bdc13a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:35.434 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.420+0000 7f5be1a76700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5bdc136b50 0x7f5bdc07a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:35.434 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.420+0000 7f5be2a78700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5bdc07abe0 0x7f5bdc13a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54654/0 (socket says 172.21.15.158:54654) 2019-12-05T03:50:35.434 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.420+0000 7f5be2a78700 1 -- 172.21.15.158:0/1036898676 learned_addr learned my addr 172.21.15.158:0/1036898676 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:35.434 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.420+0000 7f5be2277700 1 --2- 172.21.15.158:0/1036898676 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5bdc09a9c0 0x7f5bdc0650b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:35.435 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.420+0000 7f5be2a78700 1 -- 172.21.15.158:0/1036898676 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5bdc09a9c0 msgr2=0x7f5bdc0650b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:35.435 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.420+0000 7f5be2a78700 1 --2- 172.21.15.158:0/1036898676 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5bdc09a9c0 0x7f5bdc0650b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:35.435 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.420+0000 7f5be2a78700 1 -- 172.21.15.158:0/1036898676 >> v2:172.21.15.96:3300/0 conn(0x7f5bdc136b50 msgr2=0x7f5bdc07a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:35.435 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.420+0000 7f5be2a78700 1 --2- 172.21.15.158:0/1036898676 >> v2:172.21.15.96:3300/0 conn(0x7f5bdc136b50 0x7f5bdc07a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:35.435 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.420+0000 7f5be2a78700 1 -- 172.21.15.158:0/1036898676 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bdc07b010 con 0x7f5bdc07abe0 2019-12-05T03:50:35.435 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.420+0000 7f5be1a76700 1 --2- 172.21.15.158:0/1036898676 >> v2:172.21.15.96:3300/0 conn(0x7f5bdc136b50 0x7f5bdc07a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:50:35.435 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.420+0000 7f5be2a78700 1 --2- 172.21.15.158:0/1036898676 >> v2:172.21.15.158:3300/0 conn(0x7f5bdc07abe0 0x7f5bdc13a290 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5bdc0b57e0 tx=0x7f5bd4010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:35.436 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.420+0000 7f5be2a78700 1 --2- 172.21.15.158:0/1036898676 >> v2:172.21.15.158:3300/0 conn(0x7f5bdc07abe0 0x7f5bdc13a290 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5bdc0b57e0 tx=0x7f5bd4010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:35.436 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.420+0000 7f5be2a78700 1 --2- 172.21.15.158:0/1036898676 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5bdc07abe0 0x7f5bdc13a290 secure :-1 s=READY pgs=286 cs=0 l=1 rx=0x7f5bdc0b57e0 tx=0x7f5bd4010bc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:35.436 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.420+0000 7f5be2a78700 1 --2- 172.21.15.158:0/1036898676 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5bdc07abe0 0x7f5bdc13a290 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7f5bdc0b57e0 tx=0x7f5bd4010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:35.436 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.420+0000 7f5be2a78700 1 --2- 172.21.15.158:0/1036898676 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5bdc07abe0 0x7f5bdc13a290 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7f5bdc0b57e0 tx=0x7f5bd4010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:35.436 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.420+0000 7f5be2a78700 1 --2- 172.21.15.158:0/1036898676 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5bdc07abe0 0x7f5bdc13a290 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7f5bdc0b57e0 tx=0x7f5bd4010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:35.436 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.420+0000 7f5bd2ffd700 1 -- 172.21.15.158:0/1036898676 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bd4006dc0 con 0x7f5bdc07abe0 2019-12-05T03:50:35.436 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.420+0000 7f5bd2ffd700 1 -- 172.21.15.158:0/1036898676 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd40069e0 con 0x7f5bdc07abe0 2019-12-05T03:50:35.437 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.420+0000 7f5be3cda700 1 -- 172.21.15.158:0/1036898676 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bdc09adf0 con 0x7f5bdc07abe0 2019-12-05T03:50:35.437 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.420+0000 7f5bd2ffd700 1 -- 172.21.15.158:0/1036898676 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bd4012620 con 0x7f5bdc07abe0 2019-12-05T03:50:35.437 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.420+0000 7f5be3cda700 1 -- 172.21.15.158:0/1036898676 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bdc136f80 con 0x7f5bdc07abe0 2019-12-05T03:50:35.437 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.424+0000 7f5be2a78700 1 --2- 172.21.15.158:0/1036898676 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5bdc07abe0 0x7f5bdc13a290 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7f5bdc0b57e0 tx=0x7f5bd4010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:35.437 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.424+0000 7f5bd2ffd700 1 -- 172.21.15.158:0/1036898676 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f5bd40128f0 con 0x7f5bdc07abe0 2019-12-05T03:50:35.437 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.424+0000 7f5be2a78700 1 --2- 172.21.15.158:0/1036898676 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5bdc07abe0 0x7f5bdc13a290 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7f5bdc0b57e0 tx=0x7f5bd4010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:35.437 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.424+0000 7f5bd2ffd700 1 --2- 172.21.15.158:0/1036898676 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f5bc403ae60 0x7f5bc403d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:35.437 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.424+0000 7f5bd2ffd700 1 -- 172.21.15.158:0/1036898676 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6117+0+0 (secure 0 0 0) 0x7f5bd404b600 con 0x7f5bdc07abe0 2019-12-05T03:50:35.438 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.424+0000 7f5be2277700 1 --2- 172.21.15.158:0/1036898676 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f5bc403ae60 0x7f5bc403d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:35.438 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.424+0000 7f5be2277700 1 --2- 172.21.15.158:0/1036898676 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f5bc403ae60 0x7f5bc403d370 crc :-1 s=READY pgs=132 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:35.438 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.428+0000 7f5be3cda700 1 -- 172.21.15.158:0/1036898676 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bdc0554e0 con 0x7f5bdc07abe0 2019-12-05T03:50:35.443 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.432+0000 7f5be2a78700 1 --2- 172.21.15.158:0/1036898676 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5bdc07abe0 0x7f5bdc13a290 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7f5bdc0b57e0 tx=0x7f5bd4010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:35.443 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.432+0000 7f5bd2ffd700 1 -- 172.21.15.158:0/1036898676 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f5bd4032680 con 0x7f5bdc07abe0 2019-12-05T03:50:35.602 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:35.596+0000 7f5be3cda700 1 -- 172.21.15.158:0/1036898676 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5bdc0b3cf0 con 0x7f5bdc07abe0 2019-12-05T03:50:36.018 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.012+0000 7f5be2a78700 1 --2- 172.21.15.158:0/1036898676 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5bdc07abe0 0x7f5bdc13a290 secure :-1 s=THROTTLE_DONE pgs=286 cs=0 l=1 rx=0x7f5bdc0b57e0 tx=0x7f5bd4010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:36.018 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.012+0000 7f5bd2ffd700 1 -- 172.21.15.158:0/1036898676 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5bd40328e0 con 0x7f5bdc07abe0 2019-12-05T03:50:36.071 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.064+0000 7f5be3cda700 1 -- 172.21.15.158:0/1036898676 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f5bc403ae60 msgr2=0x7f5bc403d370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:36.071 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.064+0000 7f5be3cda700 1 --2- 172.21.15.158:0/1036898676 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f5bc403ae60 0x7f5bc403d370 crc :-1 s=READY pgs=132 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:36.072 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.064+0000 7f5be3cda700 1 -- 172.21.15.158:0/1036898676 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5bdc07abe0 msgr2=0x7f5bdc13a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:36.072 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.064+0000 7f5be3cda700 1 --2- 172.21.15.158:0/1036898676 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5bdc07abe0 0x7f5bdc13a290 secure :-1 s=READY pgs=286 cs=0 l=1 rx=0x7f5bdc0b57e0 tx=0x7f5bd4010bc0).stop 2019-12-05T03:50:36.072 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.064+0000 7f5be3cda700 1 -- 172.21.15.158:0/1036898676 shutdown_connections 2019-12-05T03:50:36.072 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.064+0000 7f5be3cda700 1 --2- 172.21.15.158:0/1036898676 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f5bc403ae60 0x7f5bc403d370 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:36.072 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.064+0000 7f5be3cda700 1 --2- 172.21.15.158:0/1036898676 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5bdc07abe0 0x7f5bdc13a290 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:36.072 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.064+0000 7f5be3cda700 1 --2- 172.21.15.158:0/1036898676 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5bdc09a9c0 0x7f5bdc0650b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:36.072 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.064+0000 7f5be3cda700 1 --2- 172.21.15.158:0/1036898676 >> v2:172.21.15.96:3300/0 conn(0x7f5bdc136b50 0x7f5bdc07a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:36.073 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.064+0000 7f5be3cda700 1 -- 172.21.15.158:0/1036898676 shutdown_connections 2019-12-05T03:50:36.073 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.064+0000 7f5be3cda700 1 -- 172.21.15.158:0/1036898676 wait complete. 2019-12-05T03:50:36.073 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.064+0000 7f5be3cda700 1 -- 172.21.15.158:0/1036898676 >> 172.21.15.158:0/1036898676 conn(0x7f5bdc05a890 msgr2=0x7f5bdc155040 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:36.086 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2019-12-05T03:50:36.197 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.188+0000 7f40c8c19700 1 Processor -- start 2019-12-05T03:50:36.198 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.188+0000 7f40c8c19700 1 -- start start 2019-12-05T03:50:36.198 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.188+0000 7f40c8c19700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f40c409ba40 0x7f40c409add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:36.198 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.188+0000 7f40c8c19700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f40c40b5370 0x7f40c40b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:36.198 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.188+0000 7f40c8c19700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40c4099e30 con 0x7f40c40b6970 2019-12-05T03:50:36.198 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.188+0000 7f40c8c19700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40c409d210 con 0x7f40c409ba40 2019-12-05T03:50:36.198 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.188+0000 7f40c8c19700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40c4099b90 con 0x7f40c40b5370 2019-12-05T03:50:36.198 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.188+0000 7f40c359e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f40c40b5370 0x7f40c40b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:36.199 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.188+0000 7f40c359e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f40c40b5370 0x7f40c40b57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54662/0 (socket says 172.21.15.158:54662) 2019-12-05T03:50:36.199 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.188+0000 7f40c359e700 1 -- 172.21.15.158:0/1821399355 learned_addr learned my addr 172.21.15.158:0/1821399355 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:36.199 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.188+0000 7f40c259c700 1 --2- 172.21.15.158:0/1821399355 >> v2:172.21.15.96:3300/0 conn(0x7f40c409ba40 0x7f40c409add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:36.199 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.188+0000 7f40c359e700 1 -- 172.21.15.158:0/1821399355 >> v2:172.21.15.96:3300/0 conn(0x7f40c409ba40 msgr2=0x7f40c409add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:36.199 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.188+0000 7f40c359e700 1 --2- 172.21.15.158:0/1821399355 >> v2:172.21.15.96:3300/0 conn(0x7f40c409ba40 0x7f40c409add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:36.199 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.188+0000 7f40c359e700 1 -- 172.21.15.158:0/1821399355 >> v1:172.21.15.96:6789/0 conn(0x7f40c40b6970 legacy=0x7f40c405a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:36.200 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.188+0000 7f40c359e700 1 -- 172.21.15.158:0/1821399355 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c407e960 con 0x7f40c40b5370 2019-12-05T03:50:36.200 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.188+0000 7f40c1d9b700 1 -- 172.21.15.158:0/1821399355 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3541512135 0 0) 0x7f40c4099e30 con 0x7f40c40b6970 2019-12-05T03:50:36.200 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.188+0000 7f40c259c700 1 --2- 172.21.15.158:0/1821399355 >> v2:172.21.15.96:3300/0 conn(0x7f40c409ba40 0x7f40c409add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:50:36.200 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.188+0000 7f40c359e700 1 --2- 172.21.15.158:0/1821399355 >> v2:172.21.15.158:3300/0 conn(0x7f40c40b5370 0x7f40c40b57a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f40bc0032b0 tx=0x7f40bc0100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:36.200 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.188+0000 7f40c359e700 1 --2- 172.21.15.158:0/1821399355 >> v2:172.21.15.158:3300/0 conn(0x7f40c40b5370 0x7f40c40b57a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f40bc0032b0 tx=0x7f40bc0100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:36.200 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.188+0000 7f40c359e700 1 --2- 172.21.15.158:0/1821399355 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f40c40b5370 0x7f40c40b57a0 secure :-1 s=READY pgs=287 cs=0 l=1 rx=0x7f40bc0032b0 tx=0x7f40bc0100b0).ready entity=mon.1 client_cookie=25e11c57a493a1f2 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:36.200 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.188+0000 7f40c359e700 1 --2- 172.21.15.158:0/1821399355 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f40c40b5370 0x7f40c40b57a0 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7f40bc0032b0 tx=0x7f40bc0100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:36.201 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.188+0000 7f40c1d9b700 1 -- 172.21.15.158:0/1821399355 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40bc010d60 con 0x7f40c40b5370 2019-12-05T03:50:36.201 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.188+0000 7f40c359e700 1 --2- 172.21.15.158:0/1821399355 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f40c40b5370 0x7f40c40b57a0 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7f40bc0032b0 tx=0x7f40bc0100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:36.201 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.188+0000 7f40c359e700 1 --2- 172.21.15.158:0/1821399355 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f40c40b5370 0x7f40c40b57a0 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7f40bc0032b0 tx=0x7f40bc0100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:36.201 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.188+0000 7f40c1d9b700 1 -- 172.21.15.158:0/1821399355 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40bc010980 con 0x7f40c40b5370 2019-12-05T03:50:36.201 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.188+0000 7f40c1d9b700 1 -- 172.21.15.158:0/1821399355 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40bc0114a0 con 0x7f40c40b5370 2019-12-05T03:50:36.201 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.188+0000 7f40c8c19700 1 -- 172.21.15.158:0/1821399355 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f40c40b5370 msgr2=0x7f40c40b57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:36.201 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.188+0000 7f40c8c19700 1 --2- 172.21.15.158:0/1821399355 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f40c40b5370 0x7f40c40b57a0 secure :-1 s=READY pgs=287 cs=0 l=1 rx=0x7f40bc0032b0 tx=0x7f40bc0100b0).stop 2019-12-05T03:50:36.202 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.188+0000 7f40c8c19700 1 -- 172.21.15.158:0/1821399355 shutdown_connections 2019-12-05T03:50:36.202 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.188+0000 7f40c8c19700 1 --2- 172.21.15.158:0/1821399355 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f40c40b5370 0x7f40c40b57a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:36.202 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.188+0000 7f40c8c19700 1 --2- 172.21.15.158:0/1821399355 >> v2:172.21.15.96:3300/0 conn(0x7f40c409ba40 0x7f40c409add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:36.202 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.188+0000 7f40c8c19700 1 -- 172.21.15.158:0/1821399355 shutdown_connections 2019-12-05T03:50:36.202 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.188+0000 7f40c8c19700 1 -- 172.21.15.158:0/1821399355 wait complete. 2019-12-05T03:50:36.202 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.188+0000 7f40c8c19700 1 -- 172.21.15.158:0/1821399355 >> 172.21.15.158:0/1821399355 conn(0x7f40c40b7ef0 msgr2=0x7f40c40b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:36.206 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.192+0000 7f40c8c19700 1 Processor -- start 2019-12-05T03:50:36.206 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.192+0000 7f40c8c19700 1 -- start start 2019-12-05T03:50:36.206 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.192+0000 7f40c8c19700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f40c4138fc0 0x7f40c40ad640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:36.206 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.192+0000 7f40c8c19700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f40c40adb90 0x7f40c4151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:36.207 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.192+0000 7f40c8c19700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f40c40b16a0 0x7f40c4152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:36.207 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.192+0000 7f40c8c19700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40c4152590 con 0x7f40c40adb90 2019-12-05T03:50:36.207 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.192+0000 7f40c8c19700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40c4153720 con 0x7f40c40b16a0 2019-12-05T03:50:36.207 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.192+0000 7f40c8c19700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c41538e0 con 0x7f40c4138fc0 2019-12-05T03:50:36.207 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.192+0000 7f40c359e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f40c40b16a0 0x7f40c4152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:36.207 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.192+0000 7f40c359e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f40c40b16a0 0x7f40c4152040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54668/0 (socket says 172.21.15.158:54668) 2019-12-05T03:50:36.208 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.192+0000 7f40c359e700 1 -- 172.21.15.158:0/2558433530 learned_addr learned my addr 172.21.15.158:0/2558433530 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:36.208 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.192+0000 7f40c259c700 1 --2- 172.21.15.158:0/2558433530 >> v2:172.21.15.96:3300/0 conn(0x7f40c40adb90 0x7f40c4151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:36.208 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.192+0000 7f40c2d9d700 1 --2- 172.21.15.158:0/2558433530 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f40c4138fc0 0x7f40c40ad640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:36.208 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.192+0000 7f40c359e700 1 -- 172.21.15.158:0/2558433530 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f40c4138fc0 msgr2=0x7f40c40ad640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:36.208 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.192+0000 7f40c359e700 1 --2- 172.21.15.158:0/2558433530 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f40c4138fc0 0x7f40c40ad640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:36.208 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.192+0000 7f40c359e700 1 -- 172.21.15.158:0/2558433530 >> v2:172.21.15.96:3300/0 conn(0x7f40c40adb90 msgr2=0x7f40c4151af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:36.208 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.192+0000 7f40c359e700 1 --2- 172.21.15.158:0/2558433530 >> v2:172.21.15.96:3300/0 conn(0x7f40c40adb90 0x7f40c4151af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:36.209 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.192+0000 7f40c359e700 1 -- 172.21.15.158:0/2558433530 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c4139480 con 0x7f40c40b16a0 2019-12-05T03:50:36.209 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.192+0000 7f40c259c700 1 --2- 172.21.15.158:0/2558433530 >> v2:172.21.15.96:3300/0 conn(0x7f40c40adb90 0x7f40c4151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:50:36.209 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.192+0000 7f40c359e700 1 --2- 172.21.15.158:0/2558433530 >> v2:172.21.15.158:3300/0 conn(0x7f40c40b16a0 0x7f40c4152040 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f40bc0032b0 tx=0x7f40bc010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:36.209 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.192+0000 7f40c359e700 1 --2- 172.21.15.158:0/2558433530 >> v2:172.21.15.158:3300/0 conn(0x7f40c40b16a0 0x7f40c4152040 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f40bc0032b0 tx=0x7f40bc010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:36.209 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.192+0000 7f40c359e700 1 --2- 172.21.15.158:0/2558433530 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f40c40b16a0 0x7f40c4152040 secure :-1 s=READY pgs=288 cs=0 l=1 rx=0x7f40bc0032b0 tx=0x7f40bc010d30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:36.209 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.192+0000 7f40c359e700 1 --2- 172.21.15.158:0/2558433530 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f40c40b16a0 0x7f40c4152040 secure :-1 s=THROTTLE_DONE pgs=288 cs=0 l=1 rx=0x7f40bc0032b0 tx=0x7f40bc010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:36.209 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.192+0000 7f40c359e700 1 --2- 172.21.15.158:0/2558433530 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f40c40b16a0 0x7f40c4152040 secure :-1 s=THROTTLE_DONE pgs=288 cs=0 l=1 rx=0x7f40bc0032b0 tx=0x7f40bc010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:36.210 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.192+0000 7f40b37fe700 1 -- 172.21.15.158:0/2558433530 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40bc011bb0 con 0x7f40c40b16a0 2019-12-05T03:50:36.210 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.192+0000 7f40c359e700 1 --2- 172.21.15.158:0/2558433530 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f40c40b16a0 0x7f40c4152040 secure :-1 s=THROTTLE_DONE pgs=288 cs=0 l=1 rx=0x7f40bc0032b0 tx=0x7f40bc010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:36.210 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.192+0000 7f40b37fe700 1 -- 172.21.15.158:0/2558433530 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40bc0110c0 con 0x7f40c40b16a0 2019-12-05T03:50:36.210 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.192+0000 7f40c8c19700 1 -- 172.21.15.158:0/2558433530 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40c4139710 con 0x7f40c40b16a0 2019-12-05T03:50:36.210 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.192+0000 7f40b37fe700 1 -- 172.21.15.158:0/2558433530 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40bc005ab0 con 0x7f40c40b16a0 2019-12-05T03:50:36.210 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.192+0000 7f40c8c19700 1 -- 172.21.15.158:0/2558433530 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40c4139c90 con 0x7f40c40b16a0 2019-12-05T03:50:36.210 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.196+0000 7f40c359e700 1 --2- 172.21.15.158:0/2558433530 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f40c40b16a0 0x7f40c4152040 secure :-1 s=THROTTLE_DONE pgs=288 cs=0 l=1 rx=0x7f40bc0032b0 tx=0x7f40bc010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:36.211 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.196+0000 7f40b37fe700 1 -- 172.21.15.158:0/2558433530 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f40bc005cb0 con 0x7f40c40b16a0 2019-12-05T03:50:36.211 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.196+0000 7f40c359e700 1 --2- 172.21.15.158:0/2558433530 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f40c40b16a0 0x7f40c4152040 secure :-1 s=THROTTLE_DONE pgs=288 cs=0 l=1 rx=0x7f40bc0032b0 tx=0x7f40bc010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:36.211 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.196+0000 7f40b37fe700 1 --2- 172.21.15.158:0/2558433530 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f40a803ad40 0x7f40a803d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:36.211 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.196+0000 7f40b37fe700 1 -- 172.21.15.158:0/2558433530 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6117+0+0 (secure 0 0 0) 0x7f40bc04b1c0 con 0x7f40c40b16a0 2019-12-05T03:50:36.211 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.196+0000 7f40c2d9d700 1 --2- 172.21.15.158:0/2558433530 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f40a803ad40 0x7f40a803d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:36.211 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.196+0000 7f40c2d9d700 1 --2- 172.21.15.158:0/2558433530 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f40a803ad40 0x7f40a803d250 crc :-1 s=READY pgs=133 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:36.212 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.204+0000 7f40c8c19700 1 -- 172.21.15.158:0/2558433530 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40c40554e0 con 0x7f40c40b16a0 2019-12-05T03:50:36.218 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.212+0000 7f40c359e700 1 --2- 172.21.15.158:0/2558433530 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f40c40b16a0 0x7f40c4152040 secure :-1 s=THROTTLE_DONE pgs=288 cs=0 l=1 rx=0x7f40bc0032b0 tx=0x7f40bc010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:36.218 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.212+0000 7f40b37fe700 1 -- 172.21.15.158:0/2558433530 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f40bc032240 con 0x7f40c40b16a0 2019-12-05T03:50:36.379 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:36.372+0000 7f40c8c19700 1 -- 172.21.15.158:0/2558433530 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f40c4066940 con 0x7f40c40b16a0 2019-12-05T03:50:37.023 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.016+0000 7f40c359e700 1 --2- 172.21.15.158:0/2558433530 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f40c40b16a0 0x7f40c4152040 secure :-1 s=THROTTLE_DONE pgs=288 cs=0 l=1 rx=0x7f40bc0032b0 tx=0x7f40bc010d30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:37.023 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.016+0000 7f40b37fe700 1 -- 172.21.15.158:0/2558433530 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_metadata", "prefix": "osd pool delete", "pool": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) v1 ==== 185+0+0 (secure 0 0 0) 0x7f40bc0324a0 con 0x7f40c40b16a0 2019-12-05T03:50:37.044 INFO:teuthology.orchestra.run.smithi158.stderr:pool 'cephfs_metadata' removed 2019-12-05T03:50:37.050 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.040+0000 7f40c8c19700 1 -- 172.21.15.158:0/2558433530 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f40a803ad40 msgr2=0x7f40a803d250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:37.050 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.040+0000 7f40c8c19700 1 --2- 172.21.15.158:0/2558433530 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f40a803ad40 0x7f40a803d250 crc :-1 s=READY pgs=133 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:37.051 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.040+0000 7f40c8c19700 1 -- 172.21.15.158:0/2558433530 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f40c40b16a0 msgr2=0x7f40c4152040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:37.051 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.040+0000 7f40c8c19700 1 --2- 172.21.15.158:0/2558433530 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f40c40b16a0 0x7f40c4152040 secure :-1 s=READY pgs=288 cs=0 l=1 rx=0x7f40bc0032b0 tx=0x7f40bc010d30).stop 2019-12-05T03:50:37.051 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.040+0000 7f40c8c19700 1 -- 172.21.15.158:0/2558433530 shutdown_connections 2019-12-05T03:50:37.051 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.040+0000 7f40c8c19700 1 --2- 172.21.15.158:0/2558433530 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f40a803ad40 0x7f40a803d250 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:37.051 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.040+0000 7f40c8c19700 1 --2- 172.21.15.158:0/2558433530 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f40c40b16a0 0x7f40c4152040 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:37.051 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.040+0000 7f40c8c19700 1 --2- 172.21.15.158:0/2558433530 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f40c4138fc0 0x7f40c40ad640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:37.052 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.040+0000 7f40c8c19700 1 --2- 172.21.15.158:0/2558433530 >> v2:172.21.15.96:3300/0 conn(0x7f40c40adb90 0x7f40c4151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:37.052 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.040+0000 7f40c8c19700 1 -- 172.21.15.158:0/2558433530 shutdown_connections 2019-12-05T03:50:37.052 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.040+0000 7f40c8c19700 1 -- 172.21.15.158:0/2558433530 wait complete. 2019-12-05T03:50:37.052 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.040+0000 7f40c8c19700 1 -- 172.21.15.158:0/2558433530 >> 172.21.15.158:0/2558433530 conn(0x7f40c409b490 msgr2=0x7f40c4155200 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:37.062 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2019-12-05T03:50:37.167 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.156+0000 7f3adaedf700 1 Processor -- start 2019-12-05T03:50:37.168 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.156+0000 7f3adaedf700 1 -- start start 2019-12-05T03:50:37.168 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.156+0000 7f3adaedf700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3ad40b6970 0x7f3ad409add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:37.168 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.156+0000 7f3adaedf700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3ad409ba40 0x7f3ad405a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:37.168 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.156+0000 7f3adaedf700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f3ad405a950 0x7f3ad4155290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:37.168 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.156+0000 7f3adaedf700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ad409d210 con 0x7f3ad40b6970 2019-12-05T03:50:37.168 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.156+0000 7f3adaedf700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ad4099b90 con 0x7f3ad405a950 2019-12-05T03:50:37.168 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.156+0000 7f3adaedf700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad4099e30 con 0x7f3ad409ba40 2019-12-05T03:50:37.169 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.156+0000 7f3ad9c7d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f3ad405a950 0x7f3ad4155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:37.169 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.156+0000 7f3ad9c7d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f3ad405a950 0x7f3ad4155290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54676/0 (socket says 172.21.15.158:54676) 2019-12-05T03:50:37.169 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.156+0000 7f3ad9c7d700 1 -- 172.21.15.158:0/3103570182 learned_addr learned my addr 172.21.15.158:0/3103570182 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:37.169 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.156+0000 7f3ad8c7b700 1 --2- 172.21.15.158:0/3103570182 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3ad409ba40 0x7f3ad405a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:37.169 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.156+0000 7f3ad947c700 1 --2- 172.21.15.158:0/3103570182 >> v2:172.21.15.96:3300/0 conn(0x7f3ad40b6970 0x7f3ad409add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:37.169 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.156+0000 7f3ad9c7d700 1 -- 172.21.15.158:0/3103570182 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3ad409ba40 msgr2=0x7f3ad405a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:37.170 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.156+0000 7f3ad9c7d700 1 --2- 172.21.15.158:0/3103570182 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3ad409ba40 0x7f3ad405a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:37.170 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.156+0000 7f3ad9c7d700 1 -- 172.21.15.158:0/3103570182 >> v2:172.21.15.96:3300/0 conn(0x7f3ad40b6970 msgr2=0x7f3ad409add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:37.170 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.156+0000 7f3ad9c7d700 1 --2- 172.21.15.158:0/3103570182 >> v2:172.21.15.96:3300/0 conn(0x7f3ad40b6970 0x7f3ad409add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:37.170 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.156+0000 7f3ad9c7d700 1 -- 172.21.15.158:0/3103570182 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad407e960 con 0x7f3ad405a950 2019-12-05T03:50:37.170 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.156+0000 7f3ad947c700 1 --2- 172.21.15.158:0/3103570182 >> v2:172.21.15.96:3300/0 conn(0x7f3ad40b6970 0x7f3ad409add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-12-05T03:50:37.170 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.156+0000 7f3ad9c7d700 1 --2- 172.21.15.158:0/3103570182 >> v2:172.21.15.158:3300/0 conn(0x7f3ad405a950 0x7f3ad4155290 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3acc002f30 tx=0x7f3acc00fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:37.170 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.156+0000 7f3ad9c7d700 1 --2- 172.21.15.158:0/3103570182 >> v2:172.21.15.158:3300/0 conn(0x7f3ad405a950 0x7f3ad4155290 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3acc002f30 tx=0x7f3acc00fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:37.171 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.156+0000 7f3ad9c7d700 1 --2- 172.21.15.158:0/3103570182 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3ad405a950 0x7f3ad4155290 secure :-1 s=READY pgs=289 cs=0 l=1 rx=0x7f3acc002f30 tx=0x7f3acc00fdb0).ready entity=mon.1 client_cookie=9e86811a26f44f50 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:37.171 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.156+0000 7f3ad9c7d700 1 --2- 172.21.15.158:0/3103570182 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3ad405a950 0x7f3ad4155290 secure :-1 s=THROTTLE_DONE pgs=289 cs=0 l=1 rx=0x7f3acc002f30 tx=0x7f3acc00fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:37.171 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.156+0000 7f3ad3fff700 1 -- 172.21.15.158:0/3103570182 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3acc008c90 con 0x7f3ad405a950 2019-12-05T03:50:37.171 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.156+0000 7f3ad9c7d700 1 --2- 172.21.15.158:0/3103570182 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3ad405a950 0x7f3ad4155290 secure :-1 s=THROTTLE_DONE pgs=289 cs=0 l=1 rx=0x7f3acc002f30 tx=0x7f3acc00fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:37.171 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.156+0000 7f3ad3fff700 1 -- 172.21.15.158:0/3103570182 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3acc0088b0 con 0x7f3ad405a950 2019-12-05T03:50:37.171 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.156+0000 7f3ad9c7d700 1 --2- 172.21.15.158:0/3103570182 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3ad405a950 0x7f3ad4155290 secure :-1 s=THROTTLE_DONE pgs=289 cs=0 l=1 rx=0x7f3acc002f30 tx=0x7f3acc00fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:37.172 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.156+0000 7f3adaedf700 1 -- 172.21.15.158:0/3103570182 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3ad405a950 msgr2=0x7f3ad4155290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:37.172 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.156+0000 7f3ad3fff700 1 -- 172.21.15.158:0/3103570182 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3acc011b50 con 0x7f3ad405a950 2019-12-05T03:50:37.172 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.156+0000 7f3adaedf700 1 --2- 172.21.15.158:0/3103570182 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3ad405a950 0x7f3ad4155290 secure :-1 s=READY pgs=289 cs=0 l=1 rx=0x7f3acc002f30 tx=0x7f3acc00fdb0).stop 2019-12-05T03:50:37.172 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.160+0000 7f3adaedf700 1 -- 172.21.15.158:0/3103570182 shutdown_connections 2019-12-05T03:50:37.173 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.160+0000 7f3adaedf700 1 --2- 172.21.15.158:0/3103570182 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3ad405a950 0x7f3ad4155290 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:37.173 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.160+0000 7f3adaedf700 1 --2- 172.21.15.158:0/3103570182 >> v2:172.21.15.96:3300/0 conn(0x7f3ad40b6970 0x7f3ad409add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:37.173 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.160+0000 7f3adaedf700 1 --2- 172.21.15.158:0/3103570182 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3ad409ba40 0x7f3ad405a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:37.173 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.160+0000 7f3adaedf700 1 -- 172.21.15.158:0/3103570182 shutdown_connections 2019-12-05T03:50:37.173 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.160+0000 7f3adaedf700 1 -- 172.21.15.158:0/3103570182 wait complete. 2019-12-05T03:50:37.173 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.160+0000 7f3adaedf700 1 -- 172.21.15.158:0/3103570182 >> 172.21.15.158:0/3103570182 conn(0x7f3ad40b7ef0 msgr2=0x7f3ad40b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:37.177 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.160+0000 7f3adaedf700 1 Processor -- start 2019-12-05T03:50:37.177 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.160+0000 7f3adaedf700 1 -- start start 2019-12-05T03:50:37.177 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.160+0000 7f3adaedf700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f3ad40b0d20 0x7f3ad413f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:37.177 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.160+0000 7f3adaedf700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ad40b1990 con 0x7f3ad40ae840 2019-12-05T03:50:37.177 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.160+0000 7f3adaedf700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ad40b1150 con 0x7f3ad40afe20 2019-12-05T03:50:37.177 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.160+0000 7f3adaedf700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ad40b1450 con 0x7f3ad40b0d20 2019-12-05T03:50:37.177 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.160+0000 7f3ad9c7d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f3ad40b0d20 0x7f3ad413f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:37.178 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.160+0000 7f3ad8c7b700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f3ad40afe20 0x7f3ad413b760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49460/0 (socket says 172.21.15.158:49460) 2019-12-05T03:50:37.178 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.160+0000 7f3ad8c7b700 1 -- 172.21.15.158:0/4275485504 learned_addr learned my addr 172.21.15.158:0/4275485504 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:37.178 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.164+0000 7f3ad9c7d700 1 -- 172.21.15.158:0/4275485504 >> v1:172.21.15.158:6789/0 conn(0x7f3ad40afe20 legacy=0x7f3ad413b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:37.178 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.164+0000 7f3ad9c7d700 1 -- 172.21.15.158:0/4275485504 >> v1:172.21.15.96:6789/0 conn(0x7f3ad40ae840 legacy=0x7f3ad40b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:37.178 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.164+0000 7f3ad1ffb700 1 -- 172.21.15.158:0/4275485504 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1302382423 0 0) 0x7f3ad40b1990 con 0x7f3ad40ae840 2019-12-05T03:50:37.178 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.164+0000 7f3ad9c7d700 1 -- 172.21.15.158:0/4275485504 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad413bf60 con 0x7f3ad40b0d20 2019-12-05T03:50:37.179 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.164+0000 7f3ad9c7d700 1 --2- 172.21.15.158:0/4275485504 >> v2:172.21.15.158:3300/0 conn(0x7f3ad40b0d20 0x7f3ad413f690 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3ac8007cc0 tx=0x7f3ac4007720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:37.179 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.164+0000 7f3ad9c7d700 1 --2- 172.21.15.158:0/4275485504 >> v2:172.21.15.158:3300/0 conn(0x7f3ad40b0d20 0x7f3ad413f690 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3ac8007cc0 tx=0x7f3ac4007720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:37.179 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.164+0000 7f3ad9c7d700 1 --2- 172.21.15.158:0/4275485504 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3ad40b0d20 0x7f3ad413f690 secure :-1 s=READY pgs=291 cs=0 l=1 rx=0x7f3ac8007cc0 tx=0x7f3ac4007720).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:37.179 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.164+0000 7f3ad9c7d700 1 --2- 172.21.15.158:0/4275485504 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3ad40b0d20 0x7f3ad413f690 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7f3ac8007cc0 tx=0x7f3ac4007720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:37.179 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.164+0000 7f3ad1ffb700 1 -- 172.21.15.158:0/4275485504 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3acc00f470 con 0x7f3ad40b0d20 2019-12-05T03:50:37.179 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.164+0000 7f3ad9c7d700 1 --2- 172.21.15.158:0/4275485504 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3ad40b0d20 0x7f3ad413f690 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7f3ac8007cc0 tx=0x7f3ac4007720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:37.180 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.164+0000 7f3ad9c7d700 1 --2- 172.21.15.158:0/4275485504 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3ad40b0d20 0x7f3ad413f690 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7f3ac8007cc0 tx=0x7f3ac4007720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:37.180 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.164+0000 7f3ad1ffb700 1 -- 172.21.15.158:0/4275485504 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3acc011770 con 0x7f3ad40b0d20 2019-12-05T03:50:37.180 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.164+0000 7f3adaedf700 1 -- 172.21.15.158:0/4275485504 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ad413c1f0 con 0x7f3ad40b0d20 2019-12-05T03:50:37.180 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.164+0000 7f3ad1ffb700 1 -- 172.21.15.158:0/4275485504 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3acc005730 con 0x7f3ad40b0d20 2019-12-05T03:50:37.180 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.164+0000 7f3adaedf700 1 -- 172.21.15.158:0/4275485504 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ad4146e30 con 0x7f3ad40b0d20 2019-12-05T03:50:37.180 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.164+0000 7f3ad9c7d700 1 --2- 172.21.15.158:0/4275485504 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3ad40b0d20 0x7f3ad413f690 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7f3ac8007cc0 tx=0x7f3ac4007720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:37.180 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.164+0000 7f3ad1ffb700 1 -- 172.21.15.158:0/4275485504 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f3acc005a40 con 0x7f3ad40b0d20 2019-12-05T03:50:37.181 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.164+0000 7f3ad9c7d700 1 --2- 172.21.15.158:0/4275485504 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3ad40b0d20 0x7f3ad413f690 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7f3ac8007cc0 tx=0x7f3ac4007720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:37.181 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.164+0000 7f3ad1ffb700 1 --2- 172.21.15.158:0/4275485504 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f3ab403ac00 0x7f3ab403d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:37.181 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.164+0000 7f3ad1ffb700 1 -- 172.21.15.158:0/4275485504 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5679+0+0 (secure 0 0 0) 0x7f3acc04b300 con 0x7f3ad40b0d20 2019-12-05T03:50:37.181 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.164+0000 7f3ad947c700 1 --2- 172.21.15.158:0/4275485504 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f3ab403ac00 0x7f3ab403d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:37.181 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.168+0000 7f3ad947c700 1 --2- 172.21.15.158:0/4275485504 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f3ab403ac00 0x7f3ab403d110 crc :-1 s=READY pgs=134 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:37.182 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.172+0000 7f3adaedf700 1 -- 172.21.15.158:0/4275485504 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ad41541c0 con 0x7f3ad40b0d20 2019-12-05T03:50:37.184 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.176+0000 7f3ad9c7d700 1 --2- 172.21.15.158:0/4275485504 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3ad40b0d20 0x7f3ad413f690 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7f3ac8007cc0 tx=0x7f3ac4007720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:37.190 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.176+0000 7f3ad1ffb700 1 -- 172.21.15.158:0/4275485504 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f3acc005d50 con 0x7f3ad40b0d20 2019-12-05T03:50:37.341 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:37.336+0000 7f3adaedf700 1 -- 172.21.15.158:0/4275485504 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3ad40b4700 con 0x7f3ad40b0d20 2019-12-05T03:50:38.035 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.028+0000 7f3ad9c7d700 1 --2- 172.21.15.158:0/4275485504 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3ad40b0d20 0x7f3ad413f690 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7f3ac8007cc0 tx=0x7f3ac4007720).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:38.035 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.028+0000 7f3ad1ffb700 1 -- 172.21.15.158:0/4275485504 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"pool2": "cephfs_data", "prefix": "osd pool delete", "pool": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) v1 ==== 173+0+0 (secure 0 0 0) 0x7f3acc0331b0 con 0x7f3ad40b0d20 2019-12-05T03:50:38.056 INFO:teuthology.orchestra.run.smithi158.stderr:pool 'cephfs_data' removed 2019-12-05T03:50:38.060 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.052+0000 7f3adaedf700 1 -- 172.21.15.158:0/4275485504 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f3ab403ac00 msgr2=0x7f3ab403d110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:38.060 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.052+0000 7f3adaedf700 1 --2- 172.21.15.158:0/4275485504 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f3ab403ac00 0x7f3ab403d110 crc :-1 s=READY pgs=134 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:38.060 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.052+0000 7f3adaedf700 1 -- 172.21.15.158:0/4275485504 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3ad40b0d20 msgr2=0x7f3ad413f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:38.060 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.052+0000 7f3adaedf700 1 --2- 172.21.15.158:0/4275485504 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3ad40b0d20 0x7f3ad413f690 secure :-1 s=READY pgs=291 cs=0 l=1 rx=0x7f3ac8007cc0 tx=0x7f3ac4007720).stop 2019-12-05T03:50:38.060 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.052+0000 7f3adaedf700 1 -- 172.21.15.158:0/4275485504 shutdown_connections 2019-12-05T03:50:38.061 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.052+0000 7f3adaedf700 1 --2- 172.21.15.158:0/4275485504 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3ad40b0d20 0x7f3ad413f690 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:38.061 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.052+0000 7f3adaedf700 1 --2- 172.21.15.158:0/4275485504 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f3ab403ac00 0x7f3ab403d110 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:38.061 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.052+0000 7f3adaedf700 1 -- 172.21.15.158:0/4275485504 shutdown_connections 2019-12-05T03:50:38.061 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.052+0000 7f3adaedf700 1 -- 172.21.15.158:0/4275485504 wait complete. 2019-12-05T03:50:38.061 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.052+0000 7f3adaedf700 1 -- 172.21.15.158:0/4275485504 >> 172.21.15.158:0/4275485504 conn(0x7f3ad40b2620 msgr2=0x7f3ad4130630 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:38.072 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2019-12-05T03:50:38.162 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.152+0000 7fb61c26d700 1 Processor -- start 2019-12-05T03:50:38.163 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.152+0000 7fb61c26d700 1 -- start start 2019-12-05T03:50:38.163 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.152+0000 7fb61c26d700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb61409a320 0x7fb61405a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:38.163 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.152+0000 7fb61c26d700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6140accb0 con 0x7fb61409cf60 2019-12-05T03:50:38.163 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.152+0000 7fb61c26d700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6140b6980 con 0x7fb6141553b0 2019-12-05T03:50:38.163 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.152+0000 7fb61c26d700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb61409a750 con 0x7fb61409a320 2019-12-05T03:50:38.163 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.152+0000 7fb61b00b700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fb6141553b0 0x7fb6141557e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49470/0 (socket says 172.21.15.158:49470) 2019-12-05T03:50:38.164 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.152+0000 7fb61b00b700 1 -- 172.21.15.158:0/2915144831 learned_addr learned my addr 172.21.15.158:0/2915144831 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:38.164 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.152+0000 7fb61a009700 1 --2- 172.21.15.158:0/2915144831 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb61409a320 0x7fb61405a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:38.164 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.152+0000 7fb619808700 1 -- 172.21.15.158:0/2915144831 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1608841256 0 0) 0x7fb6140b6980 con 0x7fb6141553b0 2019-12-05T03:50:38.164 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.152+0000 7fb619808700 1 -- 172.21.15.158:0/2915144831 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6000030b0 con 0x7fb6141553b0 2019-12-05T03:50:38.164 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.152+0000 7fb61a009700 1 -- 172.21.15.158:0/2915144831 >> v1:172.21.15.158:6789/0 conn(0x7fb6141553b0 legacy=0x7fb6141557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:38.164 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.152+0000 7fb619808700 1 -- 172.21.15.158:0/2915144831 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2973169896 0 0) 0x7fb6140accb0 con 0x7fb61409cf60 2019-12-05T03:50:38.165 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.152+0000 7fb61a009700 1 -- 172.21.15.158:0/2915144831 >> v1:172.21.15.96:6789/0 conn(0x7fb61409cf60 legacy=0x7fb614151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:38.165 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.152+0000 7fb61a009700 1 -- 172.21.15.158:0/2915144831 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb614155fe0 con 0x7fb61409a320 2019-12-05T03:50:38.165 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.152+0000 7fb61a009700 1 --2- 172.21.15.158:0/2915144831 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb61409a320 0x7fb61405a740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb610002f30 tx=0x7fb61000fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:38.165 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.152+0000 7fb61a009700 1 --2- 172.21.15.158:0/2915144831 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb61409a320 0x7fb61405a740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb610002f30 tx=0x7fb61000fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:38.165 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.152+0000 7fb61a009700 1 --2- 172.21.15.158:0/2915144831 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb61409a320 0x7fb61405a740 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7fb610002f30 tx=0x7fb61000fbf0).ready entity=mon.2 client_cookie=e6f9bb338eff3672 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:38.165 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.152+0000 7fb61a009700 1 --2- 172.21.15.158:0/2915144831 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb61409a320 0x7fb61405a740 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7fb610002f30 tx=0x7fb61000fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:38.165 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.152+0000 7fb619808700 1 -- 172.21.15.158:0/2915144831 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6100112b0 con 0x7fb61409a320 2019-12-05T03:50:38.166 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.152+0000 7fb61a009700 1 --2- 172.21.15.158:0/2915144831 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb61409a320 0x7fb61405a740 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7fb610002f30 tx=0x7fb61000fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:38.166 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.152+0000 7fb61a009700 1 --2- 172.21.15.158:0/2915144831 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb61409a320 0x7fb61405a740 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7fb610002f30 tx=0x7fb61000fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:38.166 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.152+0000 7fb619808700 1 -- 172.21.15.158:0/2915144831 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb610008bc0 con 0x7fb61409a320 2019-12-05T03:50:38.166 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.152+0000 7fb619808700 1 -- 172.21.15.158:0/2915144831 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb610011890 con 0x7fb61409a320 2019-12-05T03:50:38.166 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.152+0000 7fb61c26d700 1 -- 172.21.15.158:0/2915144831 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb61409a320 msgr2=0x7fb61405a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:38.166 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.152+0000 7fb61c26d700 1 --2- 172.21.15.158:0/2915144831 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb61409a320 0x7fb61405a740 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7fb610002f30 tx=0x7fb61000fbf0).stop 2019-12-05T03:50:38.166 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.156+0000 7fb61c26d700 1 -- 172.21.15.158:0/2915144831 shutdown_connections 2019-12-05T03:50:38.167 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.156+0000 7fb61c26d700 1 --2- 172.21.15.158:0/2915144831 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb61409a320 0x7fb61405a740 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:38.167 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.156+0000 7fb61c26d700 1 -- 172.21.15.158:0/2915144831 shutdown_connections 2019-12-05T03:50:38.167 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.156+0000 7fb61c26d700 1 -- 172.21.15.158:0/2915144831 wait complete. 2019-12-05T03:50:38.167 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.156+0000 7fb61c26d700 1 -- 172.21.15.158:0/2915144831 >> 172.21.15.158:0/2915144831 conn(0x7fb6140b7e60 msgr2=0x7fb6140b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:38.170 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.156+0000 7fb61c26d700 1 Processor -- start 2019-12-05T03:50:38.171 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.156+0000 7fb61c26d700 1 -- start start 2019-12-05T03:50:38.171 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.160+0000 7fb61c26d700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb6140b0c60 0x7fb6140b0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:38.171 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.160+0000 7fb61c26d700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6140b05d0 con 0x7fb6140add70 2019-12-05T03:50:38.171 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.160+0000 7fb61c26d700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6140ae320 con 0x7fb614153990 2019-12-05T03:50:38.171 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.160+0000 7fb61c26d700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6140afde0 con 0x7fb6140b0c60 2019-12-05T03:50:38.171 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.160+0000 7fb61b00b700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fb614153990 0x7fb614153dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49476/0 (socket says 172.21.15.158:49476) 2019-12-05T03:50:38.172 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.160+0000 7fb61b00b700 1 -- 172.21.15.158:0/1587653464 learned_addr learned my addr 172.21.15.158:0/1587653464 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:38.172 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.160+0000 7fb61a009700 1 --2- 172.21.15.158:0/1587653464 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb6140b0c60 0x7fb6140b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:38.172 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.160+0000 7fb6077fe700 1 -- 172.21.15.158:0/1587653464 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2264228690 0 0) 0x7fb6140ae320 con 0x7fb614153990 2019-12-05T03:50:38.172 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.160+0000 7fb6077fe700 1 -- 172.21.15.158:0/1587653464 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5fc0030b0 con 0x7fb614153990 2019-12-05T03:50:38.172 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.160+0000 7fb6077fe700 1 -- 172.21.15.158:0/1587653464 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1345323432 0 0) 0x7fb6140b05d0 con 0x7fb6140add70 2019-12-05T03:50:38.172 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.160+0000 7fb6077fe700 1 -- 172.21.15.158:0/1587653464 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6140ae320 con 0x7fb6140add70 2019-12-05T03:50:38.172 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.160+0000 7fb61a009700 1 -- 172.21.15.158:0/1587653464 >> v1:172.21.15.158:6789/0 conn(0x7fb614153990 legacy=0x7fb614153dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:38.173 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.160+0000 7fb61a009700 1 -- 172.21.15.158:0/1587653464 >> v1:172.21.15.96:6789/0 conn(0x7fb6140add70 legacy=0x7fb614134730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:38.173 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.160+0000 7fb61a009700 1 -- 172.21.15.158:0/1587653464 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb614135250 con 0x7fb6140b0c60 2019-12-05T03:50:38.173 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.160+0000 7fb61a009700 1 --2- 172.21.15.158:0/1587653464 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb6140b0c60 0x7fb6140b0080 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb610002f30 tx=0x7fb610008df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:38.173 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.160+0000 7fb61a009700 1 --2- 172.21.15.158:0/1587653464 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb6140b0c60 0x7fb6140b0080 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb610002f30 tx=0x7fb610008df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:38.173 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.160+0000 7fb61a009700 1 --2- 172.21.15.158:0/1587653464 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb6140b0c60 0x7fb6140b0080 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7fb610002f30 tx=0x7fb610008df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:38.173 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.160+0000 7fb61a009700 1 --2- 172.21.15.158:0/1587653464 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb6140b0c60 0x7fb6140b0080 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7fb610002f30 tx=0x7fb610008df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:38.173 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.160+0000 7fb6077fe700 1 -- 172.21.15.158:0/1587653464 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb610007150 con 0x7fb6140b0c60 2019-12-05T03:50:38.174 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.160+0000 7fb61a009700 1 --2- 172.21.15.158:0/1587653464 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb6140b0c60 0x7fb6140b0080 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7fb610002f30 tx=0x7fb610008df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:38.174 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.160+0000 7fb61a009700 1 --2- 172.21.15.158:0/1587653464 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb6140b0c60 0x7fb6140b0080 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7fb610002f30 tx=0x7fb610008df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:38.174 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.160+0000 7fb6077fe700 1 -- 172.21.15.158:0/1587653464 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6100114b0 con 0x7fb6140b0c60 2019-12-05T03:50:38.174 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.160+0000 7fb6077fe700 1 -- 172.21.15.158:0/1587653464 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb61000f550 con 0x7fb6140b0c60 2019-12-05T03:50:38.174 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.160+0000 7fb61c26d700 1 -- 172.21.15.158:0/1587653464 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6140b1090 con 0x7fb6140b0c60 2019-12-05T03:50:38.174 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.160+0000 7fb61c26d700 1 -- 172.21.15.158:0/1587653464 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb61407ae10 con 0x7fb6140b0c60 2019-12-05T03:50:38.174 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.164+0000 7fb61a009700 1 --2- 172.21.15.158:0/1587653464 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb6140b0c60 0x7fb6140b0080 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7fb610002f30 tx=0x7fb610008df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:38.175 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.164+0000 7fb6077fe700 1 -- 172.21.15.158:0/1587653464 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fb610005540 con 0x7fb6140b0c60 2019-12-05T03:50:38.175 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.164+0000 7fb61a009700 1 --2- 172.21.15.158:0/1587653464 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb6140b0c60 0x7fb6140b0080 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7fb610002f30 tx=0x7fb610008df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:38.175 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.164+0000 7fb6077fe700 1 --2- 172.21.15.158:0/1587653464 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fb5fc03c520 0x7fb5fc03ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:38.175 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.164+0000 7fb6077fe700 1 -- 172.21.15.158:0/1587653464 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5286+0+0 (secure 0 0 0) 0x7fb61004b610 con 0x7fb6140b0c60 2019-12-05T03:50:38.175 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.164+0000 7fb61a80a700 1 --2- 172.21.15.158:0/1587653464 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fb5fc03c520 0x7fb5fc03ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:38.176 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.164+0000 7fb61a80a700 1 --2- 172.21.15.158:0/1587653464 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fb5fc03c520 0x7fb5fc03ea30 crc :-1 s=READY pgs=135 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:38.176 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.168+0000 7fb61c26d700 1 -- 172.21.15.158:0/1587653464 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6140554e0 con 0x7fb6140b0c60 2019-12-05T03:50:38.189 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.176+0000 7fb61a009700 1 --2- 172.21.15.158:0/1587653464 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb6140b0c60 0x7fb6140b0080 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7fb610002f30 tx=0x7fb610008df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:38.189 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.176+0000 7fb6077fe700 1 -- 172.21.15.158:0/1587653464 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fb6100328d0 con 0x7fb6140b0c60 2019-12-05T03:50:38.365 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:38.356+0000 7fb61c26d700 1 -- 172.21.15.158:0/1587653464 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fb614066940 con 0x7fb6140b0c60 2019-12-05T03:50:39.047 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.040+0000 7fb61a009700 1 --2- 172.21.15.158:0/1587653464 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb6140b0c60 0x7fb6140b0080 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7fb610002f30 tx=0x7fb610008df0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.047 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.040+0000 7fb6077fe700 1 -- 172.21.15.158:0/1587653464 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v28) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb610030290 con 0x7fb6140b0c60 2019-12-05T03:50:39.080 INFO:teuthology.orchestra.run.smithi158.stderr: removed all blacklist entries 2019-12-05T03:50:39.085 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.076+0000 7fb61c26d700 1 -- 172.21.15.158:0/1587653464 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fb5fc03c520 msgr2=0x7fb5fc03ea30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:39.085 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.076+0000 7fb61c26d700 1 --2- 172.21.15.158:0/1587653464 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fb5fc03c520 0x7fb5fc03ea30 crc :-1 s=READY pgs=135 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:39.085 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.076+0000 7fb61c26d700 1 -- 172.21.15.158:0/1587653464 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb6140b0c60 msgr2=0x7fb6140b0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:39.085 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.076+0000 7fb61c26d700 1 --2- 172.21.15.158:0/1587653464 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb6140b0c60 0x7fb6140b0080 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7fb610002f30 tx=0x7fb610008df0).stop 2019-12-05T03:50:39.085 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.076+0000 7fb61c26d700 1 -- 172.21.15.158:0/1587653464 shutdown_connections 2019-12-05T03:50:39.086 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.076+0000 7fb61c26d700 1 --2- 172.21.15.158:0/1587653464 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fb5fc03c520 0x7fb5fc03ea30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:39.086 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.076+0000 7fb61c26d700 1 --2- 172.21.15.158:0/1587653464 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fb6140b0c60 0x7fb6140b0080 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:39.086 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.076+0000 7fb61c26d700 1 -- 172.21.15.158:0/1587653464 shutdown_connections 2019-12-05T03:50:39.086 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.076+0000 7fb61c26d700 1 -- 172.21.15.158:0/1587653464 wait complete. 2019-12-05T03:50:39.086 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.076+0000 7fb61c26d700 1 -- 172.21.15.158:0/1587653464 >> 172.21.15.158:0/1587653464 conn(0x7fb6140b7e60 msgr2=0x7fb6140b3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:39.100 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2', '3'] 2019-12-05T03:50:39.101 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2019-12-05T03:50:39.205 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.192+0000 7f4debe13700 1 Processor -- start 2019-12-05T03:50:39.205 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.192+0000 7f4debe13700 1 -- start start 2019-12-05T03:50:39.205 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.192+0000 7f4debe13700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4de409a320 0x7f4de405a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:39.205 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.192+0000 7f4debe13700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4de41553b0 0x7f4de41557e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:39.206 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.192+0000 7f4debe13700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4de40accb0 con 0x7f4de409cf60 2019-12-05T03:50:39.206 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.192+0000 7f4debe13700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4de409a750 con 0x7f4de41553b0 2019-12-05T03:50:39.206 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.192+0000 7f4debe13700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de40b1730 con 0x7f4de409a320 2019-12-05T03:50:39.206 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.192+0000 7f4deabb1700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4de41553b0 0x7f4de41557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:39.206 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.196+0000 7f4deabb1700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4de41553b0 0x7f4de41557e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54704/0 (socket says 172.21.15.158:54704) 2019-12-05T03:50:39.206 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.196+0000 7f4deabb1700 1 -- 172.21.15.158:0/2273059469 learned_addr learned my addr 172.21.15.158:0/2273059469 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:39.206 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.196+0000 7f4de9baf700 1 --2- 172.21.15.158:0/2273059469 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4de409a320 0x7f4de405a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:39.207 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.196+0000 7f4deabb1700 1 -- 172.21.15.158:0/2273059469 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4de409a320 msgr2=0x7f4de405a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:39.207 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.196+0000 7f4deabb1700 1 --2- 172.21.15.158:0/2273059469 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4de409a320 0x7f4de405a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:39.207 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.196+0000 7f4deabb1700 1 -- 172.21.15.158:0/2273059469 >> v1:172.21.15.96:6789/0 conn(0x7f4de409cf60 legacy=0x7f4de4151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:39.207 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.196+0000 7f4deabb1700 1 -- 172.21.15.158:0/2273059469 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de40b6980 con 0x7f4de41553b0 2019-12-05T03:50:39.207 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.196+0000 7f4deabb1700 1 --2- 172.21.15.158:0/2273059469 >> v2:172.21.15.158:3300/0 conn(0x7f4de41553b0 0x7f4de41557e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4ddc008b10 tx=0x7f4ddc0100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.207 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.196+0000 7f4deabb1700 1 --2- 172.21.15.158:0/2273059469 >> v2:172.21.15.158:3300/0 conn(0x7f4de41553b0 0x7f4de41557e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4ddc008b10 tx=0x7f4ddc0100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.207 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.196+0000 7f4deabb1700 1 --2- 172.21.15.158:0/2273059469 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4de41553b0 0x7f4de41557e0 secure :-1 s=READY pgs=294 cs=0 l=1 rx=0x7f4ddc008b10 tx=0x7f4ddc0100b0).ready entity=mon.1 client_cookie=a7c2596971f18e44 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:39.208 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.196+0000 7f4deabb1700 1 --2- 172.21.15.158:0/2273059469 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4de41553b0 0x7f4de41557e0 secure :-1 s=THROTTLE_DONE pgs=294 cs=0 l=1 rx=0x7f4ddc008b10 tx=0x7f4ddc0100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.208 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.196+0000 7f4de93ae700 1 -- 172.21.15.158:0/2273059469 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ddc00a160 con 0x7f4de41553b0 2019-12-05T03:50:39.208 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.196+0000 7f4deabb1700 1 --2- 172.21.15.158:0/2273059469 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4de41553b0 0x7f4de41557e0 secure :-1 s=THROTTLE_DONE pgs=294 cs=0 l=1 rx=0x7f4ddc008b10 tx=0x7f4ddc0100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.208 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.196+0000 7f4deabb1700 1 --2- 172.21.15.158:0/2273059469 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4de41553b0 0x7f4de41557e0 secure :-1 s=THROTTLE_DONE pgs=294 cs=0 l=1 rx=0x7f4ddc008b10 tx=0x7f4ddc0100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.208 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.196+0000 7f4de93ae700 1 -- 172.21.15.158:0/2273059469 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ddc011a30 con 0x7f4de41553b0 2019-12-05T03:50:39.208 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.196+0000 7f4de93ae700 1 -- 172.21.15.158:0/2273059469 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ddc00a550 con 0x7f4de41553b0 2019-12-05T03:50:39.208 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.196+0000 7f4debe13700 1 -- 172.21.15.158:0/2273059469 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4de41553b0 msgr2=0x7f4de41557e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:39.209 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.196+0000 7f4debe13700 1 --2- 172.21.15.158:0/2273059469 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4de41553b0 0x7f4de41557e0 secure :-1 s=READY pgs=294 cs=0 l=1 rx=0x7f4ddc008b10 tx=0x7f4ddc0100b0).stop 2019-12-05T03:50:39.209 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.196+0000 7f4debe13700 1 -- 172.21.15.158:0/2273059469 shutdown_connections 2019-12-05T03:50:39.209 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.196+0000 7f4debe13700 1 --2- 172.21.15.158:0/2273059469 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4de41553b0 0x7f4de41557e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:39.209 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.196+0000 7f4debe13700 1 --2- 172.21.15.158:0/2273059469 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4de409a320 0x7f4de405a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:39.209 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.196+0000 7f4debe13700 1 -- 172.21.15.158:0/2273059469 shutdown_connections 2019-12-05T03:50:39.209 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.196+0000 7f4debe13700 1 -- 172.21.15.158:0/2273059469 wait complete. 2019-12-05T03:50:39.209 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.196+0000 7f4debe13700 1 -- 172.21.15.158:0/2273059469 >> 172.21.15.158:0/2273059469 conn(0x7f4de40b7e60 msgr2=0x7f4de40b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:39.213 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.200+0000 7f4debe13700 1 Processor -- start 2019-12-05T03:50:39.213 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.200+0000 7f4debe13700 1 -- start start 2019-12-05T03:50:39.213 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.200+0000 7f4debe13700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4de413b8c0 0x7f4de413ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:39.213 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.200+0000 7f4debe13700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4de413ca60 0x7f4de412b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:39.214 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.200+0000 7f4debe13700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4de412b7e0 0x7f4de40af7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:39.214 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.200+0000 7f4debe13700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4de413c020 con 0x7f4de412b7e0 2019-12-05T03:50:39.214 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.200+0000 7f4debe13700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4de413c280 con 0x7f4de413b8c0 2019-12-05T03:50:39.214 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.200+0000 7f4debe13700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de413c520 con 0x7f4de413ca60 2019-12-05T03:50:39.214 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.200+0000 7f4dea3b0700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4de413b8c0 0x7f4de413ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:39.214 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.200+0000 7f4dea3b0700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4de413b8c0 0x7f4de413ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54706/0 (socket says 172.21.15.158:54706) 2019-12-05T03:50:39.214 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.200+0000 7f4dea3b0700 1 -- 172.21.15.158:0/4146802740 learned_addr learned my addr 172.21.15.158:0/4146802740 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:39.215 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.200+0000 7f4deabb1700 1 --2- 172.21.15.158:0/4146802740 >> v2:172.21.15.96:3300/0 conn(0x7f4de412b7e0 0x7f4de40af7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:39.215 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.200+0000 7f4de9baf700 1 --2- 172.21.15.158:0/4146802740 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4de413ca60 0x7f4de412b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:39.215 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.200+0000 7f4dea3b0700 1 -- 172.21.15.158:0/4146802740 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4de413ca60 msgr2=0x7f4de412b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:39.215 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.200+0000 7f4dea3b0700 1 --2- 172.21.15.158:0/4146802740 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4de413ca60 0x7f4de412b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:39.215 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.200+0000 7f4dea3b0700 1 -- 172.21.15.158:0/4146802740 >> v2:172.21.15.96:3300/0 conn(0x7f4de412b7e0 msgr2=0x7f4de40af7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:39.215 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.200+0000 7f4dea3b0700 1 --2- 172.21.15.158:0/4146802740 >> v2:172.21.15.96:3300/0 conn(0x7f4de412b7e0 0x7f4de40af7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:39.215 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.200+0000 7f4dea3b0700 1 -- 172.21.15.158:0/4146802740 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de413bcf0 con 0x7f4de413b8c0 2019-12-05T03:50:39.216 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.200+0000 7f4dea3b0700 1 --2- 172.21.15.158:0/4146802740 >> v2:172.21.15.158:3300/0 conn(0x7f4de413b8c0 0x7f4de413ffc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4de413c440 tx=0x7f4de0010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.216 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.200+0000 7f4dea3b0700 1 --2- 172.21.15.158:0/4146802740 >> v2:172.21.15.158:3300/0 conn(0x7f4de413b8c0 0x7f4de413ffc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4de413c440 tx=0x7f4de0010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.216 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.200+0000 7f4dea3b0700 1 --2- 172.21.15.158:0/4146802740 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4de413b8c0 0x7f4de413ffc0 secure :-1 s=READY pgs=295 cs=0 l=1 rx=0x7f4de413c440 tx=0x7f4de0010a20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:39.216 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.200+0000 7f4dea3b0700 1 --2- 172.21.15.158:0/4146802740 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4de413b8c0 0x7f4de413ffc0 secure :-1 s=THROTTLE_DONE pgs=295 cs=0 l=1 rx=0x7f4de413c440 tx=0x7f4de0010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.216 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.200+0000 7f4dea3b0700 1 --2- 172.21.15.158:0/4146802740 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4de413b8c0 0x7f4de413ffc0 secure :-1 s=THROTTLE_DONE pgs=295 cs=0 l=1 rx=0x7f4de413c440 tx=0x7f4de0010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.216 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.200+0000 7f4ddaffd700 1 -- 172.21.15.158:0/4146802740 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4de000caa0 con 0x7f4de413b8c0 2019-12-05T03:50:39.216 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.200+0000 7f4dea3b0700 1 --2- 172.21.15.158:0/4146802740 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4de413b8c0 0x7f4de413ffc0 secure :-1 s=THROTTLE_DONE pgs=295 cs=0 l=1 rx=0x7f4de413c440 tx=0x7f4de0010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.217 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.200+0000 7f4ddaffd700 1 -- 172.21.15.158:0/4146802740 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de000c6c0 con 0x7f4de413b8c0 2019-12-05T03:50:39.217 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.200+0000 7f4ddaffd700 1 -- 172.21.15.158:0/4146802740 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4de0012250 con 0x7f4de413b8c0 2019-12-05T03:50:39.217 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.200+0000 7f4debe13700 1 -- 172.21.15.158:0/4146802740 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4de4064ad0 con 0x7f4de413b8c0 2019-12-05T03:50:39.217 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.200+0000 7f4debe13700 1 -- 172.21.15.158:0/4146802740 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de413ce90 con 0x7f4de413b8c0 2019-12-05T03:50:39.217 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.204+0000 7f4dea3b0700 1 --2- 172.21.15.158:0/4146802740 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4de413b8c0 0x7f4de413ffc0 secure :-1 s=THROTTLE_DONE pgs=295 cs=0 l=1 rx=0x7f4de413c440 tx=0x7f4de0010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.217 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.204+0000 7f4ddaffd700 1 -- 172.21.15.158:0/4146802740 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f4de0012520 con 0x7f4de413b8c0 2019-12-05T03:50:39.217 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.204+0000 7f4dea3b0700 1 --2- 172.21.15.158:0/4146802740 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4de413b8c0 0x7f4de413ffc0 secure :-1 s=THROTTLE_DONE pgs=295 cs=0 l=1 rx=0x7f4de413c440 tx=0x7f4de0010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.218 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.204+0000 7f4ddaffd700 1 --2- 172.21.15.158:0/4146802740 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f4dcc03add0 0x7f4dcc03d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:39.218 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.204+0000 7f4ddaffd700 1 -- 172.21.15.158:0/4146802740 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f4de004b250 con 0x7f4de413b8c0 2019-12-05T03:50:39.218 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.204+0000 7f4de9baf700 1 --2- 172.21.15.158:0/4146802740 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f4dcc03add0 0x7f4dcc03d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:39.218 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.204+0000 7f4de9baf700 1 --2- 172.21.15.158:0/4146802740 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f4dcc03add0 0x7f4dcc03d2e0 crc :-1 s=READY pgs=136 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:39.218 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.208+0000 7f4debe13700 1 -- 172.21.15.158:0/4146802740 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4de40554e0 con 0x7f4de413b8c0 2019-12-05T03:50:39.221 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.216+0000 7f4dea3b0700 1 --2- 172.21.15.158:0/4146802740 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4de413b8c0 0x7f4de413ffc0 secure :-1 s=THROTTLE_DONE pgs=295 cs=0 l=1 rx=0x7f4de413c440 tx=0x7f4de0010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.222 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.216+0000 7f4ddaffd700 1 -- 172.21.15.158:0/4146802740 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f4de00322d0 con 0x7f4de413b8c0 2019-12-05T03:50:39.380 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.372+0000 7f4debe13700 1 -- 172.21.15.158:0/4146802740 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4de40b6180 con 0x7f4de413b8c0 2019-12-05T03:50:39.381 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.376+0000 7f4dea3b0700 1 --2- 172.21.15.158:0/4146802740 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4de413b8c0 0x7f4de413ffc0 secure :-1 s=THROTTLE_DONE pgs=295 cs=0 l=1 rx=0x7f4de413c440 tx=0x7f4de0010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.381 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.376+0000 7f4ddaffd700 1 -- 172.21.15.158:0/4146802740 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+5917 (secure 0 0 0) 0x7f4de0032530 con 0x7f4de413b8c0 2019-12-05T03:50:39.383 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:39.383 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2019-12-05T03:50:39.384 INFO:teuthology.orchestra.run.smithi158.stdout: "auth_dump": [ 2019-12-05T03:50:39.384 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:39.384 INFO:teuthology.orchestra.run.smithi158.stdout: "entity": "mds.a", 2019-12-05T03:50:39.384 INFO:teuthology.orchestra.run.smithi158.stdout: "key": "AQAqfuhdOuUWOhAAoINSdxLi+c9akvDm9oJUWg==", 2019-12-05T03:50:39.384 INFO:teuthology.orchestra.run.smithi158.stdout: "caps": { 2019-12-05T03:50:39.384 INFO:teuthology.orchestra.run.smithi158.stdout: "mds": "allow", 2019-12-05T03:50:39.385 INFO:teuthology.orchestra.run.smithi158.stdout: "mgr": "allow *", 2019-12-05T03:50:39.385 INFO:teuthology.orchestra.run.smithi158.stdout: "mon": "allow *", 2019-12-05T03:50:39.385 INFO:teuthology.orchestra.run.smithi158.stdout: "osd": "allow *" 2019-12-05T03:50:39.385 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:39.385 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:39.385 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:39.385 INFO:teuthology.orchestra.run.smithi158.stdout: "entity": "mds.b", 2019-12-05T03:50:39.386 INFO:teuthology.orchestra.run.smithi158.stdout: "key": "AQArfuhdPD3pBRAAX9g/5tufJZr7PJYvyLWsKg==", 2019-12-05T03:50:39.386 INFO:teuthology.orchestra.run.smithi158.stdout: "caps": { 2019-12-05T03:50:39.386 INFO:teuthology.orchestra.run.smithi158.stdout: "mds": "allow", 2019-12-05T03:50:39.386 INFO:teuthology.orchestra.run.smithi158.stdout: "mgr": "allow *", 2019-12-05T03:50:39.386 INFO:teuthology.orchestra.run.smithi158.stdout: "mon": "allow *", 2019-12-05T03:50:39.386 INFO:teuthology.orchestra.run.smithi158.stdout: "osd": "allow *" 2019-12-05T03:50:39.386 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:39.387 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:39.387 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:39.387 INFO:teuthology.orchestra.run.smithi158.stdout: "entity": "osd.0", 2019-12-05T03:50:39.387 INFO:teuthology.orchestra.run.smithi158.stdout: "key": "AQAufuhddWxFHhAAbBwVGRlTYaQITsRya6euig==", 2019-12-05T03:50:39.387 INFO:teuthology.orchestra.run.smithi158.stdout: "caps": { 2019-12-05T03:50:39.387 INFO:teuthology.orchestra.run.smithi158.stdout: "mgr": "allow *", 2019-12-05T03:50:39.387 INFO:teuthology.orchestra.run.smithi158.stdout: "mon": "allow *", 2019-12-05T03:50:39.387 INFO:teuthology.orchestra.run.smithi158.stdout: "osd": "allow *" 2019-12-05T03:50:39.388 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:39.388 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:39.388 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:39.388 INFO:teuthology.orchestra.run.smithi158.stdout: "entity": "osd.1", 2019-12-05T03:50:39.388 INFO:teuthology.orchestra.run.smithi158.stdout: "key": "AQAxfuhdVoOOCRAAocisawAV9hfkZmvhGUgexA==", 2019-12-05T03:50:39.388 INFO:teuthology.orchestra.run.smithi158.stdout: "caps": { 2019-12-05T03:50:39.389 INFO:teuthology.orchestra.run.smithi158.stdout: "mgr": "allow *", 2019-12-05T03:50:39.389 INFO:teuthology.orchestra.run.smithi158.stdout: "mon": "allow *", 2019-12-05T03:50:39.389 INFO:teuthology.orchestra.run.smithi158.stdout: "osd": "allow *" 2019-12-05T03:50:39.389 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:39.389 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:39.389 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:39.389 INFO:teuthology.orchestra.run.smithi158.stdout: "entity": "osd.2", 2019-12-05T03:50:39.389 INFO:teuthology.orchestra.run.smithi158.stdout: "key": "AQAzfuhd/+haMBAApP7Fbn8Ne56AXjF/QUlYTQ==", 2019-12-05T03:50:39.390 INFO:teuthology.orchestra.run.smithi158.stdout: "caps": { 2019-12-05T03:50:39.390 INFO:teuthology.orchestra.run.smithi158.stdout: "mgr": "allow *", 2019-12-05T03:50:39.390 INFO:teuthology.orchestra.run.smithi158.stdout: "mon": "allow *", 2019-12-05T03:50:39.390 INFO:teuthology.orchestra.run.smithi158.stdout: "osd": "allow *" 2019-12-05T03:50:39.390 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:39.390 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:39.390 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:39.391 INFO:teuthology.orchestra.run.smithi158.stdout: "entity": "osd.3", 2019-12-05T03:50:39.391 INFO:teuthology.orchestra.run.smithi158.stdout: "key": "AQA2fuhdkc8tGxAAxRpqQvx8dg/Jf1/K/NAP+Q==", 2019-12-05T03:50:39.391 INFO:teuthology.orchestra.run.smithi158.stdout: "caps": { 2019-12-05T03:50:39.391 INFO:teuthology.orchestra.run.smithi158.stdout: "mgr": "allow *", 2019-12-05T03:50:39.391 INFO:teuthology.orchestra.run.smithi158.stdout: "mon": "allow *", 2019-12-05T03:50:39.391 INFO:teuthology.orchestra.run.smithi158.stdout: "osd": "allow *" 2019-12-05T03:50:39.391 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:39.392 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:39.392 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:39.392 INFO:teuthology.orchestra.run.smithi158.stdout: "entity": "osd.4", 2019-12-05T03:50:39.392 INFO:teuthology.orchestra.run.smithi158.stdout: "key": "AQA7fuhdF855OxAAdUIf+MQAoMcnQyp6LW005g==", 2019-12-05T03:50:39.392 INFO:teuthology.orchestra.run.smithi158.stdout: "caps": { 2019-12-05T03:50:39.392 INFO:teuthology.orchestra.run.smithi158.stdout: "mgr": "allow *", 2019-12-05T03:50:39.392 INFO:teuthology.orchestra.run.smithi158.stdout: "mon": "allow *", 2019-12-05T03:50:39.393 INFO:teuthology.orchestra.run.smithi158.stdout: "osd": "allow *" 2019-12-05T03:50:39.393 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:39.393 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:39.393 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:39.394 INFO:teuthology.orchestra.run.smithi158.stdout: "entity": "osd.5", 2019-12-05T03:50:39.394 INFO:teuthology.orchestra.run.smithi158.stdout: "key": "AQA+fuhdQYpaIhAA2AG4bBEBZ8HCyJ/K3ekMXw==", 2019-12-05T03:50:39.394 INFO:teuthology.orchestra.run.smithi158.stdout: "caps": { 2019-12-05T03:50:39.394 INFO:teuthology.orchestra.run.smithi158.stdout: "mgr": "allow *", 2019-12-05T03:50:39.394 INFO:teuthology.orchestra.run.smithi158.stdout: "mon": "allow *", 2019-12-05T03:50:39.394 INFO:teuthology.orchestra.run.smithi158.stdout: "osd": "allow *" 2019-12-05T03:50:39.394 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:39.394 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:39.395 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:39.395 INFO:teuthology.orchestra.run.smithi158.stdout: "entity": "osd.6", 2019-12-05T03:50:39.396 INFO:teuthology.orchestra.run.smithi158.stdout: "key": "AQBBfuhdPnREDBAAVzDpx6Lod7yojRiF1kDC2A==", 2019-12-05T03:50:39.396 INFO:teuthology.orchestra.run.smithi158.stdout: "caps": { 2019-12-05T03:50:39.396 INFO:teuthology.orchestra.run.smithi158.stdout: "mgr": "allow *", 2019-12-05T03:50:39.396 INFO:teuthology.orchestra.run.smithi158.stdout: "mon": "allow *", 2019-12-05T03:50:39.396 INFO:teuthology.orchestra.run.smithi158.stdout: "osd": "allow *" 2019-12-05T03:50:39.396 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:39.396 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:39.397 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:39.397 INFO:teuthology.orchestra.run.smithi158.stdout: "entity": "osd.7", 2019-12-05T03:50:39.397 INFO:teuthology.orchestra.run.smithi158.stdout: "key": "AQBDfuhd8zt1MRAApdsqSze/na0dmD2Otn/SoQ==", 2019-12-05T03:50:39.397 INFO:teuthology.orchestra.run.smithi158.stdout: "caps": { 2019-12-05T03:50:39.397 INFO:teuthology.orchestra.run.smithi158.stdout: "mgr": "allow *", 2019-12-05T03:50:39.397 INFO:teuthology.orchestra.run.smithi158.stdout: "mon": "allow *", 2019-12-05T03:50:39.397 INFO:teuthology.orchestra.run.smithi158.stdout: "osd": "allow *" 2019-12-05T03:50:39.398 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:39.398 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:39.398 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:39.398 INFO:teuthology.orchestra.run.smithi158.stdout: "entity": "client.0", 2019-12-05T03:50:39.398 INFO:teuthology.orchestra.run.smithi158.stdout: "key": "AQArfuhdz0LcDBAACZcU6mxbAU8zR0OFiUJRCQ==", 2019-12-05T03:50:39.398 INFO:teuthology.orchestra.run.smithi158.stdout: "caps": { 2019-12-05T03:50:39.398 INFO:teuthology.orchestra.run.smithi158.stdout: "mds": "allow", 2019-12-05T03:50:39.399 INFO:teuthology.orchestra.run.smithi158.stdout: "mgr": "allow r", 2019-12-05T03:50:39.399 INFO:teuthology.orchestra.run.smithi158.stdout: "mon": "allow rw", 2019-12-05T03:50:39.399 INFO:teuthology.orchestra.run.smithi158.stdout: "osd": "allow rwx" 2019-12-05T03:50:39.399 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:39.399 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:39.399 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:39.399 INFO:teuthology.orchestra.run.smithi158.stdout: "entity": "client.1", 2019-12-05T03:50:39.400 INFO:teuthology.orchestra.run.smithi158.stdout: "key": "AQArfuhdw3V3ExAAjBQoBr2WI4VgWJQr76zqGA==", 2019-12-05T03:50:39.400 INFO:teuthology.orchestra.run.smithi158.stdout: "caps": { 2019-12-05T03:50:39.400 INFO:teuthology.orchestra.run.smithi158.stdout: "mds": "allow", 2019-12-05T03:50:39.400 INFO:teuthology.orchestra.run.smithi158.stdout: "mgr": "allow r", 2019-12-05T03:50:39.400 INFO:teuthology.orchestra.run.smithi158.stdout: "mon": "allow rw", 2019-12-05T03:50:39.400 INFO:teuthology.orchestra.run.smithi158.stdout: "osd": "allow rwx" 2019-12-05T03:50:39.400 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:39.401 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:39.401 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:39.401 INFO:teuthology.orchestra.run.smithi158.stdout: "entity": "client.2", 2019-12-05T03:50:39.401 INFO:teuthology.orchestra.run.smithi158.stdout: "key": "AQArfuhdDDxJFhAAwyalbbARbe3jGAfdfxKZ1A==", 2019-12-05T03:50:39.401 INFO:teuthology.orchestra.run.smithi158.stdout: "caps": { 2019-12-05T03:50:39.401 INFO:teuthology.orchestra.run.smithi158.stdout: "mds": "allow", 2019-12-05T03:50:39.401 INFO:teuthology.orchestra.run.smithi158.stdout: "mgr": "allow r", 2019-12-05T03:50:39.402 INFO:teuthology.orchestra.run.smithi158.stdout: "mon": "allow rw", 2019-12-05T03:50:39.402 INFO:teuthology.orchestra.run.smithi158.stdout: "osd": "allow rwx" 2019-12-05T03:50:39.402 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:39.402 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:39.402 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:39.402 INFO:teuthology.orchestra.run.smithi158.stdout: "entity": "client.3", 2019-12-05T03:50:39.402 INFO:teuthology.orchestra.run.smithi158.stdout: "key": "AQArfuhd4lLZHBAARKHJdQL/oNV2TDCfFy+8iQ==", 2019-12-05T03:50:39.403 INFO:teuthology.orchestra.run.smithi158.stdout: "caps": { 2019-12-05T03:50:39.403 INFO:teuthology.orchestra.run.smithi158.stdout: "mds": "allow", 2019-12-05T03:50:39.403 INFO:teuthology.orchestra.run.smithi158.stdout: "mgr": "allow r", 2019-12-05T03:50:39.403 INFO:teuthology.orchestra.run.smithi158.stdout: "mon": "allow rw", 2019-12-05T03:50:39.403 INFO:teuthology.orchestra.run.smithi158.stdout: "osd": "allow rwx" 2019-12-05T03:50:39.404 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:39.404 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:39.404 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:39.404 INFO:teuthology.orchestra.run.smithi158.stdout: "entity": "client.admin", 2019-12-05T03:50:39.404 INFO:teuthology.orchestra.run.smithi158.stdout: "key": "AQAqfuhdMG5dFhAA70+sa/aKbqn6Pi4doguYvQ==", 2019-12-05T03:50:39.405 INFO:teuthology.orchestra.run.smithi158.stdout: "caps": { 2019-12-05T03:50:39.405 INFO:teuthology.orchestra.run.smithi158.stdout: "mds": "allow *", 2019-12-05T03:50:39.405 INFO:teuthology.orchestra.run.smithi158.stdout: "mgr": "allow *", 2019-12-05T03:50:39.405 INFO:teuthology.orchestra.run.smithi158.stdout: "mon": "allow *", 2019-12-05T03:50:39.405 INFO:teuthology.orchestra.run.smithi158.stdout: "osd": "allow *" 2019-12-05T03:50:39.405 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:39.405 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:39.405 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:39.406 INFO:teuthology.orchestra.run.smithi158.stdout: "entity": "client.bootstrap-mds", 2019-12-05T03:50:39.406 INFO:teuthology.orchestra.run.smithi158.stdout: "key": "AQBTfuhdxiVPCxAAGPck4lLVmPcKyJBxUw5PSA==", 2019-12-05T03:50:39.406 INFO:teuthology.orchestra.run.smithi158.stdout: "caps": { 2019-12-05T03:50:39.406 INFO:teuthology.orchestra.run.smithi158.stdout: "mon": "allow profile bootstrap-mds" 2019-12-05T03:50:39.406 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:39.406 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:39.406 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:39.407 INFO:teuthology.orchestra.run.smithi158.stdout: "entity": "client.bootstrap-mgr", 2019-12-05T03:50:39.407 INFO:teuthology.orchestra.run.smithi158.stdout: "key": "AQBTfuhdfkBPCxAAAs0dBBK8urW4mOLuFdYMXw==", 2019-12-05T03:50:39.407 INFO:teuthology.orchestra.run.smithi158.stdout: "caps": { 2019-12-05T03:50:39.407 INFO:teuthology.orchestra.run.smithi158.stdout: "mon": "allow profile bootstrap-mgr" 2019-12-05T03:50:39.407 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:39.407 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:39.407 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:39.408 INFO:teuthology.orchestra.run.smithi158.stdout: "entity": "client.bootstrap-osd", 2019-12-05T03:50:39.408 INFO:teuthology.orchestra.run.smithi158.stdout: "key": "AQBTfuhdE1hPCxAAQyfyglZQX03STLJblClqPQ==", 2019-12-05T03:50:39.408 INFO:teuthology.orchestra.run.smithi158.stdout: "caps": { 2019-12-05T03:50:39.408 INFO:teuthology.orchestra.run.smithi158.stdout: "mon": "allow profile bootstrap-osd" 2019-12-05T03:50:39.408 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:39.408 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:39.408 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:39.409 INFO:teuthology.orchestra.run.smithi158.stdout: "entity": "client.bootstrap-rbd", 2019-12-05T03:50:39.409 INFO:teuthology.orchestra.run.smithi158.stdout: "key": "AQBTfuhdPHNPCxAApvGxyoH6qrxoP45ldRNvFg==", 2019-12-05T03:50:39.409 INFO:teuthology.orchestra.run.smithi158.stdout: "caps": { 2019-12-05T03:50:39.409 INFO:teuthology.orchestra.run.smithi158.stdout: "mon": "allow profile bootstrap-rbd" 2019-12-05T03:50:39.409 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:39.409 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:39.409 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:39.410 INFO:teuthology.orchestra.run.smithi158.stdout: "entity": "client.bootstrap-rbd-mirror", 2019-12-05T03:50:39.410 INFO:teuthology.orchestra.run.smithi158.stdout: "key": "AQBTfuhduIxPCxAAYTxepUF9A30QjpHKZHEgxA==", 2019-12-05T03:50:39.410 INFO:teuthology.orchestra.run.smithi158.stdout: "caps": { 2019-12-05T03:50:39.410 INFO:teuthology.orchestra.run.smithi158.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2019-12-05T03:50:39.410 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:39.410 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:39.410 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:39.410 INFO:teuthology.orchestra.run.smithi158.stdout: "entity": "client.bootstrap-rgw", 2019-12-05T03:50:39.411 INFO:teuthology.orchestra.run.smithi158.stdout: "key": "AQBTfuhd6aRPCxAAypYge0p6gjg4mvA3BhuKrQ==", 2019-12-05T03:50:39.411 INFO:teuthology.orchestra.run.smithi158.stdout: "caps": { 2019-12-05T03:50:39.411 INFO:teuthology.orchestra.run.smithi158.stdout: "mon": "allow profile bootstrap-rgw" 2019-12-05T03:50:39.411 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:39.411 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:39.411 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:39.411 INFO:teuthology.orchestra.run.smithi158.stdout: "entity": "mgr.x", 2019-12-05T03:50:39.412 INFO:teuthology.orchestra.run.smithi158.stdout: "key": "AQAqfuhdizfeNhAA5Q4kkpEPSZ1C/Yak1ZAN2Q==", 2019-12-05T03:50:39.412 INFO:teuthology.orchestra.run.smithi158.stdout: "caps": { 2019-12-05T03:50:39.412 INFO:teuthology.orchestra.run.smithi158.stdout: "mds": "allow *", 2019-12-05T03:50:39.412 INFO:teuthology.orchestra.run.smithi158.stdout: "mon": "allow profile mgr", 2019-12-05T03:50:39.412 INFO:teuthology.orchestra.run.smithi158.stdout: "osd": "allow *" 2019-12-05T03:50:39.416 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:39.416 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:39.417 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:39.417 INFO:teuthology.orchestra.run.smithi158.stdout: "entity": "mgr.y", 2019-12-05T03:50:39.417 INFO:teuthology.orchestra.run.smithi158.stdout: "key": "AQAqfuhdjEH5MxAA033BbVQh6fXn/TAcllODbQ==", 2019-12-05T03:50:39.417 INFO:teuthology.orchestra.run.smithi158.stdout: "caps": { 2019-12-05T03:50:39.417 INFO:teuthology.orchestra.run.smithi158.stdout: "mds": "allow *", 2019-12-05T03:50:39.417 INFO:teuthology.orchestra.run.smithi158.stdout: "mon": "allow profile mgr", 2019-12-05T03:50:39.417 INFO:teuthology.orchestra.run.smithi158.stdout: "osd": "allow *" 2019-12-05T03:50:39.418 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:39.418 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:39.418 INFO:teuthology.orchestra.run.smithi158.stdout: ] 2019-12-05T03:50:39.418 INFO:teuthology.orchestra.run.smithi158.stdout:} 2019-12-05T03:50:39.421 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.380+0000 7f4debe13700 1 -- 172.21.15.158:0/4146802740 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f4dcc03add0 msgr2=0x7f4dcc03d2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:39.421 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.380+0000 7f4debe13700 1 --2- 172.21.15.158:0/4146802740 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f4dcc03add0 0x7f4dcc03d2e0 crc :-1 s=READY pgs=136 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:39.421 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.380+0000 7f4debe13700 1 -- 172.21.15.158:0/4146802740 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4de413b8c0 msgr2=0x7f4de413ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:39.421 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.380+0000 7f4debe13700 1 --2- 172.21.15.158:0/4146802740 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4de413b8c0 0x7f4de413ffc0 secure :-1 s=READY pgs=295 cs=0 l=1 rx=0x7f4de413c440 tx=0x7f4de0010a20).stop 2019-12-05T03:50:39.421 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.380+0000 7f4debe13700 1 -- 172.21.15.158:0/4146802740 shutdown_connections 2019-12-05T03:50:39.421 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.380+0000 7f4debe13700 1 --2- 172.21.15.158:0/4146802740 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f4dcc03add0 0x7f4dcc03d2e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:39.422 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.380+0000 7f4debe13700 1 --2- 172.21.15.158:0/4146802740 >> v2:172.21.15.96:3300/0 conn(0x7f4de412b7e0 0x7f4de40af7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:39.422 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.380+0000 7f4debe13700 1 --2- 172.21.15.158:0/4146802740 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4de413b8c0 0x7f4de413ffc0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:39.422 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.380+0000 7f4debe13700 1 --2- 172.21.15.158:0/4146802740 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4de413ca60 0x7f4de412b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:39.422 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.380+0000 7f4debe13700 1 -- 172.21.15.158:0/4146802740 shutdown_connections 2019-12-05T03:50:39.422 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.380+0000 7f4debe13700 1 -- 172.21.15.158:0/4146802740 wait complete. 2019-12-05T03:50:39.422 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.380+0000 7f4debe13700 1 -- 172.21.15.158:0/4146802740 >> 172.21.15.158:0/4146802740 conn(0x7f4de407e400 msgr2=0x7f4de4155320 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:39.423 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2019-12-05T03:50:39.514 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.500+0000 7ff82ac51700 1 Processor -- start 2019-12-05T03:50:39.514 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.500+0000 7ff82ac51700 1 -- start start 2019-12-05T03:50:39.514 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.504+0000 7ff82ac51700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff82409cf60 0x7ff82409a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:39.514 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.504+0000 7ff82ac51700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff8241553b0 0x7ff8241557e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:39.515 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.504+0000 7ff82ac51700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8240accb0 con 0x7ff82405a740 2019-12-05T03:50:39.515 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.504+0000 7ff82ac51700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8240b1730 con 0x7ff8241553b0 2019-12-05T03:50:39.515 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.504+0000 7ff82ac51700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8240b19d0 con 0x7ff82409cf60 2019-12-05T03:50:39.515 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.504+0000 7ff8291ee700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff82409cf60 0x7ff82409a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:39.515 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.504+0000 7ff8299ef700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff8241553b0 0x7ff8241557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:39.515 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.504+0000 7ff8289ed700 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7ff82405a740 0x7ff824151460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.158:44630/0 (socket says 172.21.15.158:44630) 2019-12-05T03:50:39.516 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.504+0000 7ff8291ee700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff82409cf60 0x7ff82409a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.158:37454/0 (socket says 172.21.15.158:37454) 2019-12-05T03:50:39.516 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.504+0000 7ff8289ed700 1 -- 172.21.15.158:0/3194404866 learned_addr learned my addr 172.21.15.158:0/3194404866 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:39.516 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.504+0000 7ff8291ee700 1 -- 172.21.15.158:0/3194404866 >> v2:172.21.15.96:3300/0 conn(0x7ff8241553b0 msgr2=0x7ff8241557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:39.516 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.504+0000 7ff8291ee700 1 --2- 172.21.15.158:0/3194404866 >> v2:172.21.15.96:3300/0 conn(0x7ff8241553b0 0x7ff8241557e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:39.516 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.504+0000 7ff8291ee700 1 -- 172.21.15.158:0/3194404866 >> v1:172.21.15.96:6789/0 conn(0x7ff82405a740 legacy=0x7ff824151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:39.516 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.504+0000 7ff8291ee700 1 -- 172.21.15.158:0/3194404866 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82405ab70 con 0x7ff82409cf60 2019-12-05T03:50:39.516 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.504+0000 7ff8291ee700 1 --2- 172.21.15.158:0/3194404866 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff82409cf60 0x7ff82409a320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff814008b10 tx=0x7ff81400fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.517 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.504+0000 7ff8291ee700 1 --2- 172.21.15.158:0/3194404866 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff82409cf60 0x7ff82409a320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff814008b10 tx=0x7ff81400fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.517 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.504+0000 7ff8291ee700 1 --2- 172.21.15.158:0/3194404866 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff82409cf60 0x7ff82409a320 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7ff814008b10 tx=0x7ff81400fff0).ready entity=mon.2 client_cookie=9c1e109f033496a4 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:39.517 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.504+0000 7ff8291ee700 1 --2- 172.21.15.158:0/3194404866 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff82409cf60 0x7ff82409a320 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7ff814008b10 tx=0x7ff81400fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.517 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.504+0000 7ff823fff700 1 -- 172.21.15.158:0/3194404866 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff814011a50 con 0x7ff82409cf60 2019-12-05T03:50:39.517 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.504+0000 7ff8291ee700 1 --2- 172.21.15.158:0/3194404866 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff82409cf60 0x7ff82409a320 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7ff814008b10 tx=0x7ff81400fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.517 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.504+0000 7ff8291ee700 1 --2- 172.21.15.158:0/3194404866 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff82409cf60 0x7ff82409a320 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7ff814008b10 tx=0x7ff81400fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.518 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.504+0000 7ff823fff700 1 -- 172.21.15.158:0/3194404866 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff814011670 con 0x7ff82409cf60 2019-12-05T03:50:39.518 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.504+0000 7ff823fff700 1 -- 172.21.15.158:0/3194404866 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff81400a350 con 0x7ff82409cf60 2019-12-05T03:50:39.518 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.504+0000 7ff82ac51700 1 -- 172.21.15.158:0/3194404866 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff82409cf60 msgr2=0x7ff82409a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:39.518 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.504+0000 7ff82ac51700 1 --2- 172.21.15.158:0/3194404866 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff82409cf60 0x7ff82409a320 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7ff814008b10 tx=0x7ff81400fff0).stop 2019-12-05T03:50:39.518 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.504+0000 7ff82ac51700 1 -- 172.21.15.158:0/3194404866 shutdown_connections 2019-12-05T03:50:39.518 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.504+0000 7ff82ac51700 1 --2- 172.21.15.158:0/3194404866 >> v2:172.21.15.96:3300/0 conn(0x7ff8241553b0 0x7ff8241557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:39.519 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.504+0000 7ff82ac51700 1 --2- 172.21.15.158:0/3194404866 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7ff82409cf60 0x7ff82409a320 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:39.519 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.504+0000 7ff82ac51700 1 -- 172.21.15.158:0/3194404866 shutdown_connections 2019-12-05T03:50:39.519 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.504+0000 7ff82ac51700 1 -- 172.21.15.158:0/3194404866 wait complete. 2019-12-05T03:50:39.519 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.504+0000 7ff82ac51700 1 -- 172.21.15.158:0/3194404866 >> 172.21.15.158:0/3194404866 conn(0x7ff8240b7e60 msgr2=0x7ff8240b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:39.523 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.508+0000 7ff82ac51700 1 Processor -- start 2019-12-05T03:50:39.523 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.508+0000 7ff82ac51700 1 -- start start 2019-12-05T03:50:39.523 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.512+0000 7ff82ac51700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff8240b0d20 0x7ff824125f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:39.523 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.512+0000 7ff82ac51700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff82407d550 0x7ff82407d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:39.524 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.512+0000 7ff82ac51700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8240ae750 con 0x7ff8240b1da0 2019-12-05T03:50:39.524 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.512+0000 7ff82ac51700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8240ae210 con 0x7ff82407d550 2019-12-05T03:50:39.524 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.512+0000 7ff82ac51700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8240ae4b0 con 0x7ff8240b0d20 2019-12-05T03:50:39.524 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.512+0000 7ff8291ee700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff8240b0d20 0x7ff824125f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:39.524 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.512+0000 7ff8291ee700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7ff8240b0d20 0x7ff824125f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54722/0 (socket says 172.21.15.158:54722) 2019-12-05T03:50:39.524 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.512+0000 7ff8291ee700 1 -- 172.21.15.158:0/3088526414 learned_addr learned my addr 172.21.15.158:0/3088526414 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:39.524 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.512+0000 7ff8289ed700 1 --2- 172.21.15.158:0/3088526414 >> v2:172.21.15.96:3300/0 conn(0x7ff82407d550 0x7ff82407d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:39.525 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.512+0000 7ff8291ee700 1 -- 172.21.15.158:0/3088526414 >> v2:172.21.15.96:3300/0 conn(0x7ff82407d550 msgr2=0x7ff82407d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:39.525 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.512+0000 7ff8291ee700 1 --2- 172.21.15.158:0/3088526414 >> v2:172.21.15.96:3300/0 conn(0x7ff82407d550 0x7ff82407d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:39.525 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.512+0000 7ff8291ee700 1 -- 172.21.15.158:0/3088526414 >> v1:172.21.15.96:6789/0 conn(0x7ff8240b1da0 legacy=0x7ff8240b21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:39.525 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.512+0000 7ff8291ee700 1 -- 172.21.15.158:0/3088526414 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff824154fe0 con 0x7ff8240b0d20 2019-12-05T03:50:39.525 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.512+0000 7ff8291ee700 1 --2- 172.21.15.158:0/3088526414 >> v2:172.21.15.158:3300/0 conn(0x7ff8240b0d20 0x7ff824125f30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff814008b10 tx=0x7ff814011920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.525 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.512+0000 7ff8291ee700 1 --2- 172.21.15.158:0/3088526414 >> v2:172.21.15.158:3300/0 conn(0x7ff8240b0d20 0x7ff824125f30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff814008b10 tx=0x7ff814011920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.525 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.512+0000 7ff8291ee700 1 --2- 172.21.15.158:0/3088526414 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff8240b0d20 0x7ff824125f30 secure :-1 s=READY pgs=296 cs=0 l=1 rx=0x7ff814008b10 tx=0x7ff814011920).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:39.526 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.512+0000 7ff8291ee700 1 --2- 172.21.15.158:0/3088526414 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff8240b0d20 0x7ff824125f30 secure :-1 s=THROTTLE_DONE pgs=296 cs=0 l=1 rx=0x7ff814008b10 tx=0x7ff814011920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.526 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.512+0000 7ff821ffb700 1 -- 172.21.15.158:0/3088526414 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff81400f760 con 0x7ff8240b0d20 2019-12-05T03:50:39.526 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.512+0000 7ff8291ee700 1 --2- 172.21.15.158:0/3088526414 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff8240b0d20 0x7ff824125f30 secure :-1 s=THROTTLE_DONE pgs=296 cs=0 l=1 rx=0x7ff814008b10 tx=0x7ff814011920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.526 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.512+0000 7ff8291ee700 1 --2- 172.21.15.158:0/3088526414 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff8240b0d20 0x7ff824125f30 secure :-1 s=THROTTLE_DONE pgs=296 cs=0 l=1 rx=0x7ff814008b10 tx=0x7ff814011920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.526 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.512+0000 7ff821ffb700 1 -- 172.21.15.158:0/3088526414 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff814011c50 con 0x7ff8240b0d20 2019-12-05T03:50:39.526 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.512+0000 7ff82ac51700 1 -- 172.21.15.158:0/3088526414 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff824134170 con 0x7ff8240b0d20 2019-12-05T03:50:39.527 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.512+0000 7ff821ffb700 1 -- 172.21.15.158:0/3088526414 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff81400a810 con 0x7ff8240b0d20 2019-12-05T03:50:39.527 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.512+0000 7ff82ac51700 1 -- 172.21.15.158:0/3088526414 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8240b29d0 con 0x7ff8240b0d20 2019-12-05T03:50:39.527 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.512+0000 7ff8291ee700 1 --2- 172.21.15.158:0/3088526414 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff8240b0d20 0x7ff824125f30 secure :-1 s=THROTTLE_DONE pgs=296 cs=0 l=1 rx=0x7ff814008b10 tx=0x7ff814011920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.527 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.512+0000 7ff821ffb700 1 -- 172.21.15.158:0/3088526414 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7ff81400ab20 con 0x7ff8240b0d20 2019-12-05T03:50:39.527 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.512+0000 7ff8291ee700 1 --2- 172.21.15.158:0/3088526414 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff8240b0d20 0x7ff824125f30 secure :-1 s=THROTTLE_DONE pgs=296 cs=0 l=1 rx=0x7ff814008b10 tx=0x7ff814011920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.527 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.512+0000 7ff821ffb700 1 --2- 172.21.15.158:0/3088526414 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7ff80403acb0 0x7ff80403d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:39.527 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.516+0000 7ff821ffb700 1 -- 172.21.15.158:0/3088526414 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5200+0+0 (secure 0 0 0) 0x7ff81404bc10 con 0x7ff8240b0d20 2019-12-05T03:50:39.528 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.516+0000 7ff8289ed700 1 --2- 172.21.15.158:0/3088526414 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7ff80403acb0 0x7ff80403d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:39.528 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.516+0000 7ff8289ed700 1 --2- 172.21.15.158:0/3088526414 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7ff80403acb0 0x7ff80403d1c0 crc :-1 s=READY pgs=137 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:39.528 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.516+0000 7ff82ac51700 1 -- 172.21.15.158:0/3088526414 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8240554e0 con 0x7ff8240b0d20 2019-12-05T03:50:39.529 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.524+0000 7ff8291ee700 1 --2- 172.21.15.158:0/3088526414 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff8240b0d20 0x7ff824125f30 secure :-1 s=THROTTLE_DONE pgs=296 cs=0 l=1 rx=0x7ff814008b10 tx=0x7ff814011920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.529 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.524+0000 7ff821ffb700 1 -- 172.21.15.158:0/3088526414 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7ff814032c90 con 0x7ff8240b0d20 2019-12-05T03:50:39.687 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.680+0000 7ff82ac51700 1 -- 172.21.15.158:0/3088526414 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7ff8241291d0 con 0x7ff8240b0d20 2019-12-05T03:50:39.695 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.688+0000 7ff8291ee700 1 --2- 172.21.15.158:0/3088526414 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff8240b0d20 0x7ff824125f30 secure :-1 s=THROTTLE_DONE pgs=296 cs=0 l=1 rx=0x7ff814008b10 tx=0x7ff814011920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.695 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.688+0000 7ff821ffb700 1 -- 172.21.15.158:0/3088526414 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 updated v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff814032ef0 con 0x7ff8240b0d20 2019-12-05T03:50:39.702 INFO:teuthology.orchestra.run.smithi158.stderr:updated 2019-12-05T03:50:39.705 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.700+0000 7ff82ac51700 1 -- 172.21.15.158:0/3088526414 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7ff80403acb0 msgr2=0x7ff80403d1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:39.706 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.700+0000 7ff82ac51700 1 --2- 172.21.15.158:0/3088526414 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7ff80403acb0 0x7ff80403d1c0 crc :-1 s=READY pgs=137 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:39.706 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.700+0000 7ff82ac51700 1 -- 172.21.15.158:0/3088526414 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff8240b0d20 msgr2=0x7ff824125f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:39.706 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.700+0000 7ff82ac51700 1 --2- 172.21.15.158:0/3088526414 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff8240b0d20 0x7ff824125f30 secure :-1 s=READY pgs=296 cs=0 l=1 rx=0x7ff814008b10 tx=0x7ff814011920).stop 2019-12-05T03:50:39.706 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.700+0000 7ff82ac51700 1 -- 172.21.15.158:0/3088526414 shutdown_connections 2019-12-05T03:50:39.706 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.700+0000 7ff82ac51700 1 --2- 172.21.15.158:0/3088526414 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7ff80403acb0 0x7ff80403d1c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:39.706 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.700+0000 7ff82ac51700 1 --2- 172.21.15.158:0/3088526414 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7ff8240b0d20 0x7ff824125f30 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:39.707 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.700+0000 7ff82ac51700 1 --2- 172.21.15.158:0/3088526414 >> v2:172.21.15.96:3300/0 conn(0x7ff82407d550 0x7ff82407d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:39.707 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.700+0000 7ff82ac51700 1 -- 172.21.15.158:0/3088526414 shutdown_connections 2019-12-05T03:50:39.707 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.700+0000 7ff82ac51700 1 -- 172.21.15.158:0/3088526414 wait complete. 2019-12-05T03:50:39.707 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.700+0000 7ff82ac51700 1 -- 172.21.15.158:0/3088526414 >> 172.21.15.158:0/3088526414 conn(0x7ff824128d50 msgr2=0x7ff8240b2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:39.717 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2019-12-05T03:50:39.812 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.800+0000 7eff84ea7700 1 Processor -- start 2019-12-05T03:50:39.812 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.800+0000 7eff84ea7700 1 -- start start 2019-12-05T03:50:39.813 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.800+0000 7eff84ea7700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7eff8009a320 0x7eff8005a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:39.813 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.800+0000 7eff84ea7700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7eff801553b0 0x7eff801557e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:39.813 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.800+0000 7eff84ea7700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff800accb0 con 0x7eff8009cf60 2019-12-05T03:50:39.813 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.800+0000 7eff84ea7700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff8009a750 con 0x7eff8009a320 2019-12-05T03:50:39.813 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.800+0000 7eff84ea7700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff800b1730 con 0x7eff801553b0 2019-12-05T03:50:39.813 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.800+0000 7eff7f59e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7eff801553b0 0x7eff801557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:39.813 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.800+0000 7eff7f59e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7eff801553b0 0x7eff801557e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54732/0 (socket says 172.21.15.158:54732) 2019-12-05T03:50:39.814 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.804+0000 7eff7f59e700 1 -- 172.21.15.158:0/93884609 learned_addr learned my addr 172.21.15.158:0/93884609 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:39.814 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.804+0000 7eff7e59c700 1 --2- 172.21.15.158:0/93884609 >> v2:172.21.15.96:3300/0 conn(0x7eff8009a320 0x7eff8005a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:39.814 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.804+0000 7eff7f59e700 1 -- 172.21.15.158:0/93884609 >> v2:172.21.15.96:3300/0 conn(0x7eff8009a320 msgr2=0x7eff8005a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:39.814 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.804+0000 7eff7f59e700 1 --2- 172.21.15.158:0/93884609 >> v2:172.21.15.96:3300/0 conn(0x7eff8009a320 0x7eff8005a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:39.814 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.804+0000 7eff7f59e700 1 -- 172.21.15.158:0/93884609 >> v1:172.21.15.96:6789/0 conn(0x7eff8009cf60 legacy=0x7eff80151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:39.814 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.804+0000 7eff7f59e700 1 -- 172.21.15.158:0/93884609 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff800b6980 con 0x7eff801553b0 2019-12-05T03:50:39.814 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.804+0000 7eff7f59e700 1 --2- 172.21.15.158:0/93884609 >> v2:172.21.15.158:3300/0 conn(0x7eff801553b0 0x7eff801557e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7eff78008b10 tx=0x7eff780100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.815 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.804+0000 7eff7f59e700 1 --2- 172.21.15.158:0/93884609 >> v2:172.21.15.158:3300/0 conn(0x7eff801553b0 0x7eff801557e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7eff78008b10 tx=0x7eff780100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.815 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.804+0000 7eff7f59e700 1 --2- 172.21.15.158:0/93884609 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7eff801553b0 0x7eff801557e0 secure :-1 s=READY pgs=297 cs=0 l=1 rx=0x7eff78008b10 tx=0x7eff780100b0).ready entity=mon.1 client_cookie=322ed2b1f75ab43a server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:39.815 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.804+0000 7eff7f59e700 1 --2- 172.21.15.158:0/93884609 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7eff801553b0 0x7eff801557e0 secure :-1 s=THROTTLE_DONE pgs=297 cs=0 l=1 rx=0x7eff78008b10 tx=0x7eff780100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.815 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.804+0000 7eff7dd9b700 1 -- 172.21.15.158:0/93884609 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff78010d60 con 0x7eff801553b0 2019-12-05T03:50:39.815 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.804+0000 7eff7f59e700 1 --2- 172.21.15.158:0/93884609 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7eff801553b0 0x7eff801557e0 secure :-1 s=THROTTLE_DONE pgs=297 cs=0 l=1 rx=0x7eff78008b10 tx=0x7eff780100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.815 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.804+0000 7eff7dd9b700 1 -- 172.21.15.158:0/93884609 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff78010980 con 0x7eff801553b0 2019-12-05T03:50:39.815 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.804+0000 7eff7f59e700 1 --2- 172.21.15.158:0/93884609 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7eff801553b0 0x7eff801557e0 secure :-1 s=THROTTLE_DONE pgs=297 cs=0 l=1 rx=0x7eff78008b10 tx=0x7eff780100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.816 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.804+0000 7eff7dd9b700 1 -- 172.21.15.158:0/93884609 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff780114a0 con 0x7eff801553b0 2019-12-05T03:50:39.816 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.804+0000 7eff84ea7700 1 -- 172.21.15.158:0/93884609 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7eff801553b0 msgr2=0x7eff801557e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:39.816 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.804+0000 7eff84ea7700 1 --2- 172.21.15.158:0/93884609 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7eff801553b0 0x7eff801557e0 secure :-1 s=READY pgs=297 cs=0 l=1 rx=0x7eff78008b10 tx=0x7eff780100b0).stop 2019-12-05T03:50:39.816 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.804+0000 7eff84ea7700 1 -- 172.21.15.158:0/93884609 shutdown_connections 2019-12-05T03:50:39.816 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.804+0000 7eff84ea7700 1 --2- 172.21.15.158:0/93884609 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7eff801553b0 0x7eff801557e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:39.816 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.804+0000 7eff84ea7700 1 --2- 172.21.15.158:0/93884609 >> v2:172.21.15.96:3300/0 conn(0x7eff8009a320 0x7eff8005a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:39.816 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.804+0000 7eff84ea7700 1 -- 172.21.15.158:0/93884609 shutdown_connections 2019-12-05T03:50:39.817 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.804+0000 7eff84ea7700 1 -- 172.21.15.158:0/93884609 wait complete. 2019-12-05T03:50:39.817 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.804+0000 7eff84ea7700 1 -- 172.21.15.158:0/93884609 >> 172.21.15.158:0/93884609 conn(0x7eff800b7e60 msgr2=0x7eff800b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:39.820 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.808+0000 7eff84ea7700 1 Processor -- start 2019-12-05T03:50:39.820 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.808+0000 7eff84ea7700 1 -- start start 2019-12-05T03:50:39.820 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.808+0000 7eff84ea7700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7eff8007dd30 0x7eff8007e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:39.820 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.808+0000 7eff84ea7700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7eff80140190 0x7eff801405c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:39.821 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.808+0000 7eff84ea7700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff8012d200 con 0x7eff80143fd0 2019-12-05T03:50:39.821 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.808+0000 7eff84ea7700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff801437f0 con 0x7eff80140190 2019-12-05T03:50:39.821 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.808+0000 7eff84ea7700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff80143a90 con 0x7eff8007dd30 2019-12-05T03:50:39.821 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.808+0000 7eff7f59e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7eff80140190 0x7eff801405c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:39.821 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.808+0000 7eff7f59e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7eff80140190 0x7eff801405c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54738/0 (socket says 172.21.15.158:54738) 2019-12-05T03:50:39.821 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.808+0000 7eff7f59e700 1 -- 172.21.15.158:0/1024337667 learned_addr learned my addr 172.21.15.158:0/1024337667 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:39.821 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.808+0000 7eff7e59c700 1 --2- 172.21.15.158:0/1024337667 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7eff8007dd30 0x7eff8007e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:39.822 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.812+0000 7eff7f59e700 1 -- 172.21.15.158:0/1024337667 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7eff8007dd30 msgr2=0x7eff8007e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:39.822 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.812+0000 7eff7f59e700 1 --2- 172.21.15.158:0/1024337667 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7eff8007dd30 0x7eff8007e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:39.822 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.812+0000 7eff7f59e700 1 -- 172.21.15.158:0/1024337667 >> v1:172.21.15.158:6789/0 conn(0x7eff80143fd0 legacy=0x7eff800645c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:39.822 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.812+0000 7eff6f7fe700 1 -- 172.21.15.158:0/1024337667 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2398042646 0 0) 0x7eff8012d200 con 0x7eff80143fd0 2019-12-05T03:50:39.822 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.812+0000 7eff7f59e700 1 -- 172.21.15.158:0/1024337667 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8013fde0 con 0x7eff80140190 2019-12-05T03:50:39.822 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.812+0000 7eff7f59e700 1 --2- 172.21.15.158:0/1024337667 >> v2:172.21.15.158:3300/0 conn(0x7eff80140190 0x7eff801405c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7eff801439b0 tx=0x7eff78010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.822 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.812+0000 7eff7f59e700 1 --2- 172.21.15.158:0/1024337667 >> v2:172.21.15.158:3300/0 conn(0x7eff80140190 0x7eff801405c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7eff801439b0 tx=0x7eff78010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.823 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.812+0000 7eff7f59e700 1 --2- 172.21.15.158:0/1024337667 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7eff80140190 0x7eff801405c0 secure :-1 s=READY pgs=299 cs=0 l=1 rx=0x7eff801439b0 tx=0x7eff78010cd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:39.823 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.812+0000 7eff7f59e700 1 --2- 172.21.15.158:0/1024337667 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7eff80140190 0x7eff801405c0 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7eff801439b0 tx=0x7eff78010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.823 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.812+0000 7eff6f7fe700 1 -- 172.21.15.158:0/1024337667 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff78011b80 con 0x7eff80140190 2019-12-05T03:50:39.823 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.812+0000 7eff7f59e700 1 --2- 172.21.15.158:0/1024337667 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7eff80140190 0x7eff801405c0 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7eff801439b0 tx=0x7eff78010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.823 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.812+0000 7eff6f7fe700 1 -- 172.21.15.158:0/1024337667 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff780110c0 con 0x7eff80140190 2019-12-05T03:50:39.823 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.812+0000 7eff7f59e700 1 --2- 172.21.15.158:0/1024337667 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7eff80140190 0x7eff801405c0 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7eff801439b0 tx=0x7eff78010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.823 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.812+0000 7eff84ea7700 1 -- 172.21.15.158:0/1024337667 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff80144400 con 0x7eff80140190 2019-12-05T03:50:39.824 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.812+0000 7eff6f7fe700 1 -- 172.21.15.158:0/1024337667 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff78005ab0 con 0x7eff80140190 2019-12-05T03:50:39.824 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.812+0000 7eff84ea7700 1 -- 172.21.15.158:0/1024337667 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff80140b10 con 0x7eff80140190 2019-12-05T03:50:39.824 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.812+0000 7eff7f59e700 1 --2- 172.21.15.158:0/1024337667 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7eff80140190 0x7eff801405c0 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7eff801439b0 tx=0x7eff78010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.824 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.812+0000 7eff6f7fe700 1 -- 172.21.15.158:0/1024337667 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7eff7800f280 con 0x7eff80140190 2019-12-05T03:50:39.824 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.812+0000 7eff7f59e700 1 --2- 172.21.15.158:0/1024337667 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7eff80140190 0x7eff801405c0 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7eff801439b0 tx=0x7eff78010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.824 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.812+0000 7eff6f7fe700 1 --2- 172.21.15.158:0/1024337667 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7eff6403ac10 0x7eff6403d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:39.824 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.812+0000 7eff6f7fe700 1 -- 172.21.15.158:0/1024337667 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5200+0+0 (secure 0 0 0) 0x7eff7808f760 con 0x7eff80140190 2019-12-05T03:50:39.825 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.812+0000 7eff7ed9d700 1 --2- 172.21.15.158:0/1024337667 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7eff6403ac10 0x7eff6403d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:39.825 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.812+0000 7eff7ed9d700 1 --2- 172.21.15.158:0/1024337667 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7eff6403ac10 0x7eff6403d120 crc :-1 s=READY pgs=138 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:39.825 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.816+0000 7eff84ea7700 1 -- 172.21.15.158:0/1024337667 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff800554e0 con 0x7eff80140190 2019-12-05T03:50:39.825 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.820+0000 7eff7f59e700 1 --2- 172.21.15.158:0/1024337667 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7eff80140190 0x7eff801405c0 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7eff801439b0 tx=0x7eff78010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.826 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.820+0000 7eff6f7fe700 1 -- 172.21.15.158:0/1024337667 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7eff780767c0 con 0x7eff80140190 2019-12-05T03:50:39.981 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.972+0000 7eff84ea7700 1 -- 172.21.15.158:0/1024337667 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7eff800653f0 con 0x7eff80140190 2019-12-05T03:50:39.991 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.984+0000 7eff7f59e700 1 --2- 172.21.15.158:0/1024337667 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7eff80140190 0x7eff801405c0 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7eff801439b0 tx=0x7eff78010cd0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:39.991 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.984+0000 7eff6f7fe700 1 -- 172.21.15.158:0/1024337667 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 updated v8) v1 ==== 97+0+0 (secure 0 0 0) 0x7eff78076a20 con 0x7eff80140190 2019-12-05T03:50:39.996 INFO:teuthology.orchestra.run.smithi158.stderr:updated 2019-12-05T03:50:39.999 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.992+0000 7eff84ea7700 1 -- 172.21.15.158:0/1024337667 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7eff6403ac10 msgr2=0x7eff6403d120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:39.999 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.992+0000 7eff84ea7700 1 --2- 172.21.15.158:0/1024337667 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7eff6403ac10 0x7eff6403d120 crc :-1 s=READY pgs=138 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:39.999 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.992+0000 7eff84ea7700 1 -- 172.21.15.158:0/1024337667 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7eff80140190 msgr2=0x7eff801405c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:40.000 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.992+0000 7eff84ea7700 1 --2- 172.21.15.158:0/1024337667 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7eff80140190 0x7eff801405c0 secure :-1 s=READY pgs=299 cs=0 l=1 rx=0x7eff801439b0 tx=0x7eff78010cd0).stop 2019-12-05T03:50:40.000 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.992+0000 7eff84ea7700 1 -- 172.21.15.158:0/1024337667 shutdown_connections 2019-12-05T03:50:40.000 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.992+0000 7eff84ea7700 1 --2- 172.21.15.158:0/1024337667 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7eff6403ac10 0x7eff6403d120 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:40.000 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.992+0000 7eff84ea7700 1 --2- 172.21.15.158:0/1024337667 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7eff80140190 0x7eff801405c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:40.000 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.992+0000 7eff84ea7700 1 --2- 172.21.15.158:0/1024337667 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7eff8007dd30 0x7eff8007e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:40.000 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.992+0000 7eff84ea7700 1 -- 172.21.15.158:0/1024337667 shutdown_connections 2019-12-05T03:50:40.000 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.992+0000 7eff84ea7700 1 -- 172.21.15.158:0/1024337667 wait complete. 2019-12-05T03:50:40.001 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:39.992+0000 7eff84ea7700 1 -- 172.21.15.158:0/1024337667 >> 172.21.15.158:0/1024337667 conn(0x7eff8009cf60 msgr2=0x7eff801558c0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:40.010 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2019-12-05T03:50:40.102 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.088+0000 7feb3ee94700 1 Processor -- start 2019-12-05T03:50:40.102 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.088+0000 7feb3ee94700 1 -- start start 2019-12-05T03:50:40.103 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.092+0000 7feb3ee94700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7feb3809cf60 0x7feb3809a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:40.103 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.092+0000 7feb3ee94700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7feb381553b0 0x7feb381557e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:40.103 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.092+0000 7feb3ee94700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb380accb0 con 0x7feb3805a740 2019-12-05T03:50:40.103 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.092+0000 7feb3ee94700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb380b1730 con 0x7feb3809cf60 2019-12-05T03:50:40.103 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.092+0000 7feb3ee94700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb380b19d0 con 0x7feb381553b0 2019-12-05T03:50:40.104 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.092+0000 7feb3dc32700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7feb381553b0 0x7feb381557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:40.104 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.092+0000 7feb3dc32700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7feb381553b0 0x7feb381557e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54746/0 (socket says 172.21.15.158:54746) 2019-12-05T03:50:40.104 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.092+0000 7feb3dc32700 1 -- 172.21.15.158:0/1988888007 learned_addr learned my addr 172.21.15.158:0/1988888007 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:40.104 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.092+0000 7feb3d431700 1 --2- 172.21.15.158:0/1988888007 >> v2:172.21.15.96:3300/0 conn(0x7feb3809cf60 0x7feb3809a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:40.104 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.092+0000 7feb3dc32700 1 -- 172.21.15.158:0/1988888007 >> v2:172.21.15.96:3300/0 conn(0x7feb3809cf60 msgr2=0x7feb3809a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:40.104 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.092+0000 7feb3dc32700 1 --2- 172.21.15.158:0/1988888007 >> v2:172.21.15.96:3300/0 conn(0x7feb3809cf60 0x7feb3809a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:40.104 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.092+0000 7feb3dc32700 1 -- 172.21.15.158:0/1988888007 >> v1:172.21.15.96:6789/0 conn(0x7feb3805a740 legacy=0x7feb38151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:40.105 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.092+0000 7feb3dc32700 1 -- 172.21.15.158:0/1988888007 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb3805ab70 con 0x7feb381553b0 2019-12-05T03:50:40.105 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.092+0000 7feb3dc32700 1 --2- 172.21.15.158:0/1988888007 >> v2:172.21.15.158:3300/0 conn(0x7feb381553b0 0x7feb381557e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7feb30008b10 tx=0x7feb300100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.105 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.092+0000 7feb3dc32700 1 --2- 172.21.15.158:0/1988888007 >> v2:172.21.15.158:3300/0 conn(0x7feb381553b0 0x7feb381557e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7feb30008b10 tx=0x7feb300100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.105 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.092+0000 7feb3dc32700 1 --2- 172.21.15.158:0/1988888007 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7feb381553b0 0x7feb381557e0 secure :-1 s=READY pgs=300 cs=0 l=1 rx=0x7feb30008b10 tx=0x7feb300100b0).ready entity=mon.1 client_cookie=a8f59b73858dc463 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:40.105 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.092+0000 7feb3dc32700 1 --2- 172.21.15.158:0/1988888007 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7feb381553b0 0x7feb381557e0 secure :-1 s=THROTTLE_DONE pgs=300 cs=0 l=1 rx=0x7feb30008b10 tx=0x7feb300100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.106 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.092+0000 7feb2ffff700 1 -- 172.21.15.158:0/1988888007 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb30010d60 con 0x7feb381553b0 2019-12-05T03:50:40.106 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.092+0000 7feb3dc32700 1 --2- 172.21.15.158:0/1988888007 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7feb381553b0 0x7feb381557e0 secure :-1 s=THROTTLE_DONE pgs=300 cs=0 l=1 rx=0x7feb30008b10 tx=0x7feb300100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.106 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.092+0000 7feb3dc32700 1 --2- 172.21.15.158:0/1988888007 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7feb381553b0 0x7feb381557e0 secure :-1 s=THROTTLE_DONE pgs=300 cs=0 l=1 rx=0x7feb30008b10 tx=0x7feb300100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.107 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.092+0000 7feb2ffff700 1 -- 172.21.15.158:0/1988888007 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb30010980 con 0x7feb381553b0 2019-12-05T03:50:40.107 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.092+0000 7feb2ffff700 1 -- 172.21.15.158:0/1988888007 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb300114a0 con 0x7feb381553b0 2019-12-05T03:50:40.107 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.092+0000 7feb3ee94700 1 -- 172.21.15.158:0/1988888007 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7feb381553b0 msgr2=0x7feb381557e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:40.107 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.092+0000 7feb3ee94700 1 --2- 172.21.15.158:0/1988888007 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7feb381553b0 0x7feb381557e0 secure :-1 s=READY pgs=300 cs=0 l=1 rx=0x7feb30008b10 tx=0x7feb300100b0).stop 2019-12-05T03:50:40.107 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.092+0000 7feb3ee94700 1 -- 172.21.15.158:0/1988888007 shutdown_connections 2019-12-05T03:50:40.107 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.092+0000 7feb3ee94700 1 --2- 172.21.15.158:0/1988888007 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7feb381553b0 0x7feb381557e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:40.108 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.092+0000 7feb3ee94700 1 --2- 172.21.15.158:0/1988888007 >> v2:172.21.15.96:3300/0 conn(0x7feb3809cf60 0x7feb3809a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:40.108 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.096+0000 7feb3ee94700 1 -- 172.21.15.158:0/1988888007 shutdown_connections 2019-12-05T03:50:40.108 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.096+0000 7feb3ee94700 1 -- 172.21.15.158:0/1988888007 wait complete. 2019-12-05T03:50:40.108 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.096+0000 7feb3ee94700 1 -- 172.21.15.158:0/1988888007 >> 172.21.15.158:0/1988888007 conn(0x7feb380b7e60 msgr2=0x7feb380b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:40.114 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.096+0000 7feb3ee94700 1 Processor -- start 2019-12-05T03:50:40.114 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.096+0000 7feb3ee94700 1 -- start start 2019-12-05T03:50:40.115 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.100+0000 7feb3ee94700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb381254d0 0x7feb38137c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:40.115 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.100+0000 7feb3ee94700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb380b0cf0 con 0x7feb38133f60 2019-12-05T03:50:40.115 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.100+0000 7feb3ee94700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb380ae610 con 0x7feb380acfa0 2019-12-05T03:50:40.115 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.100+0000 7feb3ee94700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb380b0fe0 con 0x7feb381254d0 2019-12-05T03:50:40.115 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.100+0000 7feb3cc30700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7feb380acfa0 0x7feb3807d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49528/0 (socket says 172.21.15.158:49528) 2019-12-05T03:50:40.115 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.100+0000 7feb3cc30700 1 -- 172.21.15.158:0/107020380 learned_addr learned my addr 172.21.15.158:0/107020380 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:40.115 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.100+0000 7feb3d431700 1 --2- 172.21.15.158:0/107020380 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb381254d0 0x7feb38137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:40.116 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.100+0000 7feb2dffb700 1 -- 172.21.15.158:0/107020380 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1255210315 0 0) 0x7feb380ae610 con 0x7feb380acfa0 2019-12-05T03:50:40.116 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.100+0000 7feb2dffb700 1 -- 172.21.15.158:0/107020380 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb180030b0 con 0x7feb380acfa0 2019-12-05T03:50:40.117 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.100+0000 7feb2dffb700 1 -- 172.21.15.158:0/107020380 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3402753241 0 0) 0x7feb380b0cf0 con 0x7feb38133f60 2019-12-05T03:50:40.117 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.100+0000 7feb2dffb700 1 -- 172.21.15.158:0/107020380 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb380ae610 con 0x7feb38133f60 2019-12-05T03:50:40.117 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.100+0000 7feb2dffb700 1 -- 172.21.15.158:0/107020380 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3191683012 0 0) 0x7feb180030b0 con 0x7feb380acfa0 2019-12-05T03:50:40.117 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.100+0000 7feb3d431700 1 -- 172.21.15.158:0/107020380 >> v1:172.21.15.158:6789/0 conn(0x7feb380acfa0 legacy=0x7feb3807d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:40.117 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.100+0000 7feb3d431700 1 -- 172.21.15.158:0/107020380 >> v1:172.21.15.96:6789/0 conn(0x7feb38133f60 legacy=0x7feb38134390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:40.117 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.100+0000 7feb3d431700 1 -- 172.21.15.158:0/107020380 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb38125900 con 0x7feb381254d0 2019-12-05T03:50:40.118 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.100+0000 7feb3d431700 1 --2- 172.21.15.158:0/107020380 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb381254d0 0x7feb38137c30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7feb380aefd0 tx=0x7feb28001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.118 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.100+0000 7feb3d431700 1 --2- 172.21.15.158:0/107020380 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb381254d0 0x7feb38137c30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7feb380aefd0 tx=0x7feb28001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.118 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.100+0000 7feb3d431700 1 --2- 172.21.15.158:0/107020380 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb381254d0 0x7feb38137c30 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7feb380aefd0 tx=0x7feb28001780).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:40.118 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.100+0000 7feb3d431700 1 --2- 172.21.15.158:0/107020380 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb381254d0 0x7feb38137c30 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7feb380aefd0 tx=0x7feb28001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.118 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.100+0000 7feb2dffb700 1 -- 172.21.15.158:0/107020380 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb28001a30 con 0x7feb381254d0 2019-12-05T03:50:40.118 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.100+0000 7feb3d431700 1 --2- 172.21.15.158:0/107020380 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb381254d0 0x7feb38137c30 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7feb380aefd0 tx=0x7feb28001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.118 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.100+0000 7feb3ee94700 1 -- 172.21.15.158:0/107020380 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb38134b90 con 0x7feb381254d0 2019-12-05T03:50:40.119 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.100+0000 7feb2dffb700 1 -- 172.21.15.158:0/107020380 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb28001840 con 0x7feb381254d0 2019-12-05T03:50:40.119 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.100+0000 7feb3d431700 1 --2- 172.21.15.158:0/107020380 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb381254d0 0x7feb38137c30 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7feb380aefd0 tx=0x7feb28001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.119 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.100+0000 7feb2dffb700 1 -- 172.21.15.158:0/107020380 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb34005b20 con 0x7feb381254d0 2019-12-05T03:50:40.119 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.100+0000 7feb3ee94700 1 -- 172.21.15.158:0/107020380 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb3807dd70 con 0x7feb381254d0 2019-12-05T03:50:40.119 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.100+0000 7feb3d431700 1 --2- 172.21.15.158:0/107020380 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb381254d0 0x7feb38137c30 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7feb380aefd0 tx=0x7feb28001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.120 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.100+0000 7feb2dffb700 1 -- 172.21.15.158:0/107020380 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7feb34007ae0 con 0x7feb381254d0 2019-12-05T03:50:40.120 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.100+0000 7feb3d431700 1 --2- 172.21.15.158:0/107020380 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb381254d0 0x7feb38137c30 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7feb380aefd0 tx=0x7feb28001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.120 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.100+0000 7feb2dffb700 1 --2- 172.21.15.158:0/107020380 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7feb1803b450 0x7feb1803d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:40.120 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.100+0000 7feb2dffb700 1 -- 172.21.15.158:0/107020380 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5200+0+0 (secure 0 0 0) 0x7feb3404a580 con 0x7feb381254d0 2019-12-05T03:50:40.120 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.104+0000 7feb3cc30700 1 --2- 172.21.15.158:0/107020380 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7feb1803b450 0x7feb1803d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:40.120 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.104+0000 7feb3cc30700 1 --2- 172.21.15.158:0/107020380 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7feb1803b450 0x7feb1803d960 crc :-1 s=READY pgs=139 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:40.120 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.104+0000 7feb3ee94700 1 -- 172.21.15.158:0/107020380 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb380554e0 con 0x7feb381254d0 2019-12-05T03:50:40.121 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.112+0000 7feb3d431700 1 --2- 172.21.15.158:0/107020380 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb381254d0 0x7feb38137c30 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7feb380aefd0 tx=0x7feb28001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.121 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.112+0000 7feb2dffb700 1 -- 172.21.15.158:0/107020380 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7feb340315e0 con 0x7feb381254d0 2019-12-05T03:50:40.286 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.280+0000 7feb3ee94700 1 -- 172.21.15.158:0/107020380 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7feb38066940 con 0x7feb381254d0 2019-12-05T03:50:40.297 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.288+0000 7feb3d431700 1 --2- 172.21.15.158:0/107020380 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb381254d0 0x7feb38137c30 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7feb380aefd0 tx=0x7feb28001780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.297 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.288+0000 7feb2dffb700 1 -- 172.21.15.158:0/107020380 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 updated v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7feb34031840 con 0x7feb381254d0 2019-12-05T03:50:40.301 INFO:teuthology.orchestra.run.smithi158.stderr:updated 2019-12-05T03:50:40.305 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.296+0000 7feb3ee94700 1 -- 172.21.15.158:0/107020380 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7feb1803b450 msgr2=0x7feb1803d960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:40.305 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.296+0000 7feb3ee94700 1 --2- 172.21.15.158:0/107020380 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7feb1803b450 0x7feb1803d960 crc :-1 s=READY pgs=139 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:40.305 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.296+0000 7feb3ee94700 1 -- 172.21.15.158:0/107020380 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb381254d0 msgr2=0x7feb38137c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:40.305 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.296+0000 7feb3ee94700 1 --2- 172.21.15.158:0/107020380 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb381254d0 0x7feb38137c30 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7feb380aefd0 tx=0x7feb28001780).stop 2019-12-05T03:50:40.305 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.296+0000 7feb3ee94700 1 -- 172.21.15.158:0/107020380 shutdown_connections 2019-12-05T03:50:40.306 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.296+0000 7feb3ee94700 1 --2- 172.21.15.158:0/107020380 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7feb1803b450 0x7feb1803d960 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:40.306 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.296+0000 7feb3ee94700 1 --2- 172.21.15.158:0/107020380 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7feb381254d0 0x7feb38137c30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:40.306 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.296+0000 7feb3ee94700 1 -- 172.21.15.158:0/107020380 shutdown_connections 2019-12-05T03:50:40.306 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.296+0000 7feb3ee94700 1 -- 172.21.15.158:0/107020380 wait complete. 2019-12-05T03:50:40.306 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.296+0000 7feb3ee94700 1 -- 172.21.15.158:0/107020380 >> 172.21.15.158:0/107020380 conn(0x7feb3807e280 msgr2=0x7feb38155370 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:40.316 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2019-12-05T03:50:40.419 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.404+0000 7f5f823da700 1 Processor -- start 2019-12-05T03:50:40.420 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.404+0000 7f5f823da700 1 -- start start 2019-12-05T03:50:40.420 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.408+0000 7f5f823da700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5f7c09a320 0x7f5f7c05a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:40.420 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.408+0000 7f5f823da700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5f7c1553b0 0x7f5f7c1557e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:40.420 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.408+0000 7f5f823da700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f7c0accb0 con 0x7f5f7c09cf60 2019-12-05T03:50:40.420 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.408+0000 7f5f823da700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f7c09a750 con 0x7f5f7c1553b0 2019-12-05T03:50:40.421 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.408+0000 7f5f823da700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c0b1730 con 0x7f5f7c09a320 2019-12-05T03:50:40.421 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.408+0000 7f5f7bfff700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5f7c09a320 0x7f5f7c05a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:40.421 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.408+0000 7f5f81178700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5f7c1553b0 0x7f5f7c1557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:40.421 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.408+0000 7f5f7bfff700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5f7c09a320 0x7f5f7c05a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.158:37496/0 (socket says 172.21.15.158:37496) 2019-12-05T03:50:40.422 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.408+0000 7f5f81178700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5f7c1553b0 0x7f5f7c1557e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.158:41346/0 (socket says 172.21.15.158:41346) 2019-12-05T03:50:40.422 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.408+0000 7f5f7bfff700 1 -- 172.21.15.158:0/2243714588 learned_addr learned my addr 172.21.15.158:0/2243714588 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:40.422 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.408+0000 7f5f7bfff700 1 -- 172.21.15.158:0/2243714588 >> v2:172.21.15.96:3300/0 conn(0x7f5f7c1553b0 msgr2=0x7f5f7c1557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:40.422 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.408+0000 7f5f7bfff700 1 --2- 172.21.15.158:0/2243714588 >> v2:172.21.15.96:3300/0 conn(0x7f5f7c1553b0 0x7f5f7c1557e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:40.423 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.408+0000 7f5f7bfff700 1 -- 172.21.15.158:0/2243714588 >> v1:172.21.15.96:6789/0 conn(0x7f5f7c09cf60 legacy=0x7f5f7c151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:40.423 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.408+0000 7f5f7bfff700 1 -- 172.21.15.158:0/2243714588 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7c0b6980 con 0x7f5f7c09a320 2019-12-05T03:50:40.423 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.408+0000 7f5f81178700 1 --2- 172.21.15.158:0/2243714588 >> v2:172.21.15.96:3300/0 conn(0x7f5f7c1553b0 0x7f5f7c1557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:50:40.423 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.408+0000 7f5f7bfff700 1 --2- 172.21.15.158:0/2243714588 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5f7c09a320 0x7f5f7c05a740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5f70008790 tx=0x7f5f7000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.423 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.408+0000 7f5f7bfff700 1 --2- 172.21.15.158:0/2243714588 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5f7c09a320 0x7f5f7c05a740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5f70008790 tx=0x7f5f7000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.424 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.408+0000 7f5f7bfff700 1 --2- 172.21.15.158:0/2243714588 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5f7c09a320 0x7f5f7c05a740 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f5f70008790 tx=0x7f5f7000fd30).ready entity=mon.2 client_cookie=ba23713e713483b0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:40.424 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.408+0000 7f5f7bfff700 1 --2- 172.21.15.158:0/2243714588 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5f7c09a320 0x7f5f7c05a740 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f5f70008790 tx=0x7f5f7000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.424 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.408+0000 7f5f7bfff700 1 --2- 172.21.15.158:0/2243714588 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5f7c09a320 0x7f5f7c05a740 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f5f70008790 tx=0x7f5f7000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.424 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.408+0000 7f5f7b7fe700 1 -- 172.21.15.158:0/2243714588 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f700113b0 con 0x7f5f7c09a320 2019-12-05T03:50:40.425 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.408+0000 7f5f7bfff700 1 --2- 172.21.15.158:0/2243714588 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5f7c09a320 0x7f5f7c05a740 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f5f70008790 tx=0x7f5f7000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.425 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.408+0000 7f5f7b7fe700 1 -- 172.21.15.158:0/2243714588 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f70008bb0 con 0x7f5f7c09a320 2019-12-05T03:50:40.426 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.408+0000 7f5f7b7fe700 1 -- 172.21.15.158:0/2243714588 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f70011990 con 0x7f5f7c09a320 2019-12-05T03:50:40.426 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.408+0000 7f5f823da700 1 -- 172.21.15.158:0/2243714588 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5f7c09a320 msgr2=0x7f5f7c05a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:40.426 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.408+0000 7f5f823da700 1 --2- 172.21.15.158:0/2243714588 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5f7c09a320 0x7f5f7c05a740 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f5f70008790 tx=0x7f5f7000fd30).stop 2019-12-05T03:50:40.426 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.408+0000 7f5f823da700 1 -- 172.21.15.158:0/2243714588 shutdown_connections 2019-12-05T03:50:40.427 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.412+0000 7f5f823da700 1 --2- 172.21.15.158:0/2243714588 >> v2:172.21.15.96:3300/0 conn(0x7f5f7c1553b0 0x7f5f7c1557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:40.427 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.412+0000 7f5f823da700 1 --2- 172.21.15.158:0/2243714588 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5f7c09a320 0x7f5f7c05a740 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:40.427 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.412+0000 7f5f823da700 1 -- 172.21.15.158:0/2243714588 shutdown_connections 2019-12-05T03:50:40.427 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.412+0000 7f5f823da700 1 -- 172.21.15.158:0/2243714588 wait complete. 2019-12-05T03:50:40.428 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.412+0000 7f5f823da700 1 -- 172.21.15.158:0/2243714588 >> 172.21.15.158:0/2243714588 conn(0x7f5f7c0b7e60 msgr2=0x7f5f7c0b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:40.428 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.412+0000 7f5f823da700 1 Processor -- start 2019-12-05T03:50:40.428 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.412+0000 7f5f823da700 1 -- start start 2019-12-05T03:50:40.433 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.412+0000 7f5f823da700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5f7c07c7e0 0x7f5f7c0aea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:40.434 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.412+0000 7f5f823da700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5f7c0aef60 0x7f5f7c0af390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:40.434 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.412+0000 7f5f823da700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f7c0ae450 con 0x7f5f7c13e0b0 2019-12-05T03:50:40.434 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.412+0000 7f5f823da700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f7c0adea0 con 0x7f5f7c0aef60 2019-12-05T03:50:40.434 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.412+0000 7f5f823da700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c0ae770 con 0x7f5f7c07c7e0 2019-12-05T03:50:40.435 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.412+0000 7f5f7bfff700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5f7c07c7e0 0x7f5f7c0aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:40.435 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.412+0000 7f5f81178700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5f7c0aef60 0x7f5f7c0af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:40.435 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.412+0000 7f5f81178700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5f7c0aef60 0x7f5f7c0af390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.158:41352/0 (socket says 172.21.15.158:41352) 2019-12-05T03:50:40.436 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.412+0000 7f5f81178700 1 -- 172.21.15.158:0/1911687756 learned_addr learned my addr 172.21.15.158:0/1911687756 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:40.436 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.412+0000 7f5f81178700 1 -- 172.21.15.158:0/1911687756 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5f7c07c7e0 msgr2=0x7f5f7c0aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:40.437 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.412+0000 7f5f81178700 1 --2- 172.21.15.158:0/1911687756 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5f7c07c7e0 0x7f5f7c0aea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:40.437 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.412+0000 7f5f81178700 1 -- 172.21.15.158:0/1911687756 >> v1:172.21.15.96:6789/0 conn(0x7f5f7c13e0b0 legacy=0x7f5f7c154330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:40.437 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.412+0000 7f5f797fa700 1 -- 172.21.15.158:0/1911687756 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1263871585 0 0) 0x7f5f7c0ae450 con 0x7f5f7c13e0b0 2019-12-05T03:50:40.437 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.412+0000 7f5f81178700 1 -- 172.21.15.158:0/1911687756 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7c154b30 con 0x7f5f7c0aef60 2019-12-05T03:50:40.438 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.412+0000 7f5f7bfff700 1 --2- 172.21.15.158:0/1911687756 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5f7c07c7e0 0x7f5f7c0aea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:50:40.438 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.412+0000 7f5f81178700 1 --2- 172.21.15.158:0/1911687756 >> v2:172.21.15.96:3300/0 conn(0x7f5f7c0aef60 0x7f5f7c0af390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5f740032b0 tx=0x7f5f74010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.438 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.416+0000 7f5f81178700 1 --2- 172.21.15.158:0/1911687756 >> v2:172.21.15.96:3300/0 conn(0x7f5f7c0aef60 0x7f5f7c0af390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5f740032b0 tx=0x7f5f74010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.438 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.416+0000 7f5f81178700 1 --2- 172.21.15.158:0/1911687756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f7c0aef60 0x7f5f7c0af390 secure :-1 s=READY pgs=219 cs=0 l=1 rx=0x7f5f740032b0 tx=0x7f5f74010f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:40.439 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.416+0000 7f5f81178700 1 --2- 172.21.15.158:0/1911687756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f7c0aef60 0x7f5f7c0af390 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7f5f740032b0 tx=0x7f5f74010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.439 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.416+0000 7f5f797fa700 1 -- 172.21.15.158:0/1911687756 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f74005d40 con 0x7f5f7c0aef60 2019-12-05T03:50:40.439 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.416+0000 7f5f81178700 1 --2- 172.21.15.158:0/1911687756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f7c0aef60 0x7f5f7c0af390 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7f5f740032b0 tx=0x7f5f74010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.439 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.416+0000 7f5f797fa700 1 -- 172.21.15.158:0/1911687756 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f74005960 con 0x7f5f7c0aef60 2019-12-05T03:50:40.440 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.416+0000 7f5f81178700 1 --2- 172.21.15.158:0/1911687756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f7c0aef60 0x7f5f7c0af390 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7f5f740032b0 tx=0x7f5f74010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.440 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.416+0000 7f5f797fa700 1 -- 172.21.15.158:0/1911687756 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f74011bf0 con 0x7f5f7c0aef60 2019-12-05T03:50:40.440 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.416+0000 7f5f823da700 1 -- 172.21.15.158:0/1911687756 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f7c07cc10 con 0x7f5f7c0aef60 2019-12-05T03:50:40.440 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.416+0000 7f5f823da700 1 -- 172.21.15.158:0/1911687756 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f7c0ada40 con 0x7f5f7c0aef60 2019-12-05T03:50:40.440 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.416+0000 7f5f81178700 1 --2- 172.21.15.158:0/1911687756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f7c0aef60 0x7f5f7c0af390 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7f5f740032b0 tx=0x7f5f74010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.441 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.416+0000 7f5f797fa700 1 -- 172.21.15.158:0/1911687756 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f5f74007180 con 0x7f5f7c0aef60 2019-12-05T03:50:40.441 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.416+0000 7f5f81178700 1 --2- 172.21.15.158:0/1911687756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f7c0aef60 0x7f5f7c0af390 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7f5f740032b0 tx=0x7f5f74010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.441 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.416+0000 7f5f797fa700 1 --2- 172.21.15.158:0/1911687756 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f5f5c03ac10 0x7f5f5c03d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:40.441 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.416+0000 7f5f797fa700 1 -- 172.21.15.158:0/1911687756 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f5f7404afb0 con 0x7f5f7c0aef60 2019-12-05T03:50:40.442 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.416+0000 7f5f80977700 1 --2- 172.21.15.158:0/1911687756 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f5f5c03ac10 0x7f5f5c03d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:40.442 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.416+0000 7f5f80977700 1 --2- 172.21.15.158:0/1911687756 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f5f5c03ac10 0x7f5f5c03d120 crc :-1 s=READY pgs=140 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:40.442 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.424+0000 7f5f823da700 1 -- 172.21.15.158:0/1911687756 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f7c0554e0 con 0x7f5f7c0aef60 2019-12-05T03:50:40.443 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.432+0000 7f5f81178700 1 --2- 172.21.15.158:0/1911687756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f7c0aef60 0x7f5f7c0af390 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7f5f740032b0 tx=0x7f5f74010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.444 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.432+0000 7f5f797fa700 1 -- 172.21.15.158:0/1911687756 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f5f7c07cc10 con 0x7f5f7c0aef60 2019-12-05T03:50:40.599 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.592+0000 7f5f823da700 1 -- 172.21.15.158:0/1911687756 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f5f7c066940 con 0x7f5f7c0aef60 2019-12-05T03:50:40.607 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.600+0000 7f5f81178700 1 --2- 172.21.15.158:0/1911687756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f7c0aef60 0x7f5f7c0af390 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7f5f740032b0 tx=0x7f5f74010f00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.607 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.600+0000 7f5f797fa700 1 -- 172.21.15.158:0/1911687756 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 updated v10) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5f7c154b30 con 0x7f5f7c0aef60 2019-12-05T03:50:40.614 INFO:teuthology.orchestra.run.smithi158.stderr:updated 2019-12-05T03:50:40.618 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.612+0000 7f5f823da700 1 -- 172.21.15.158:0/1911687756 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f5f5c03ac10 msgr2=0x7f5f5c03d120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:40.618 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.612+0000 7f5f823da700 1 --2- 172.21.15.158:0/1911687756 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f5f5c03ac10 0x7f5f5c03d120 crc :-1 s=READY pgs=140 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:40.618 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.612+0000 7f5f823da700 1 -- 172.21.15.158:0/1911687756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f7c0aef60 msgr2=0x7f5f7c0af390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:40.618 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.612+0000 7f5f823da700 1 --2- 172.21.15.158:0/1911687756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f7c0aef60 0x7f5f7c0af390 secure :-1 s=READY pgs=219 cs=0 l=1 rx=0x7f5f740032b0 tx=0x7f5f74010f00).stop 2019-12-05T03:50:40.618 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.612+0000 7f5f823da700 1 -- 172.21.15.158:0/1911687756 shutdown_connections 2019-12-05T03:50:40.618 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.612+0000 7f5f823da700 1 --2- 172.21.15.158:0/1911687756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f7c0aef60 0x7f5f7c0af390 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:40.619 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.612+0000 7f5f823da700 1 --2- 172.21.15.158:0/1911687756 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f5f5c03ac10 0x7f5f5c03d120 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:40.619 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.612+0000 7f5f823da700 1 --2- 172.21.15.158:0/1911687756 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5f7c07c7e0 0x7f5f7c0aea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:40.619 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.612+0000 7f5f823da700 1 -- 172.21.15.158:0/1911687756 shutdown_connections 2019-12-05T03:50:40.619 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.612+0000 7f5f823da700 1 -- 172.21.15.158:0/1911687756 wait complete. 2019-12-05T03:50:40.619 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.612+0000 7f5f823da700 1 -- 172.21.15.158:0/1911687756 >> 172.21.15.158:0/1911687756 conn(0x7f5f7c07e3f0 msgr2=0x7f5f7c0593f0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:40.630 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2019-12-05T03:50:40.725 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.712+0000 7f36fb2a6700 1 Processor -- start 2019-12-05T03:50:40.725 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.712+0000 7f36fb2a6700 1 -- start start 2019-12-05T03:50:40.725 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.716+0000 7f36fb2a6700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f36f409a310 0x7f36f405a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:40.726 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.716+0000 7f36fb2a6700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f36f41553a0 0x7f36f41557d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:40.726 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.716+0000 7f36fb2a6700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36f40acca0 con 0x7f36f409cf50 2019-12-05T03:50:40.726 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.716+0000 7f36fb2a6700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f409a740 con 0x7f36f41553a0 2019-12-05T03:50:40.726 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.716+0000 7f36fb2a6700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f40b1720 con 0x7f36f409a310 2019-12-05T03:50:40.726 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.716+0000 7f36f9042700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f36f409a310 0x7f36f405a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:40.726 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.716+0000 7f36f9042700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f36f409a310 0x7f36f405a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54770/0 (socket says 172.21.15.158:54770) 2019-12-05T03:50:40.727 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.716+0000 7f36f9042700 1 -- 172.21.15.158:0/3066431627 learned_addr learned my addr 172.21.15.158:0/3066431627 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:40.727 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.716+0000 7f36fa044700 1 --2- 172.21.15.158:0/3066431627 >> v2:172.21.15.96:3300/0 conn(0x7f36f41553a0 0x7f36f41557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:40.727 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.716+0000 7f36f9042700 1 -- 172.21.15.158:0/3066431627 >> v2:172.21.15.96:3300/0 conn(0x7f36f41553a0 msgr2=0x7f36f41557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:40.727 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.716+0000 7f36f9042700 1 --2- 172.21.15.158:0/3066431627 >> v2:172.21.15.96:3300/0 conn(0x7f36f41553a0 0x7f36f41557d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:40.727 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.716+0000 7f36f9042700 1 -- 172.21.15.158:0/3066431627 >> v1:172.21.15.96:6789/0 conn(0x7f36f409cf50 legacy=0x7f36f4151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:40.727 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.716+0000 7f36f9042700 1 -- 172.21.15.158:0/3066431627 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f40b6970 con 0x7f36f409a310 2019-12-05T03:50:40.728 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.716+0000 7f36f9042700 1 --2- 172.21.15.158:0/3066431627 >> v2:172.21.15.158:3300/0 conn(0x7f36f409a310 0x7f36f405a730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f36e4008790 tx=0x7f36e400fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.728 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.716+0000 7f36f9042700 1 --2- 172.21.15.158:0/3066431627 >> v2:172.21.15.158:3300/0 conn(0x7f36f409a310 0x7f36f405a730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f36e4008790 tx=0x7f36e400fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.728 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.716+0000 7f36f9042700 1 --2- 172.21.15.158:0/3066431627 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f36f409a310 0x7f36f405a730 secure :-1 s=READY pgs=302 cs=0 l=1 rx=0x7f36e4008790 tx=0x7f36e400fd30).ready entity=mon.1 client_cookie=559adebefec17e9e server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:40.728 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.716+0000 7f36f9042700 1 --2- 172.21.15.158:0/3066431627 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f36f409a310 0x7f36f405a730 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7f36e4008790 tx=0x7f36e400fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.728 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.716+0000 7f36f8841700 1 -- 172.21.15.158:0/3066431627 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36e4008c90 con 0x7f36f409a310 2019-12-05T03:50:40.728 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.716+0000 7f36f9042700 1 --2- 172.21.15.158:0/3066431627 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f36f409a310 0x7f36f405a730 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7f36e4008790 tx=0x7f36e400fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.728 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.716+0000 7f36f8841700 1 -- 172.21.15.158:0/3066431627 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e40088b0 con 0x7f36f409a310 2019-12-05T03:50:40.729 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.716+0000 7f36f9042700 1 --2- 172.21.15.158:0/3066431627 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f36f409a310 0x7f36f405a730 secure :-1 s=THROTTLE_DONE pgs=302 cs=0 l=1 rx=0x7f36e4008790 tx=0x7f36e400fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.729 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.716+0000 7f36f8841700 1 -- 172.21.15.158:0/3066431627 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36e4011ad0 con 0x7f36f409a310 2019-12-05T03:50:40.729 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.716+0000 7f36fb2a6700 1 -- 172.21.15.158:0/3066431627 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f36f409a310 msgr2=0x7f36f405a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:40.729 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.716+0000 7f36fb2a6700 1 --2- 172.21.15.158:0/3066431627 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f36f409a310 0x7f36f405a730 secure :-1 s=READY pgs=302 cs=0 l=1 rx=0x7f36e4008790 tx=0x7f36e400fd30).stop 2019-12-05T03:50:40.729 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.716+0000 7f36fb2a6700 1 -- 172.21.15.158:0/3066431627 shutdown_connections 2019-12-05T03:50:40.729 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.716+0000 7f36fb2a6700 1 --2- 172.21.15.158:0/3066431627 >> v2:172.21.15.96:3300/0 conn(0x7f36f41553a0 0x7f36f41557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:40.730 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.716+0000 7f36fb2a6700 1 --2- 172.21.15.158:0/3066431627 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f36f409a310 0x7f36f405a730 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:40.730 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.716+0000 7f36fb2a6700 1 -- 172.21.15.158:0/3066431627 shutdown_connections 2019-12-05T03:50:40.730 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.716+0000 7f36fb2a6700 1 -- 172.21.15.158:0/3066431627 wait complete. 2019-12-05T03:50:40.730 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.716+0000 7f36fb2a6700 1 -- 172.21.15.158:0/3066431627 >> 172.21.15.158:0/3066431627 conn(0x7f36f40b7e50 msgr2=0x7f36f40b3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:40.735 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.720+0000 7f36fb2a6700 1 Processor -- start 2019-12-05T03:50:40.735 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.720+0000 7f36fb2a6700 1 -- start start 2019-12-05T03:50:40.735 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.720+0000 7f36fb2a6700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f36f4152500 0x7f36f407ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:40.735 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.720+0000 7f36fb2a6700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f36f41539e0 0x7f36f4153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:40.735 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.720+0000 7f36fb2a6700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36f40b0f90 con 0x7f36f4133170 2019-12-05T03:50:40.735 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.720+0000 7f36fb2a6700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f4151fc0 con 0x7f36f41539e0 2019-12-05T03:50:40.736 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.720+0000 7f36fb2a6700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f4152260 con 0x7f36f4152500 2019-12-05T03:50:40.736 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.720+0000 7f36f9843700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f36f4152500 0x7f36f407ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:40.736 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.724+0000 7f36fa044700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f36f41539e0 0x7f36f4153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:40.736 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.724+0000 7f36f9843700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f36f4152500 0x7f36f407ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54774/0 (socket says 172.21.15.158:54774) 2019-12-05T03:50:40.736 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.724+0000 7f36f9843700 1 -- 172.21.15.158:0/422445274 learned_addr learned my addr 172.21.15.158:0/422445274 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:40.736 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.724+0000 7f36fa044700 1 -- 172.21.15.158:0/422445274 >> v2:172.21.15.158:3300/0 conn(0x7f36f4152500 msgr2=0x7f36f407ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:40.737 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.724+0000 7f36fa044700 1 --2- 172.21.15.158:0/422445274 >> v2:172.21.15.158:3300/0 conn(0x7f36f4152500 0x7f36f407ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:40.737 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.724+0000 7f36fa044700 1 -- 172.21.15.158:0/422445274 >> v1:172.21.15.96:6789/0 conn(0x7f36f4133170 legacy=0x7f36f40b03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:40.737 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.724+0000 7f36fa044700 1 -- 172.21.15.158:0/422445274 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f41335a0 con 0x7f36f41539e0 2019-12-05T03:50:40.737 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.724+0000 7f36ea7fc700 1 -- 172.21.15.158:0/422445274 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3058850646 0 0) 0x7f36f40b0f90 con 0x7f36f4133170 2019-12-05T03:50:40.737 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.724+0000 7f36f9843700 1 --2- 172.21.15.158:0/422445274 >> v2:172.21.15.158:3300/0 conn(0x7f36f4152500 0x7f36f407ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:50:40.737 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.724+0000 7f36fa044700 1 --2- 172.21.15.158:0/422445274 >> v2:172.21.15.96:3300/0 conn(0x7f36f41539e0 0x7f36f4153e10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f36f4152180 tx=0x7f36ec012a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.738 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.724+0000 7f36fa044700 1 --2- 172.21.15.158:0/422445274 >> v2:172.21.15.96:3300/0 conn(0x7f36f41539e0 0x7f36f4153e10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f36f4152180 tx=0x7f36ec012a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.738 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.724+0000 7f36fa044700 1 --2- 172.21.15.158:0/422445274 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36f41539e0 0x7f36f4153e10 secure :-1 s=READY pgs=222 cs=0 l=1 rx=0x7f36f4152180 tx=0x7f36ec012a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:40.738 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.724+0000 7f36fa044700 1 --2- 172.21.15.158:0/422445274 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36f41539e0 0x7f36f4153e10 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f36f4152180 tx=0x7f36ec012a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.738 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.724+0000 7f36ea7fc700 1 -- 172.21.15.158:0/422445274 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36ec00a160 con 0x7f36f41539e0 2019-12-05T03:50:40.738 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.724+0000 7f36fa044700 1 --2- 172.21.15.158:0/422445274 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36f41539e0 0x7f36f4153e10 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f36f4152180 tx=0x7f36ec012a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.738 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.724+0000 7f36fa044700 1 --2- 172.21.15.158:0/422445274 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36f41539e0 0x7f36f4153e10 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f36f4152180 tx=0x7f36ec012a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.738 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.724+0000 7f36ea7fc700 1 -- 172.21.15.158:0/422445274 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ec008af0 con 0x7f36f41539e0 2019-12-05T03:50:40.739 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.724+0000 7f36fb2a6700 1 -- 172.21.15.158:0/422445274 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f40ac2c0 con 0x7f36f41539e0 2019-12-05T03:50:40.739 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.724+0000 7f36ea7fc700 1 -- 172.21.15.158:0/422445274 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36ec00a740 con 0x7f36f41539e0 2019-12-05T03:50:40.739 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.724+0000 7f36fb2a6700 1 -- 172.21.15.158:0/422445274 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f40ac620 con 0x7f36f41539e0 2019-12-05T03:50:40.739 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.724+0000 7f36fa044700 1 --2- 172.21.15.158:0/422445274 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36f41539e0 0x7f36f4153e10 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f36f4152180 tx=0x7f36ec012a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.739 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.724+0000 7f36fa044700 1 --2- 172.21.15.158:0/422445274 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36f41539e0 0x7f36f4153e10 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f36f4152180 tx=0x7f36ec012a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.739 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.724+0000 7f36ea7fc700 1 -- 172.21.15.158:0/422445274 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f36ec00aa20 con 0x7f36f41539e0 2019-12-05T03:50:40.740 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.728+0000 7f36ea7fc700 1 --2- 172.21.15.158:0/422445274 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f36dc03ac10 0x7f36dc03d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:40.740 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.728+0000 7f36ea7fc700 1 -- 172.21.15.158:0/422445274 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f36ec04d3d0 con 0x7f36f41539e0 2019-12-05T03:50:40.740 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.728+0000 7f36f9843700 1 --2- 172.21.15.158:0/422445274 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f36dc03ac10 0x7f36dc03d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:40.740 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.728+0000 7f36f9843700 1 --2- 172.21.15.158:0/422445274 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f36dc03ac10 0x7f36dc03d120 crc :-1 s=READY pgs=141 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:40.740 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.728+0000 7f36fb2a6700 1 -- 172.21.15.158:0/422445274 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f40554d0 con 0x7f36f41539e0 2019-12-05T03:50:40.749 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.736+0000 7f36fa044700 1 --2- 172.21.15.158:0/422445274 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36f41539e0 0x7f36f4153e10 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f36f4152180 tx=0x7f36ec012a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.749 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.736+0000 7f36ea7fc700 1 -- 172.21.15.158:0/422445274 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f36ec034390 con 0x7f36f41539e0 2019-12-05T03:50:40.906 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.900+0000 7f36fb2a6700 1 -- 172.21.15.158:0/422445274 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f36f41561f0 con 0x7f36f41539e0 2019-12-05T03:50:40.914 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.908+0000 7f36fa044700 1 --2- 172.21.15.158:0/422445274 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36f41539e0 0x7f36f4153e10 secure :-1 s=THROTTLE_DONE pgs=222 cs=0 l=1 rx=0x7f36f4152180 tx=0x7f36ec012a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:40.914 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.908+0000 7f36ea7fc700 1 -- 172.21.15.158:0/422445274 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 updated v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f36ec0345f0 con 0x7f36f41539e0 2019-12-05T03:50:40.921 INFO:teuthology.orchestra.run.smithi158.stderr:updated 2019-12-05T03:50:40.924 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.916+0000 7f36fb2a6700 1 -- 172.21.15.158:0/422445274 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f36dc03ac10 msgr2=0x7f36dc03d120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:40.925 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.916+0000 7f36fb2a6700 1 --2- 172.21.15.158:0/422445274 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f36dc03ac10 0x7f36dc03d120 crc :-1 s=READY pgs=141 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:40.925 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.916+0000 7f36fb2a6700 1 -- 172.21.15.158:0/422445274 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36f41539e0 msgr2=0x7f36f4153e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:40.925 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.916+0000 7f36fb2a6700 1 --2- 172.21.15.158:0/422445274 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36f41539e0 0x7f36f4153e10 secure :-1 s=READY pgs=222 cs=0 l=1 rx=0x7f36f4152180 tx=0x7f36ec012a90).stop 2019-12-05T03:50:40.925 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.916+0000 7f36fb2a6700 1 -- 172.21.15.158:0/422445274 shutdown_connections 2019-12-05T03:50:40.925 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.916+0000 7f36fb2a6700 1 --2- 172.21.15.158:0/422445274 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f36f41539e0 0x7f36f4153e10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:40.926 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.916+0000 7f36fb2a6700 1 --2- 172.21.15.158:0/422445274 >> v2:172.21.15.158:3300/0 conn(0x7f36f4152500 0x7f36f407ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:40.926 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.916+0000 7f36fb2a6700 1 --2- 172.21.15.158:0/422445274 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f36dc03ac10 0x7f36dc03d120 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:40.926 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.916+0000 7f36fb2a6700 1 -- 172.21.15.158:0/422445274 shutdown_connections 2019-12-05T03:50:40.926 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.916+0000 7f36fb2a6700 1 -- 172.21.15.158:0/422445274 wait complete. 2019-12-05T03:50:40.926 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:40.916+0000 7f36fb2a6700 1 -- 172.21.15.158:0/422445274 >> 172.21.15.158:0/422445274 conn(0x7f36f409ab10 msgr2=0x7f36f4155310 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:40.937 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2019-12-05T03:50:41.032 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.020+0000 7fe720b66700 1 Processor -- start 2019-12-05T03:50:41.033 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.020+0000 7fe720b66700 1 -- start start 2019-12-05T03:50:41.033 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.024+0000 7fe720b66700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe71c09cf50 0x7fe71c09a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:41.033 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.024+0000 7fe720b66700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe71c05a730 0x7fe71c151450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:41.033 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.024+0000 7fe720b66700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe71c0acca0 con 0x7fe71c1519a0 2019-12-05T03:50:41.033 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.024+0000 7fe720b66700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe71c0b1720 con 0x7fe71c09cf50 2019-12-05T03:50:41.034 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.024+0000 7fe720b66700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe71c0b19c0 con 0x7fe71c05a730 2019-12-05T03:50:41.034 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.024+0000 7fe71a59c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe71c05a730 0x7fe71c151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:41.034 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.024+0000 7fe71b59e700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fe71c1519a0 0x7fe71c0b52d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49566/0 (socket says 172.21.15.158:49566) 2019-12-05T03:50:41.034 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.024+0000 7fe71a59c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fe71c05a730 0x7fe71c151450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54782/0 (socket says 172.21.15.158:54782) 2019-12-05T03:50:41.034 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.024+0000 7fe71a59c700 1 -- 172.21.15.158:0/1757686376 learned_addr learned my addr 172.21.15.158:0/1757686376 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:41.034 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.024+0000 7fe71ad9d700 1 --2- 172.21.15.158:0/1757686376 >> v2:172.21.15.96:3300/0 conn(0x7fe71c09cf50 0x7fe71c09a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:41.034 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.024+0000 7fe71a59c700 1 -- 172.21.15.158:0/1757686376 >> v2:172.21.15.96:3300/0 conn(0x7fe71c09cf50 msgr2=0x7fe71c09a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:41.035 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.024+0000 7fe71a59c700 1 --2- 172.21.15.158:0/1757686376 >> v2:172.21.15.96:3300/0 conn(0x7fe71c09cf50 0x7fe71c09a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:41.035 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.024+0000 7fe71a59c700 1 -- 172.21.15.158:0/1757686376 >> v1:172.21.15.158:6789/0 conn(0x7fe71c1519a0 legacy=0x7fe71c0b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:41.035 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.024+0000 7fe71a59c700 1 -- 172.21.15.158:0/1757686376 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe71c05ab60 con 0x7fe71c05a730 2019-12-05T03:50:41.035 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.024+0000 7fe71a59c700 1 --2- 172.21.15.158:0/1757686376 >> v2:172.21.15.158:3300/0 conn(0x7fe71c05a730 0x7fe71c151450 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe704002f30 tx=0x7fe70400fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.035 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.024+0000 7fe71a59c700 1 --2- 172.21.15.158:0/1757686376 >> v2:172.21.15.158:3300/0 conn(0x7fe71c05a730 0x7fe71c151450 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe704002f30 tx=0x7fe70400fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.035 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.024+0000 7fe71a59c700 1 --2- 172.21.15.158:0/1757686376 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe71c05a730 0x7fe71c151450 secure :-1 s=READY pgs=304 cs=0 l=1 rx=0x7fe704002f30 tx=0x7fe70400fd30).ready entity=mon.1 client_cookie=e66d23a7f4cf050f server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:41.035 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.024+0000 7fe71a59c700 1 --2- 172.21.15.158:0/1757686376 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe71c05a730 0x7fe71c151450 secure :-1 s=THROTTLE_DONE pgs=304 cs=0 l=1 rx=0x7fe704002f30 tx=0x7fe70400fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.036 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.024+0000 7fe719d9b700 1 -- 172.21.15.158:0/1757686376 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe704011370 con 0x7fe71c05a730 2019-12-05T03:50:41.036 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.024+0000 7fe71a59c700 1 --2- 172.21.15.158:0/1757686376 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe71c05a730 0x7fe71c151450 secure :-1 s=THROTTLE_DONE pgs=304 cs=0 l=1 rx=0x7fe704002f30 tx=0x7fe70400fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.036 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.024+0000 7fe71a59c700 1 --2- 172.21.15.158:0/1757686376 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe71c05a730 0x7fe71c151450 secure :-1 s=THROTTLE_DONE pgs=304 cs=0 l=1 rx=0x7fe704002f30 tx=0x7fe70400fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.036 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.024+0000 7fe719d9b700 1 -- 172.21.15.158:0/1757686376 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe704008bb0 con 0x7fe71c05a730 2019-12-05T03:50:41.036 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.024+0000 7fe719d9b700 1 -- 172.21.15.158:0/1757686376 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe704011950 con 0x7fe71c05a730 2019-12-05T03:50:41.036 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.024+0000 7fe720b66700 1 -- 172.21.15.158:0/1757686376 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe71c05a730 msgr2=0x7fe71c151450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:41.037 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.024+0000 7fe720b66700 1 --2- 172.21.15.158:0/1757686376 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe71c05a730 0x7fe71c151450 secure :-1 s=READY pgs=304 cs=0 l=1 rx=0x7fe704002f30 tx=0x7fe70400fd30).stop 2019-12-05T03:50:41.038 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.024+0000 7fe720b66700 1 -- 172.21.15.158:0/1757686376 shutdown_connections 2019-12-05T03:50:41.038 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.024+0000 7fe720b66700 1 --2- 172.21.15.158:0/1757686376 >> v2:172.21.15.96:3300/0 conn(0x7fe71c09cf50 0x7fe71c09a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:41.038 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.024+0000 7fe720b66700 1 --2- 172.21.15.158:0/1757686376 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe71c05a730 0x7fe71c151450 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:41.038 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.024+0000 7fe720b66700 1 -- 172.21.15.158:0/1757686376 shutdown_connections 2019-12-05T03:50:41.038 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.024+0000 7fe720b66700 1 -- 172.21.15.158:0/1757686376 wait complete. 2019-12-05T03:50:41.038 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.024+0000 7fe720b66700 1 -- 172.21.15.158:0/1757686376 >> 172.21.15.158:0/1757686376 conn(0x7fe71c0b7e50 msgr2=0x7fe71c0b3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:41.044 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe720b66700 1 Processor -- start 2019-12-05T03:50:41.044 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe720b66700 1 -- start start 2019-12-05T03:50:41.044 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe720b66700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe71c136bd0 0x7fe71c0afb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:41.044 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe720b66700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe71c137000 con 0x7fe71c1275f0 2019-12-05T03:50:41.045 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe720b66700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe71c07b900 con 0x7fe71c128d50 2019-12-05T03:50:41.045 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe720b66700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe71c128580 con 0x7fe71c136bd0 2019-12-05T03:50:41.045 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe71a59c700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fe71c128d50 0x7fe71c132d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49568/0 (socket says 172.21.15.158:49568) 2019-12-05T03:50:41.045 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe71a59c700 1 -- 172.21.15.158:0/1406284866 learned_addr learned my addr 172.21.15.158:0/1406284866 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:41.045 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe71b59e700 1 --2- 172.21.15.158:0/1406284866 >> v2:172.21.15.96:3300/0 conn(0x7fe71c136bd0 0x7fe71c0afb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:41.045 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe7137fe700 1 -- 172.21.15.158:0/1406284866 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3697562416 0 0) 0x7fe71c07b900 con 0x7fe71c128d50 2019-12-05T03:50:41.045 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe7137fe700 1 -- 172.21.15.158:0/1406284866 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7000030b0 con 0x7fe71c128d50 2019-12-05T03:50:41.046 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe7137fe700 1 -- 172.21.15.158:0/1406284866 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 818097207 0 0) 0x7fe71c137000 con 0x7fe71c1275f0 2019-12-05T03:50:41.046 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe7137fe700 1 -- 172.21.15.158:0/1406284866 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe71c07b900 con 0x7fe71c1275f0 2019-12-05T03:50:41.046 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe7137fe700 1 -- 172.21.15.158:0/1406284866 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 786281846 0 0) 0x7fe7000030b0 con 0x7fe71c128d50 2019-12-05T03:50:41.046 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe7137fe700 1 -- 172.21.15.158:0/1406284866 --> v1:172.21.15.158:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe71c137000 con 0x7fe71c128d50 2019-12-05T03:50:41.046 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe7137fe700 1 -- 172.21.15.158:0/1406284866 <== mon.1 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 828730332 0 0) 0x7fe704011370 con 0x7fe71c128d50 2019-12-05T03:50:41.046 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe7137fe700 1 -- 172.21.15.158:0/1406284866 >> v2:172.21.15.96:3300/0 conn(0x7fe71c136bd0 msgr2=0x7fe71c0afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:41.047 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe7137fe700 1 --2- 172.21.15.158:0/1406284866 >> v2:172.21.15.96:3300/0 conn(0x7fe71c136bd0 0x7fe71c0afb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:41.047 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe7137fe700 1 -- 172.21.15.158:0/1406284866 >> v1:172.21.15.158:6789/0 conn(0x7fe71c128d50 legacy=0x7fe71c132d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:41.047 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe7137fe700 1 -- 172.21.15.158:0/1406284866 >> v1:172.21.15.96:6789/0 conn(0x7fe71c1275f0 legacy=0x7fe71c07b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:41.048 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe7137fe700 1 --2- 172.21.15.158:0/1406284866 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe700003ab0 0x7fe700004420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:41.048 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe7137fe700 1 --2- 172.21.15.158:0/1406284866 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe700004970 0x7fe700004da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:41.048 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe7137fe700 1 --2- 172.21.15.158:0/1406284866 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe700009660 0x7fe70000baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:41.049 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe7137fe700 1 -- 172.21.15.158:0/1406284866 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c128580 con 0x7fe700003ab0 2019-12-05T03:50:41.049 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe7137fe700 1 -- 172.21.15.158:0/1406284866 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70000bff0 con 0x7fe700009660 2019-12-05T03:50:41.049 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe7137fe700 1 -- 172.21.15.158:0/1406284866 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70000c1b0 con 0x7fe700004970 2019-12-05T03:50:41.049 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe71b59e700 1 --2- 172.21.15.158:0/1406284866 >> v2:172.21.15.96:3300/0 conn(0x7fe71c136bd0 0x7fe71c0afb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:50:41.049 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe71a59c700 1 --2- 172.21.15.158:0/1406284866 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe700004970 0x7fe700004da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:41.049 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe71ad9d700 1 --2- 172.21.15.158:0/1406284866 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe700003ab0 0x7fe700004420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:41.050 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe71b59e700 1 --2- 172.21.15.158:0/1406284866 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe700009660 0x7fe70000baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:41.050 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe71a59c700 1 -- 172.21.15.158:0/1406284866 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe700009660 msgr2=0x7fe70000baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:41.050 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe71a59c700 1 --2- 172.21.15.158:0/1406284866 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fe700009660 0x7fe70000baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:41.050 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe71a59c700 1 -- 172.21.15.158:0/1406284866 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe700003ab0 msgr2=0x7fe700004420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:41.050 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe71a59c700 1 --2- 172.21.15.158:0/1406284866 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe700003ab0 0x7fe700004420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:41.050 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe71b59e700 1 -- 172.21.15.158:0/1406284866 reap_dead start 2019-12-05T03:50:41.051 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe71a59c700 1 -- 172.21.15.158:0/1406284866 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe71c129180 con 0x7fe700004970 2019-12-05T03:50:41.051 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe720b66700 1 -- 172.21.15.158:0/1406284866 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe71c128d50 con 0x7fe700004970 2019-12-05T03:50:41.051 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe71ad9d700 1 --2- 172.21.15.158:0/1406284866 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe700003ab0 0x7fe700004420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:50:41.051 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe720b66700 1 -- 172.21.15.158:0/1406284866 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe71c1275f0 con 0x7fe700004970 2019-12-05T03:50:41.051 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe71a59c700 1 --2- 172.21.15.158:0/1406284866 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe700004970 0x7fe700004da0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe704008fc0 tx=0x7fe704007670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.051 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.028+0000 7fe71a59c700 1 --2- 172.21.15.158:0/1406284866 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe700004970 0x7fe700004da0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe704008fc0 tx=0x7fe704007670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.052 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.032+0000 7fe71a59c700 1 --2- 172.21.15.158:0/1406284866 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe700004970 0x7fe700004da0 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7fe704008fc0 tx=0x7fe704007670).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:41.052 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.032+0000 7fe71a59c700 1 --2- 172.21.15.158:0/1406284866 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe700004970 0x7fe700004da0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7fe704008fc0 tx=0x7fe704007670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.052 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.032+0000 7fe7137fe700 1 -- 172.21.15.158:0/1406284866 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe704005540 con 0x7fe700004970 2019-12-05T03:50:41.052 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.032+0000 7fe71a59c700 1 --2- 172.21.15.158:0/1406284866 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe700004970 0x7fe700004da0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7fe704008fc0 tx=0x7fe704007670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.052 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.032+0000 7fe7137fe700 1 -- 172.21.15.158:0/1406284866 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe704007150 con 0x7fe700004970 2019-12-05T03:50:41.052 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.032+0000 7fe71a59c700 1 --2- 172.21.15.158:0/1406284866 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe700004970 0x7fe700004da0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7fe704008fc0 tx=0x7fe704007670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.052 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.032+0000 7fe7137fe700 1 -- 172.21.15.158:0/1406284866 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe704005b20 con 0x7fe700004970 2019-12-05T03:50:41.053 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.032+0000 7fe71a59c700 1 --2- 172.21.15.158:0/1406284866 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe700004970 0x7fe700004da0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7fe704008fc0 tx=0x7fe704007670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.053 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.032+0000 7fe7137fe700 1 -- 172.21.15.158:0/1406284866 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fe70400a4f0 con 0x7fe700004970 2019-12-05T03:50:41.053 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.032+0000 7fe71a59c700 1 --2- 172.21.15.158:0/1406284866 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe700004970 0x7fe700004da0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7fe704008fc0 tx=0x7fe704007670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.053 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.032+0000 7fe7137fe700 1 --2- 172.21.15.158:0/1406284866 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fe700040ce0 0x7fe7000431f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:41.053 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.032+0000 7fe7137fe700 1 -- 172.21.15.158:0/1406284866 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5200+0+0 (secure 0 0 0) 0x7fe70404c070 con 0x7fe700004970 2019-12-05T03:50:41.053 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.032+0000 7fe71ad9d700 1 --2- 172.21.15.158:0/1406284866 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fe700040ce0 0x7fe7000431f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:41.054 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.032+0000 7fe71ad9d700 1 --2- 172.21.15.158:0/1406284866 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fe700040ce0 0x7fe7000431f0 crc :-1 s=READY pgs=142 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:41.054 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.036+0000 7fe720b66700 1 -- 172.21.15.158:0/1406284866 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f4003200 con 0x7fe700004970 2019-12-05T03:50:41.054 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.044+0000 7fe71a59c700 1 --2- 172.21.15.158:0/1406284866 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe700004970 0x7fe700004da0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7fe704008fc0 tx=0x7fe704007670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.055 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.044+0000 7fe7137fe700 1 -- 172.21.15.158:0/1406284866 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fe7040330d0 con 0x7fe700004970 2019-12-05T03:50:41.217 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.212+0000 7fe720b66700 1 -- 172.21.15.158:0/1406284866 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fe6f4003650 con 0x7fe700004970 2019-12-05T03:50:41.226 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.220+0000 7fe71a59c700 1 --2- 172.21.15.158:0/1406284866 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe700004970 0x7fe700004da0 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7fe704008fc0 tx=0x7fe704007670).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.226 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.220+0000 7fe7137fe700 1 -- 172.21.15.158:0/1406284866 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 updated v12) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe704033330 con 0x7fe700004970 2019-12-05T03:50:41.233 INFO:teuthology.orchestra.run.smithi158.stderr:updated 2019-12-05T03:50:41.236 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.228+0000 7fe720b66700 1 -- 172.21.15.158:0/1406284866 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fe700040ce0 msgr2=0x7fe7000431f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:41.236 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.228+0000 7fe720b66700 1 --2- 172.21.15.158:0/1406284866 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fe700040ce0 0x7fe7000431f0 crc :-1 s=READY pgs=142 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:41.236 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.228+0000 7fe720b66700 1 -- 172.21.15.158:0/1406284866 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe700004970 msgr2=0x7fe700004da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:41.237 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.228+0000 7fe720b66700 1 --2- 172.21.15.158:0/1406284866 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe700004970 0x7fe700004da0 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7fe704008fc0 tx=0x7fe704007670).stop 2019-12-05T03:50:41.237 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.228+0000 7fe720b66700 1 -- 172.21.15.158:0/1406284866 shutdown_connections 2019-12-05T03:50:41.237 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.228+0000 7fe720b66700 1 --2- 172.21.15.158:0/1406284866 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fe700040ce0 0x7fe7000431f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:41.237 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.228+0000 7fe720b66700 1 --2- 172.21.15.158:0/1406284866 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fe700004970 0x7fe700004da0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:41.237 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.228+0000 7fe720b66700 1 -- 172.21.15.158:0/1406284866 shutdown_connections 2019-12-05T03:50:41.237 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.228+0000 7fe720b66700 1 -- 172.21.15.158:0/1406284866 wait complete. 2019-12-05T03:50:41.237 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.228+0000 7fe720b66700 1 -- 172.21.15.158:0/1406284866 >> 172.21.15.158:0/1406284866 conn(0x7fe71c09ba70 msgr2=0x7fe71c0b52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:41.248 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-05T03:50:41.342 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.328+0000 7f51f58f4700 1 Processor -- start 2019-12-05T03:50:41.343 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.332+0000 7f51f58f4700 1 -- start start 2019-12-05T03:50:41.343 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.332+0000 7f51f58f4700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f51f009a320 0x7f51f005a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:41.343 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.332+0000 7f51f58f4700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f51f01553b0 0x7f51f01557e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:41.343 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.332+0000 7f51f58f4700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f00accb0 con 0x7f51f009cf60 2019-12-05T03:50:41.343 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.332+0000 7f51f58f4700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f009a750 con 0x7f51f009a320 2019-12-05T03:50:41.343 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.332+0000 7f51f58f4700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f00b1730 con 0x7f51f01553b0 2019-12-05T03:50:41.344 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.332+0000 7f51effff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f51f01553b0 0x7f51f01557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:41.344 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.332+0000 7f51effff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f51f01553b0 0x7f51f01557e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54806/0 (socket says 172.21.15.158:54806) 2019-12-05T03:50:41.344 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.332+0000 7f51effff700 1 -- 172.21.15.158:0/4183802024 learned_addr learned my addr 172.21.15.158:0/4183802024 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:41.344 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.332+0000 7f51eeffd700 1 --2- 172.21.15.158:0/4183802024 >> v2:172.21.15.96:3300/0 conn(0x7f51f009a320 0x7f51f005a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:41.344 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.332+0000 7f51effff700 1 -- 172.21.15.158:0/4183802024 >> v2:172.21.15.96:3300/0 conn(0x7f51f009a320 msgr2=0x7f51f005a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:41.344 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.332+0000 7f51effff700 1 --2- 172.21.15.158:0/4183802024 >> v2:172.21.15.96:3300/0 conn(0x7f51f009a320 0x7f51f005a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:41.344 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.332+0000 7f51effff700 1 -- 172.21.15.158:0/4183802024 >> v1:172.21.15.96:6789/0 conn(0x7f51f009cf60 legacy=0x7f51f0151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:41.345 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.332+0000 7f51effff700 1 -- 172.21.15.158:0/4183802024 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f00b6980 con 0x7f51f01553b0 2019-12-05T03:50:41.345 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.332+0000 7f51effff700 1 --2- 172.21.15.158:0/4183802024 >> v2:172.21.15.158:3300/0 conn(0x7f51f01553b0 0x7f51f01557e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f51e8008b10 tx=0x7f51e80100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.345 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.332+0000 7f51effff700 1 --2- 172.21.15.158:0/4183802024 >> v2:172.21.15.158:3300/0 conn(0x7f51f01553b0 0x7f51f01557e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f51e8008b10 tx=0x7f51e80100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.345 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.332+0000 7f51effff700 1 --2- 172.21.15.158:0/4183802024 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f51f01553b0 0x7f51f01557e0 secure :-1 s=READY pgs=306 cs=0 l=1 rx=0x7f51e8008b10 tx=0x7f51e80100b0).ready entity=mon.1 client_cookie=6e9a4d55ee2f168e server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:41.345 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.332+0000 7f51effff700 1 --2- 172.21.15.158:0/4183802024 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f51f01553b0 0x7f51f01557e0 secure :-1 s=THROTTLE_DONE pgs=306 cs=0 l=1 rx=0x7f51e8008b10 tx=0x7f51e80100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.345 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.332+0000 7f51ee7fc700 1 -- 172.21.15.158:0/4183802024 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51e8010d60 con 0x7f51f01553b0 2019-12-05T03:50:41.345 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.332+0000 7f51effff700 1 --2- 172.21.15.158:0/4183802024 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f51f01553b0 0x7f51f01557e0 secure :-1 s=THROTTLE_DONE pgs=306 cs=0 l=1 rx=0x7f51e8008b10 tx=0x7f51e80100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.346 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.332+0000 7f51ee7fc700 1 -- 172.21.15.158:0/4183802024 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e8010980 con 0x7f51f01553b0 2019-12-05T03:50:41.346 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.332+0000 7f51effff700 1 --2- 172.21.15.158:0/4183802024 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f51f01553b0 0x7f51f01557e0 secure :-1 s=THROTTLE_DONE pgs=306 cs=0 l=1 rx=0x7f51e8008b10 tx=0x7f51e80100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.346 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.332+0000 7f51ee7fc700 1 -- 172.21.15.158:0/4183802024 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51e80114a0 con 0x7f51f01553b0 2019-12-05T03:50:41.346 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.332+0000 7f51f58f4700 1 -- 172.21.15.158:0/4183802024 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f51f01553b0 msgr2=0x7f51f01557e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:41.346 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.332+0000 7f51f58f4700 1 --2- 172.21.15.158:0/4183802024 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f51f01553b0 0x7f51f01557e0 secure :-1 s=READY pgs=306 cs=0 l=1 rx=0x7f51e8008b10 tx=0x7f51e80100b0).stop 2019-12-05T03:50:41.346 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.336+0000 7f51f58f4700 1 -- 172.21.15.158:0/4183802024 shutdown_connections 2019-12-05T03:50:41.346 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.336+0000 7f51f58f4700 1 --2- 172.21.15.158:0/4183802024 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f51f01553b0 0x7f51f01557e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:41.347 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.336+0000 7f51f58f4700 1 --2- 172.21.15.158:0/4183802024 >> v2:172.21.15.96:3300/0 conn(0x7f51f009a320 0x7f51f005a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:41.347 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.336+0000 7f51f58f4700 1 -- 172.21.15.158:0/4183802024 shutdown_connections 2019-12-05T03:50:41.347 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.336+0000 7f51f58f4700 1 -- 172.21.15.158:0/4183802024 wait complete. 2019-12-05T03:50:41.347 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.336+0000 7f51f58f4700 1 -- 172.21.15.158:0/4183802024 >> 172.21.15.158:0/4183802024 conn(0x7f51f00b7e60 msgr2=0x7f51f00b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:41.352 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.336+0000 7f51f58f4700 1 Processor -- start 2019-12-05T03:50:41.352 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.336+0000 7f51f58f4700 1 -- start start 2019-12-05T03:50:41.353 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.340+0000 7f51f58f4700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f51f011f0e0 0x7f51f00ad880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:41.353 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.340+0000 7f51f58f4700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f0137250 con 0x7f51f00748c0 2019-12-05T03:50:41.353 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.340+0000 7f51f58f4700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f01209e0 con 0x7f51f0137c80 2019-12-05T03:50:41.353 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.340+0000 7f51f58f4700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f00b34a0 con 0x7f51f011f0e0 2019-12-05T03:50:41.353 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.340+0000 7f51ef7fe700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f51f0137c80 0x7f51f00740c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49588/0 (socket says 172.21.15.158:49588) 2019-12-05T03:50:41.353 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.340+0000 7f51ef7fe700 1 -- 172.21.15.158:0/1886026946 learned_addr learned my addr 172.21.15.158:0/1886026946 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:41.354 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.340+0000 7f51effff700 1 --2- 172.21.15.158:0/1886026946 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f51f011f0e0 0x7f51f00ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:41.354 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.340+0000 7f51e7fff700 1 -- 172.21.15.158:0/1886026946 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3524861032 0 0) 0x7f51f01209e0 con 0x7f51f0137c80 2019-12-05T03:50:41.354 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.340+0000 7f51e7fff700 1 -- 172.21.15.158:0/1886026946 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51d40030b0 con 0x7f51f0137c80 2019-12-05T03:50:41.354 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.340+0000 7f51e7fff700 1 -- 172.21.15.158:0/1886026946 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3570254844 0 0) 0x7f51f0137250 con 0x7f51f00748c0 2019-12-05T03:50:41.354 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.340+0000 7f51e7fff700 1 -- 172.21.15.158:0/1886026946 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51f01209e0 con 0x7f51f00748c0 2019-12-05T03:50:41.354 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.340+0000 7f51e7fff700 1 -- 172.21.15.158:0/1886026946 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 567128635 0 0) 0x7f51d40030b0 con 0x7f51f0137c80 2019-12-05T03:50:41.354 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.340+0000 7f51effff700 1 -- 172.21.15.158:0/1886026946 >> v1:172.21.15.158:6789/0 conn(0x7f51f0137c80 legacy=0x7f51f00740c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:41.355 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.340+0000 7f51effff700 1 -- 172.21.15.158:0/1886026946 >> v1:172.21.15.96:6789/0 conn(0x7f51f00748c0 legacy=0x7f51f00ad080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:41.355 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.340+0000 7f51effff700 1 -- 172.21.15.158:0/1886026946 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f011f510 con 0x7f51f011f0e0 2019-12-05T03:50:41.355 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.340+0000 7f51effff700 1 --2- 172.21.15.158:0/1886026946 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f51f011f0e0 0x7f51f00ad880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f51e0001830 tx=0x7f51e0001c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.355 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.340+0000 7f51effff700 1 --2- 172.21.15.158:0/1886026946 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f51f011f0e0 0x7f51f00ad880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f51e0001830 tx=0x7f51e0001c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.355 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.340+0000 7f51effff700 1 --2- 172.21.15.158:0/1886026946 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f51f011f0e0 0x7f51f00ad880 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f51e0001830 tx=0x7f51e0001c60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:41.355 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.340+0000 7f51effff700 1 --2- 172.21.15.158:0/1886026946 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f51f011f0e0 0x7f51f00ad880 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f51e0001830 tx=0x7f51e0001c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.355 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.340+0000 7f51e7fff700 1 -- 172.21.15.158:0/1886026946 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51e0001a60 con 0x7f51f011f0e0 2019-12-05T03:50:41.356 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.340+0000 7f51effff700 1 --2- 172.21.15.158:0/1886026946 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f51f011f0e0 0x7f51f00ad880 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f51e0001830 tx=0x7f51e0001c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.356 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.340+0000 7f51f58f4700 1 -- 172.21.15.158:0/1886026946 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51f00addd0 con 0x7f51f011f0e0 2019-12-05T03:50:41.356 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.340+0000 7f51e7fff700 1 -- 172.21.15.158:0/1886026946 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e0001870 con 0x7f51f011f0e0 2019-12-05T03:50:41.356 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.340+0000 7f51effff700 1 --2- 172.21.15.158:0/1886026946 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f51f011f0e0 0x7f51f00ad880 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f51e0001830 tx=0x7f51e0001c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.356 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.340+0000 7f51e7fff700 1 -- 172.21.15.158:0/1886026946 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51e8011d70 con 0x7f51f011f0e0 2019-12-05T03:50:41.356 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.340+0000 7f51f58f4700 1 -- 172.21.15.158:0/1886026946 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f00ae320 con 0x7f51f011f0e0 2019-12-05T03:50:41.356 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.344+0000 7f51effff700 1 --2- 172.21.15.158:0/1886026946 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f51f011f0e0 0x7f51f00ad880 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f51e0001830 tx=0x7f51e0001c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.356 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.344+0000 7f51effff700 1 --2- 172.21.15.158:0/1886026946 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f51f011f0e0 0x7f51f00ad880 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f51e0001830 tx=0x7f51e0001c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.357 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.344+0000 7f51e7fff700 1 -- 172.21.15.158:0/1886026946 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f51e80058c0 con 0x7f51f011f0e0 2019-12-05T03:50:41.357 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.344+0000 7f51e7fff700 1 --2- 172.21.15.158:0/1886026946 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f51d403b400 0x7f51d403d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:41.357 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.344+0000 7f51e7fff700 1 -- 172.21.15.158:0/1886026946 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f51e804af00 con 0x7f51f011f0e0 2019-12-05T03:50:41.357 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.344+0000 7f51ef7fe700 1 --2- 172.21.15.158:0/1886026946 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f51d403b400 0x7f51d403d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:41.357 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.344+0000 7f51ef7fe700 1 --2- 172.21.15.158:0/1886026946 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f51d403b400 0x7f51d403d910 crc :-1 s=READY pgs=143 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:41.358 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.344+0000 7f51f58f4700 1 -- 172.21.15.158:0/1886026946 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51f00554e0 con 0x7f51f011f0e0 2019-12-05T03:50:41.362 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.356+0000 7f51effff700 1 --2- 172.21.15.158:0/1886026946 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f51f011f0e0 0x7f51f00ad880 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f51e0001830 tx=0x7f51e0001c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.362 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.356+0000 7f51e7fff700 1 -- 172.21.15.158:0/1886026946 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f51e8031f40 con 0x7f51f011f0e0 2019-12-05T03:50:41.529 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.524+0000 7f51f58f4700 1 -- 172.21.15.158:0/1886026946 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51f009a530 con 0x7f51f011f0e0 2019-12-05T03:50:41.531 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.524+0000 7f51effff700 1 --2- 172.21.15.158:0/1886026946 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f51f011f0e0 0x7f51f00ad880 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f51e0001830 tx=0x7f51e0001c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.531 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.524+0000 7f51e7fff700 1 -- 172.21.15.158:0/1886026946 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+12048 (secure 0 0 0) 0x7f51e80321a0 con 0x7f51f011f0e0 2019-12-05T03:50:41.532 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:41.533 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":28,"fsid":"a91186ae-f496-4de1-918d-820c55ff1feb","created":"2019-12-05T03:49:39.187523+0000","modified":"2019-12-05T03:50:39.029481+0000","last_up_change":"2019-12-05T03:49:48.551934+0000","last_in_change":"2019-12-05T03:49:48.551934+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-05T03:49:52.900870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"782c4258-e28c-4a11-9d54-3c9c7a36fba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":12192},{"type":"v1","addr":"172.21.15.158:6801","nonce":12192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":12192},{"type":"v1","addr":"172.21.15.158:6803","nonce":12192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":12192},{"type":"v1","addr":"172.21.15.158:6807","nonce":12192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":12192},{"type":"v1","addr":"172.21.15.158:6805","nonce":12192}]},"public_addr":"172.21.15.158:6801/12192","cluster_addr":"172.21.15.158:6803/12192","heartbeat_back_addr":"172.21.15.158:6807/12192","heartbeat_front_addr":"172.21.15.158:6805/12192","state":["exists","up"]},{"osd":1,"uuid":"d4426b21-b666-4158-bf34-a24b14572731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":12193},{"type":"v1","addr":"172.21.15.158:6809","nonce":12193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":12193},{"type":"v1","addr":"172.21.15.158:6811","nonce":12193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":12193},{"type":"v1","addr":"172.21.15.158:6815","nonce":12193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":12193},{"type":"v1","addr":"172.21.15.158:6813","nonce":12193}]},"public_addr":"172.21.15.158:6809/12193","cluster_addr":"172.21.15.158:6811/12193","heartbeat_back_addr":"172.21.15.158:6815/12193","heartbeat_front_addr":"172.21.15.158:6813/12193","state":["exists","up"]},{"osd":2,"uuid":"22680edd-6490-4ab0-bb15-0605830e4cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":12195},{"type":"v1","addr":"172.21.15.158:6825","nonce":12195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":12195},{"type":"v1","addr":"172.21.15.158:6827","nonce":12195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":12195},{"type":"v1","addr":"172.21.15.158:6831","nonce":12195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":12195},{"type":"v1","addr":"172.21.15.158:6829","nonce":12195}]},"public_addr":"172.21.15.158:6825/12195","cluster_addr":"172.21.15.158:6827/12195","heartbeat_back_addr":"172.21.15.158:6831/12195","heartbeat_front_addr":"172.21.15.158:6829/12195","state":["exists","up"]},{"osd":3,"uuid":"7ec999ee-ace8-4ccb-a4f9-6f5d313bbbd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":12194},{"type":"v1","addr":"172.21.15.158:6817","nonce":12194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":12194},{"type":"v1","addr":"172.21.15.158:6819","nonce":12194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":12194},{"type":"v1","addr":"172.21.15.158:6823","nonce":12194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":12194},{"type":"v1","addr":"172.21.15.158:6821","nonce":12194}]},"public_addr":"172.21.15.158:6817/12194","cluster_addr":"172.21.15.158:6819/12194","heartbeat_back_addr":"172.21.15.158:6823/12194","heartbeat_front_addr":"172.21.15.158:6821/12194","state":["exists","up"]},{"osd":4,"uuid":"186e69c4-b69f-4dd1-bb8f-faf759c60484","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":12460},{"type":"v1","addr":"172.21.15.96:6803","nonce":12460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":12460},{"type":"v1","addr":"172.21.15.96:6805","nonce":12460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":12460},{"type":"v1","addr":"172.21.15.96:6809","nonce":12460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":12460},{"type":"v1","addr":"172.21.15.96:6807","nonce":12460}]},"public_addr":"172.21.15.96:6803/12460","cluster_addr":"172.21.15.96:6805/12460","heartbeat_back_addr":"172.21.15.96:6809/12460","heartbeat_front_addr":"172.21.15.96:6807/12460","state":["exists","up"]},{"osd":5,"uuid":"86b658b2-8b40-4cea-8163-305a3982758b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":12461},{"type":"v1","addr":"172.21.15.96:6811","nonce":12461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":12461},{"type":"v1","addr":"172.21.15.96:6813","nonce":12461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":12461},{"type":"v1","addr":"172.21.15.96:6817","nonce":12461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":12461},{"type":"v1","addr":"172.21.15.96:6815","nonce":12461}]},"public_addr":"172.21.15.96:6811/12461","cluster_addr":"172.21.15.96:6813/12461","heartbeat_back_addr":"172.21.15.96:6817/12461","heartbeat_front_addr":"172.21.15.96:6815/12461","state":["exists","up"]},{"osd":6,"uuid":"bdadaea8-9296-4788-bc59-d9c9eb8defdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":12463},{"type":"v1","addr":"172.21.15.96:6827","nonce":12463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":12463},{"type":"v1","addr":"172.21.15.96:6829","nonce":12463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":12463},{"type":"v1","addr":"172.21.15.96:6833","nonce":12463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":12463},{"type":"v1","addr":"172.21.15.96:6831","nonce":12463}]},"public_addr":"172.21.15.96:6827/12463","cluster_addr":"172.21.15.96:6829/12463","heartbeat_back_addr":"172.21.15.96:6833/12463","heartbeat_front_addr":"172.21.15.96:6831/12463","state":["exists","up"]},{"osd":7,"uuid":"c6d71846-d68e-430f-ab72-0fb8ea4bf640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":12462},{"type":"v1","addr":"172.21.15.96:6819","nonce":12462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":12462},{"type":"v1","addr":"172.21.15.96:6821","nonce":12462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":12462},{"type":"v1","addr":"172.21.15.96:6825","nonce":12462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":12462},{"type":"v1","addr":"172.21.15.96:6823","nonce":12462}]},"public_addr":"172.21.15.96:6819/12462","cluster_addr":"172.21.15.96:6821/12462","heartbeat_back_addr":"172.21.15.96:6825/12462","heartbeat_front_addr":"172.21.15.96:6823/12462","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.875762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.900817+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.210347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.133973+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.864697+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.131015+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.237225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.154377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-05T03:50:41.535 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.528+0000 7f51f58f4700 1 -- 172.21.15.158:0/1886026946 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f51d403b400 msgr2=0x7f51d403d910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:41.535 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.528+0000 7f51f58f4700 1 --2- 172.21.15.158:0/1886026946 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f51d403b400 0x7f51d403d910 crc :-1 s=READY pgs=143 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:41.535 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.528+0000 7f51f58f4700 1 -- 172.21.15.158:0/1886026946 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f51f011f0e0 msgr2=0x7f51f00ad880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:41.535 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.528+0000 7f51f58f4700 1 --2- 172.21.15.158:0/1886026946 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f51f011f0e0 0x7f51f00ad880 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f51e0001830 tx=0x7f51e0001c60).stop 2019-12-05T03:50:41.535 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.528+0000 7f51f58f4700 1 -- 172.21.15.158:0/1886026946 shutdown_connections 2019-12-05T03:50:41.535 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.528+0000 7f51f58f4700 1 --2- 172.21.15.158:0/1886026946 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f51f011f0e0 0x7f51f00ad880 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:41.536 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.528+0000 7f51f58f4700 1 --2- 172.21.15.158:0/1886026946 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f51d403b400 0x7f51d403d910 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:41.536 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.528+0000 7f51f58f4700 1 -- 172.21.15.158:0/1886026946 shutdown_connections 2019-12-05T03:50:41.536 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.528+0000 7f51f58f4700 1 -- 172.21.15.158:0/1886026946 wait complete. 2019-12-05T03:50:41.536 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.528+0000 7f51f58f4700 1 -- 172.21.15.158:0/1886026946 >> 172.21.15.158:0/1886026946 conn(0x7f51f00b5e70 msgr2=0x7f51f00b52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:41.546 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:49:52.900870+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-12-05T03:50:41.546 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-12-05T03:50:41.646 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.636+0000 7f50f570d700 1 Processor -- start 2019-12-05T03:50:41.646 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.636+0000 7f50f570d700 1 -- start start 2019-12-05T03:50:41.646 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.636+0000 7f50f570d700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f50f009ba40 0x7f50f009add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:41.646 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.636+0000 7f50f570d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f50f00b5370 0x7f50f00b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:41.646 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.636+0000 7f50f570d700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50f0099e30 con 0x7f50f00b6970 2019-12-05T03:50:41.647 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.636+0000 7f50f570d700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50f009d210 con 0x7f50f009ba40 2019-12-05T03:50:41.647 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.636+0000 7f50f570d700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50f0099b90 con 0x7f50f00b5370 2019-12-05T03:50:41.647 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.636+0000 7f50effff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f50f00b5370 0x7f50f00b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:41.647 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.636+0000 7f50effff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f50f00b5370 0x7f50f00b57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54820/0 (socket says 172.21.15.158:54820) 2019-12-05T03:50:41.647 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.636+0000 7f50effff700 1 -- 172.21.15.158:0/3669686390 learned_addr learned my addr 172.21.15.158:0/3669686390 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:41.647 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.636+0000 7f50eeffd700 1 --2- 172.21.15.158:0/3669686390 >> v2:172.21.15.96:3300/0 conn(0x7f50f009ba40 0x7f50f009add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:41.647 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.636+0000 7f50effff700 1 -- 172.21.15.158:0/3669686390 >> v2:172.21.15.96:3300/0 conn(0x7f50f009ba40 msgr2=0x7f50f009add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:41.648 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.636+0000 7f50effff700 1 --2- 172.21.15.158:0/3669686390 >> v2:172.21.15.96:3300/0 conn(0x7f50f009ba40 0x7f50f009add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:41.648 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.636+0000 7f50effff700 1 -- 172.21.15.158:0/3669686390 >> v1:172.21.15.96:6789/0 conn(0x7f50f00b6970 legacy=0x7f50f005a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:41.648 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.636+0000 7f50effff700 1 -- 172.21.15.158:0/3669686390 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f007e960 con 0x7f50f00b5370 2019-12-05T03:50:41.648 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.636+0000 7f50effff700 1 --2- 172.21.15.158:0/3669686390 >> v2:172.21.15.158:3300/0 conn(0x7f50f00b5370 0x7f50f00b57a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f50e80032b0 tx=0x7f50e80100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.648 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.636+0000 7f50effff700 1 --2- 172.21.15.158:0/3669686390 >> v2:172.21.15.158:3300/0 conn(0x7f50f00b5370 0x7f50f00b57a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f50e80032b0 tx=0x7f50e80100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.648 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.636+0000 7f50effff700 1 --2- 172.21.15.158:0/3669686390 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f50f00b5370 0x7f50f00b57a0 secure :-1 s=READY pgs=308 cs=0 l=1 rx=0x7f50e80032b0 tx=0x7f50e80100b0).ready entity=mon.1 client_cookie=33c07b3f74b5d73d server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:41.648 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.636+0000 7f50effff700 1 --2- 172.21.15.158:0/3669686390 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f50f00b5370 0x7f50f00b57a0 secure :-1 s=THROTTLE_DONE pgs=308 cs=0 l=1 rx=0x7f50e80032b0 tx=0x7f50e80100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.649 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.636+0000 7f50ee7fc700 1 -- 172.21.15.158:0/3669686390 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50e8010d60 con 0x7f50f00b5370 2019-12-05T03:50:41.649 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.636+0000 7f50effff700 1 --2- 172.21.15.158:0/3669686390 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f50f00b5370 0x7f50f00b57a0 secure :-1 s=THROTTLE_DONE pgs=308 cs=0 l=1 rx=0x7f50e80032b0 tx=0x7f50e80100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.649 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.636+0000 7f50effff700 1 --2- 172.21.15.158:0/3669686390 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f50f00b5370 0x7f50f00b57a0 secure :-1 s=THROTTLE_DONE pgs=308 cs=0 l=1 rx=0x7f50e80032b0 tx=0x7f50e80100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.649 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.636+0000 7f50ee7fc700 1 -- 172.21.15.158:0/3669686390 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e8010980 con 0x7f50f00b5370 2019-12-05T03:50:41.649 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.636+0000 7f50ee7fc700 1 -- 172.21.15.158:0/3669686390 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50e80114a0 con 0x7f50f00b5370 2019-12-05T03:50:41.649 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.636+0000 7f50f570d700 1 -- 172.21.15.158:0/3669686390 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f50f00b5370 msgr2=0x7f50f00b57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:41.649 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.636+0000 7f50f570d700 1 --2- 172.21.15.158:0/3669686390 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f50f00b5370 0x7f50f00b57a0 secure :-1 s=READY pgs=308 cs=0 l=1 rx=0x7f50e80032b0 tx=0x7f50e80100b0).stop 2019-12-05T03:50:41.650 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.636+0000 7f50f570d700 1 -- 172.21.15.158:0/3669686390 shutdown_connections 2019-12-05T03:50:41.650 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.636+0000 7f50f570d700 1 --2- 172.21.15.158:0/3669686390 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f50f00b5370 0x7f50f00b57a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:41.650 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.636+0000 7f50f570d700 1 --2- 172.21.15.158:0/3669686390 >> v2:172.21.15.96:3300/0 conn(0x7f50f009ba40 0x7f50f009add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:41.650 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.636+0000 7f50f570d700 1 -- 172.21.15.158:0/3669686390 shutdown_connections 2019-12-05T03:50:41.650 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.640+0000 7f50f570d700 1 -- 172.21.15.158:0/3669686390 wait complete. 2019-12-05T03:50:41.650 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.640+0000 7f50f570d700 1 -- 172.21.15.158:0/3669686390 >> 172.21.15.158:0/3669686390 conn(0x7f50f00b7ef0 msgr2=0x7f50f00b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:41.654 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.640+0000 7f50f570d700 1 Processor -- start 2019-12-05T03:50:41.654 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.640+0000 7f50f570d700 1 -- start start 2019-12-05T03:50:41.654 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.640+0000 7f50f570d700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f50f007d6a0 0x7f50f012b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:41.654 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.640+0000 7f50f570d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f50f013cbb0 0x7f50f013cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:41.655 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.640+0000 7f50f570d700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50f0130310 con 0x7f50f007b340 2019-12-05T03:50:41.655 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.640+0000 7f50f570d700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50f012e580 con 0x7f50f007d6a0 2019-12-05T03:50:41.655 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.640+0000 7f50f570d700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50f0140200 con 0x7f50f013cbb0 2019-12-05T03:50:41.655 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.640+0000 7f50eeffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f50f013cbb0 0x7f50f013cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:41.655 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.640+0000 7f50effff700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f50f007b340 0x7f50f01404a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49604/0 (socket says 172.21.15.158:49604) 2019-12-05T03:50:41.655 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.640+0000 7f50effff700 1 -- 172.21.15.158:0/663350398 learned_addr learned my addr 172.21.15.158:0/663350398 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:41.655 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.640+0000 7f50ef7fe700 1 --2- 172.21.15.158:0/663350398 >> v2:172.21.15.96:3300/0 conn(0x7f50f007d6a0 0x7f50f012b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:41.656 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.640+0000 7f50eeffd700 1 -- 172.21.15.158:0/663350398 >> v2:172.21.15.96:3300/0 conn(0x7f50f007d6a0 msgr2=0x7f50f012b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:41.656 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.640+0000 7f50eeffd700 1 --2- 172.21.15.158:0/663350398 >> v2:172.21.15.96:3300/0 conn(0x7f50f007d6a0 0x7f50f012b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:41.656 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.640+0000 7f50eeffd700 1 -- 172.21.15.158:0/663350398 >> v1:172.21.15.158:6789/0 conn(0x7f50f007b340 legacy=0x7f50f01404a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:41.656 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.640+0000 7f50eeffd700 1 -- 172.21.15.158:0/663350398 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f0154ad0 con 0x7f50f013cbb0 2019-12-05T03:50:41.656 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.640+0000 7f50ef7fe700 1 --2- 172.21.15.158:0/663350398 >> v2:172.21.15.96:3300/0 conn(0x7f50f007d6a0 0x7f50f012b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2019-12-05T03:50:41.656 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.640+0000 7f50eeffd700 1 --2- 172.21.15.158:0/663350398 >> v2:172.21.15.158:3300/0 conn(0x7f50f013cbb0 0x7f50f013cfe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f50d8002f30 tx=0x7f50d8010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.656 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.640+0000 7f50eeffd700 1 --2- 172.21.15.158:0/663350398 >> v2:172.21.15.158:3300/0 conn(0x7f50f013cbb0 0x7f50f013cfe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f50d8002f30 tx=0x7f50d8010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.657 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.640+0000 7f50eeffd700 1 --2- 172.21.15.158:0/663350398 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f50f013cbb0 0x7f50f013cfe0 secure :-1 s=READY pgs=310 cs=0 l=1 rx=0x7f50d8002f30 tx=0x7f50d8010b60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:41.657 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.640+0000 7f50eeffd700 1 --2- 172.21.15.158:0/663350398 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f50f013cbb0 0x7f50f013cfe0 secure :-1 s=THROTTLE_DONE pgs=310 cs=0 l=1 rx=0x7f50d8002f30 tx=0x7f50d8010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.657 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.640+0000 7f50e7fff700 1 -- 172.21.15.158:0/663350398 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50d8012610 con 0x7f50f013cbb0 2019-12-05T03:50:41.657 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.640+0000 7f50eeffd700 1 --2- 172.21.15.158:0/663350398 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f50f013cbb0 0x7f50f013cfe0 secure :-1 s=THROTTLE_DONE pgs=310 cs=0 l=1 rx=0x7f50d8002f30 tx=0x7f50d8010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.657 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.640+0000 7f50e7fff700 1 -- 172.21.15.158:0/663350398 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d8007150 con 0x7f50f013cbb0 2019-12-05T03:50:41.657 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.640+0000 7f50f570d700 1 -- 172.21.15.158:0/663350398 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50f0140ca0 con 0x7f50f013cbb0 2019-12-05T03:50:41.657 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.640+0000 7f50eeffd700 1 --2- 172.21.15.158:0/663350398 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f50f013cbb0 0x7f50f013cfe0 secure :-1 s=THROTTLE_DONE pgs=310 cs=0 l=1 rx=0x7f50d8002f30 tx=0x7f50d8010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.657 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.640+0000 7f50e7fff700 1 -- 172.21.15.158:0/663350398 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50d8012bf0 con 0x7f50f013cbb0 2019-12-05T03:50:41.658 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.640+0000 7f50f570d700 1 -- 172.21.15.158:0/663350398 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f007b910 con 0x7f50f013cbb0 2019-12-05T03:50:41.658 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.644+0000 7f50eeffd700 1 --2- 172.21.15.158:0/663350398 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f50f013cbb0 0x7f50f013cfe0 secure :-1 s=THROTTLE_DONE pgs=310 cs=0 l=1 rx=0x7f50d8002f30 tx=0x7f50d8010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.658 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.644+0000 7f50e7fff700 1 -- 172.21.15.158:0/663350398 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f50d8005540 con 0x7f50f013cbb0 2019-12-05T03:50:41.658 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.644+0000 7f50eeffd700 1 --2- 172.21.15.158:0/663350398 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f50f013cbb0 0x7f50f013cfe0 secure :-1 s=THROTTLE_DONE pgs=310 cs=0 l=1 rx=0x7f50d8002f30 tx=0x7f50d8010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.658 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.644+0000 7f50e7fff700 1 --2- 172.21.15.158:0/663350398 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f50d403ac70 0x7f50d403d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:41.658 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.644+0000 7f50e7fff700 1 -- 172.21.15.158:0/663350398 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f50d804b1d0 con 0x7f50f013cbb0 2019-12-05T03:50:41.658 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.644+0000 7f50ef7fe700 1 --2- 172.21.15.158:0/663350398 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f50d403ac70 0x7f50d403d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:41.659 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.644+0000 7f50ef7fe700 1 --2- 172.21.15.158:0/663350398 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f50d403ac70 0x7f50d403d180 crc :-1 s=READY pgs=144 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:41.659 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.652+0000 7f50f570d700 1 -- 172.21.15.158:0/663350398 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50f00554e0 con 0x7f50f013cbb0 2019-12-05T03:50:41.665 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.660+0000 7f50eeffd700 1 --2- 172.21.15.158:0/663350398 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f50f013cbb0 0x7f50f013cfe0 secure :-1 s=THROTTLE_DONE pgs=310 cs=0 l=1 rx=0x7f50d8002f30 tx=0x7f50d8010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.666 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.660+0000 7f50e7fff700 1 -- 172.21.15.158:0/663350398 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f50d8030de0 con 0x7f50f013cbb0 2019-12-05T03:50:41.824 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.816+0000 7f50f570d700 1 -- 172.21.15.158:0/663350398 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f50f0066940 con 0x7f50f013cbb0 2019-12-05T03:50:41.825 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.816+0000 7f50eeffd700 1 --2- 172.21.15.158:0/663350398 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f50f013cbb0 0x7f50f013cfe0 secure :-1 s=THROTTLE_DONE pgs=310 cs=0 l=1 rx=0x7f50d8002f30 tx=0x7f50d8010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.825 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.816+0000 7f50e7fff700 1 -- 172.21.15.158:0/663350398 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f50d8032230 con 0x7f50f013cbb0 2019-12-05T03:50:41.825 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:50:41.828 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.820+0000 7f50f570d700 1 -- 172.21.15.158:0/663350398 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f50d403ac70 msgr2=0x7f50d403d180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:41.828 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.820+0000 7f50f570d700 1 --2- 172.21.15.158:0/663350398 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f50d403ac70 0x7f50d403d180 crc :-1 s=READY pgs=144 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:41.828 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.820+0000 7f50f570d700 1 -- 172.21.15.158:0/663350398 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f50f013cbb0 msgr2=0x7f50f013cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:41.828 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.820+0000 7f50f570d700 1 --2- 172.21.15.158:0/663350398 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f50f013cbb0 0x7f50f013cfe0 secure :-1 s=READY pgs=310 cs=0 l=1 rx=0x7f50d8002f30 tx=0x7f50d8010b60).stop 2019-12-05T03:50:41.828 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.820+0000 7f50f570d700 1 -- 172.21.15.158:0/663350398 shutdown_connections 2019-12-05T03:50:41.828 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.820+0000 7f50f570d700 1 --2- 172.21.15.158:0/663350398 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f50d403ac70 0x7f50d403d180 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:41.828 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.820+0000 7f50f570d700 1 --2- 172.21.15.158:0/663350398 >> v2:172.21.15.96:3300/0 conn(0x7f50f007d6a0 0x7f50f012b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:41.829 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.820+0000 7f50f570d700 1 --2- 172.21.15.158:0/663350398 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f50f013cbb0 0x7f50f013cfe0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:41.829 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.820+0000 7f50f570d700 1 -- 172.21.15.158:0/663350398 shutdown_connections 2019-12-05T03:50:41.829 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.820+0000 7f50f570d700 1 -- 172.21.15.158:0/663350398 wait complete. 2019-12-05T03:50:41.829 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.820+0000 7f50f570d700 1 -- 172.21.15.158:0/663350398 >> 172.21.15.158:0/663350398 conn(0x7f50f0155e20 msgr2=0x7f50f012c770 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:41.837 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2019-12-05T03:50:41.931 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.916+0000 7f7ac0a55700 1 Processor -- start 2019-12-05T03:50:41.931 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.916+0000 7f7ac0a55700 1 -- start start 2019-12-05T03:50:41.931 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.920+0000 7f7ac0a55700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7abc09cf60 0x7f7abc09a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:41.931 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.920+0000 7f7ac0a55700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7abc05a740 0x7f7abc151460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:41.932 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.920+0000 7f7ac0a55700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7abc0accb0 con 0x7f7abc1519b0 2019-12-05T03:50:41.932 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.920+0000 7f7ac0a55700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7abc0b1730 con 0x7f7abc05a740 2019-12-05T03:50:41.932 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.920+0000 7f7ac0a55700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7abc0b19d0 con 0x7f7abc09cf60 2019-12-05T03:50:41.932 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.920+0000 7f7abad9d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7abc09cf60 0x7f7abc09a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:41.932 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.920+0000 7f7abad9d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7abc09cf60 0x7f7abc09a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54830/0 (socket says 172.21.15.158:54830) 2019-12-05T03:50:41.932 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.920+0000 7f7abad9d700 1 -- 172.21.15.158:0/185352701 learned_addr learned my addr 172.21.15.158:0/185352701 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:41.933 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.920+0000 7f7aba59c700 1 --2- 172.21.15.158:0/185352701 >> v2:172.21.15.96:3300/0 conn(0x7f7abc05a740 0x7f7abc151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:41.933 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.920+0000 7f7abad9d700 1 -- 172.21.15.158:0/185352701 >> v2:172.21.15.96:3300/0 conn(0x7f7abc05a740 msgr2=0x7f7abc151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:41.933 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.920+0000 7f7abad9d700 1 --2- 172.21.15.158:0/185352701 >> v2:172.21.15.96:3300/0 conn(0x7f7abc05a740 0x7f7abc151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:41.933 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.920+0000 7f7abad9d700 1 -- 172.21.15.158:0/185352701 >> v1:172.21.15.158:6789/0 conn(0x7f7abc1519b0 legacy=0x7f7abc0b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:41.933 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.920+0000 7f7abad9d700 1 -- 172.21.15.158:0/185352701 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7abc05ab70 con 0x7f7abc09cf60 2019-12-05T03:50:41.933 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.920+0000 7f7abad9d700 1 --2- 172.21.15.158:0/185352701 >> v2:172.21.15.158:3300/0 conn(0x7f7abc09cf60 0x7f7abc09a320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7aac002f30 tx=0x7f7aac00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.933 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.920+0000 7f7abad9d700 1 --2- 172.21.15.158:0/185352701 >> v2:172.21.15.158:3300/0 conn(0x7f7abc09cf60 0x7f7abc09a320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7aac002f30 tx=0x7f7aac00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.934 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.920+0000 7f7abad9d700 1 --2- 172.21.15.158:0/185352701 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7abc09cf60 0x7f7abc09a320 secure :-1 s=READY pgs=312 cs=0 l=1 rx=0x7f7aac002f30 tx=0x7f7aac00fd30).ready entity=mon.1 client_cookie=11ad1860af82c12d server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:41.934 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.920+0000 7f7abad9d700 1 --2- 172.21.15.158:0/185352701 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7abc09cf60 0x7f7abc09a320 secure :-1 s=THROTTLE_DONE pgs=312 cs=0 l=1 rx=0x7f7aac002f30 tx=0x7f7aac00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.934 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.920+0000 7f7ab9d9b700 1 -- 172.21.15.158:0/185352701 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7aac011370 con 0x7f7abc09cf60 2019-12-05T03:50:41.934 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.920+0000 7f7abad9d700 1 --2- 172.21.15.158:0/185352701 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7abc09cf60 0x7f7abc09a320 secure :-1 s=THROTTLE_DONE pgs=312 cs=0 l=1 rx=0x7f7aac002f30 tx=0x7f7aac00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.934 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.920+0000 7f7abad9d700 1 --2- 172.21.15.158:0/185352701 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7abc09cf60 0x7f7abc09a320 secure :-1 s=THROTTLE_DONE pgs=312 cs=0 l=1 rx=0x7f7aac002f30 tx=0x7f7aac00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.934 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.920+0000 7f7ab9d9b700 1 -- 172.21.15.158:0/185352701 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aac008bb0 con 0x7f7abc09cf60 2019-12-05T03:50:41.934 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.920+0000 7f7ab9d9b700 1 -- 172.21.15.158:0/185352701 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7aac011950 con 0x7f7abc09cf60 2019-12-05T03:50:41.935 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.920+0000 7f7ac0a55700 1 -- 172.21.15.158:0/185352701 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7abc09cf60 msgr2=0x7f7abc09a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:41.935 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.920+0000 7f7ac0a55700 1 --2- 172.21.15.158:0/185352701 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7abc09cf60 0x7f7abc09a320 secure :-1 s=READY pgs=312 cs=0 l=1 rx=0x7f7aac002f30 tx=0x7f7aac00fd30).stop 2019-12-05T03:50:41.935 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.920+0000 7f7ac0a55700 1 -- 172.21.15.158:0/185352701 shutdown_connections 2019-12-05T03:50:41.935 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.920+0000 7f7ac0a55700 1 --2- 172.21.15.158:0/185352701 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7abc09cf60 0x7f7abc09a320 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:41.935 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.920+0000 7f7ac0a55700 1 --2- 172.21.15.158:0/185352701 >> v2:172.21.15.96:3300/0 conn(0x7f7abc05a740 0x7f7abc151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:41.935 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.920+0000 7f7ac0a55700 1 -- 172.21.15.158:0/185352701 shutdown_connections 2019-12-05T03:50:41.935 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.920+0000 7f7ac0a55700 1 -- 172.21.15.158:0/185352701 wait complete. 2019-12-05T03:50:41.936 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.920+0000 7f7ac0a55700 1 -- 172.21.15.158:0/185352701 >> 172.21.15.158:0/185352701 conn(0x7f7abc0b7e60 msgr2=0x7f7abc0b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:41.939 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.924+0000 7f7ac0a55700 1 Processor -- start 2019-12-05T03:50:41.939 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.924+0000 7f7ac0a55700 1 -- start start 2019-12-05T03:50:41.939 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.928+0000 7f7ac0a55700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7abc0b31c0 0x7f7abc0b2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:41.939 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.928+0000 7f7ac0a55700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7abc07b250 0x7f7abc07b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:41.940 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.928+0000 7f7ac0a55700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7abc09b040 con 0x7f7abc09ac10 2019-12-05T03:50:41.940 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.928+0000 7f7ac0a55700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7abc139fa0 con 0x7f7abc0b31c0 2019-12-05T03:50:41.940 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.928+0000 7f7ac0a55700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc1512c0 con 0x7f7abc07b250 2019-12-05T03:50:41.940 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.928+0000 7f7abad9d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7abc0b31c0 0x7f7abc0b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:41.940 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.928+0000 7f7abad9d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7abc0b31c0 0x7f7abc0b2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54836/0 (socket says 172.21.15.158:54836) 2019-12-05T03:50:41.940 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.928+0000 7f7abad9d700 1 -- 172.21.15.158:0/1425389447 learned_addr learned my addr 172.21.15.158:0/1425389447 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:41.940 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.928+0000 7f7abb59e700 1 --2- 172.21.15.158:0/1425389447 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7abc07b250 0x7f7abc07b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:41.941 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.928+0000 7f7abad9d700 1 -- 172.21.15.158:0/1425389447 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7abc07b250 msgr2=0x7f7abc07b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:41.941 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.928+0000 7f7abad9d700 1 --2- 172.21.15.158:0/1425389447 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7abc07b250 0x7f7abc07b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:41.941 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.928+0000 7f7abad9d700 1 -- 172.21.15.158:0/1425389447 >> v1:172.21.15.158:6789/0 conn(0x7f7abc09ac10 legacy=0x7f7abc153990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:41.941 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.928+0000 7f7abad9d700 1 -- 172.21.15.158:0/1425389447 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7abc13a240 con 0x7f7abc0b31c0 2019-12-05T03:50:41.941 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.928+0000 7f7abad9d700 1 --2- 172.21.15.158:0/1425389447 >> v2:172.21.15.158:3300/0 conn(0x7f7abc0b31c0 0x7f7abc0b2760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7abc099900 tx=0x7f7aac008bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.941 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.928+0000 7f7abad9d700 1 --2- 172.21.15.158:0/1425389447 >> v2:172.21.15.158:3300/0 conn(0x7f7abc0b31c0 0x7f7abc0b2760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7abc099900 tx=0x7f7aac008bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.941 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.928+0000 7f7abad9d700 1 --2- 172.21.15.158:0/1425389447 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7abc0b31c0 0x7f7abc0b2760 secure :-1 s=READY pgs=314 cs=0 l=1 rx=0x7f7abc099900 tx=0x7f7aac008bb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:41.942 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.928+0000 7f7abad9d700 1 --2- 172.21.15.158:0/1425389447 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7abc0b31c0 0x7f7abc0b2760 secure :-1 s=THROTTLE_DONE pgs=314 cs=0 l=1 rx=0x7f7abc099900 tx=0x7f7aac008bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.942 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.928+0000 7f7abad9d700 1 --2- 172.21.15.158:0/1425389447 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7abc0b31c0 0x7f7abc0b2760 secure :-1 s=THROTTLE_DONE pgs=314 cs=0 l=1 rx=0x7f7abc099900 tx=0x7f7aac008bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.942 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.928+0000 7f7ab37fe700 1 -- 172.21.15.158:0/1425389447 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7aac007150 con 0x7f7abc0b31c0 2019-12-05T03:50:41.942 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.928+0000 7f7abad9d700 1 --2- 172.21.15.158:0/1425389447 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7abc0b31c0 0x7f7abc0b2760 secure :-1 s=THROTTLE_DONE pgs=314 cs=0 l=1 rx=0x7f7abc099900 tx=0x7f7aac008bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.942 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.928+0000 7f7ab37fe700 1 -- 172.21.15.158:0/1425389447 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aac011570 con 0x7f7abc0b31c0 2019-12-05T03:50:41.942 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.928+0000 7f7ab37fe700 1 -- 172.21.15.158:0/1425389447 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7aac005730 con 0x7f7abc0b31c0 2019-12-05T03:50:41.942 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.928+0000 7f7ac0a55700 1 -- 172.21.15.158:0/1425389447 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7abc13a510 con 0x7f7abc0b31c0 2019-12-05T03:50:41.943 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.928+0000 7f7ac0a55700 1 -- 172.21.15.158:0/1425389447 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7abc13aa40 con 0x7f7abc0b31c0 2019-12-05T03:50:41.943 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.928+0000 7f7abad9d700 1 --2- 172.21.15.158:0/1425389447 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7abc0b31c0 0x7f7abc0b2760 secure :-1 s=THROTTLE_DONE pgs=314 cs=0 l=1 rx=0x7f7abc099900 tx=0x7f7aac008bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.943 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.928+0000 7f7ab37fe700 1 -- 172.21.15.158:0/1425389447 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f7aac005a00 con 0x7f7abc0b31c0 2019-12-05T03:50:41.943 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.928+0000 7f7abad9d700 1 --2- 172.21.15.158:0/1425389447 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7abc0b31c0 0x7f7abc0b2760 secure :-1 s=THROTTLE_DONE pgs=314 cs=0 l=1 rx=0x7f7abc099900 tx=0x7f7aac008bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.943 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.928+0000 7f7ab37fe700 1 --2- 172.21.15.158:0/1425389447 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f7a9803ad80 0x7f7a9803d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:41.943 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.928+0000 7f7ab37fe700 1 -- 172.21.15.158:0/1425389447 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5200+0+0 (secure 0 0 0) 0x7f7aac04b540 con 0x7f7abc0b31c0 2019-12-05T03:50:41.943 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.928+0000 7f7aba59c700 1 --2- 172.21.15.158:0/1425389447 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f7a9803ad80 0x7f7a9803d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:41.944 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.932+0000 7f7aba59c700 1 --2- 172.21.15.158:0/1425389447 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f7a9803ad80 0x7f7a9803d290 crc :-1 s=READY pgs=145 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:41.944 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.932+0000 7f7ac0a55700 1 -- 172.21.15.158:0/1425389447 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7abc0554e0 con 0x7f7abc0b31c0 2019-12-05T03:50:41.944 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.936+0000 7f7abad9d700 1 --2- 172.21.15.158:0/1425389447 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7abc0b31c0 0x7f7abc0b2760 secure :-1 s=THROTTLE_DONE pgs=314 cs=0 l=1 rx=0x7f7abc099900 tx=0x7f7aac008bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:41.945 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:41.936+0000 7f7ab37fe700 1 -- 172.21.15.158:0/1425389447 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f7aac0325c0 con 0x7f7abc0b31c0 2019-12-05T03:50:42.101 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.092+0000 7f7ac0a55700 1 -- 172.21.15.158:0/1425389447 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7abc066940 con 0x7f7abc0b31c0 2019-12-05T03:50:42.101 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.092+0000 7f7abad9d700 1 --2- 172.21.15.158:0/1425389447 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7abc0b31c0 0x7f7abc0b2760 secure :-1 s=THROTTLE_DONE pgs=314 cs=0 l=1 rx=0x7f7abc099900 tx=0x7f7aac008bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:42.102 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.092+0000 7f7ab37fe700 1 -- 172.21.15.158:0/1425389447 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) v1 ==== 84+0+64 (secure 0 0 0) 0x7f7aac032820 con 0x7f7abc0b31c0 2019-12-05T03:50:42.102 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:42.102 INFO:teuthology.orchestra.run.smithi158.stdout:[ 2019-12-05T03:50:42.102 INFO:teuthology.orchestra.run.smithi158.stdout: { 2019-12-05T03:50:42.103 INFO:teuthology.orchestra.run.smithi158.stdout: "poolnum": 1, 2019-12-05T03:50:42.103 INFO:teuthology.orchestra.run.smithi158.stdout: "poolname": "rbd" 2019-12-05T03:50:42.103 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:42.103 INFO:teuthology.orchestra.run.smithi158.stdout:] 2019-12-05T03:50:42.104 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.096+0000 7f7ac0a55700 1 -- 172.21.15.158:0/1425389447 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f7a9803ad80 msgr2=0x7f7a9803d290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:42.104 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.096+0000 7f7ac0a55700 1 --2- 172.21.15.158:0/1425389447 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f7a9803ad80 0x7f7a9803d290 crc :-1 s=READY pgs=145 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:42.104 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.096+0000 7f7ac0a55700 1 -- 172.21.15.158:0/1425389447 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7abc0b31c0 msgr2=0x7f7abc0b2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:42.105 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.096+0000 7f7ac0a55700 1 --2- 172.21.15.158:0/1425389447 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7abc0b31c0 0x7f7abc0b2760 secure :-1 s=READY pgs=314 cs=0 l=1 rx=0x7f7abc099900 tx=0x7f7aac008bb0).stop 2019-12-05T03:50:42.105 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.096+0000 7f7ac0a55700 1 -- 172.21.15.158:0/1425389447 shutdown_connections 2019-12-05T03:50:42.105 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.096+0000 7f7ac0a55700 1 --2- 172.21.15.158:0/1425389447 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f7a9803ad80 0x7f7a9803d290 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:42.105 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.096+0000 7f7ac0a55700 1 --2- 172.21.15.158:0/1425389447 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7abc0b31c0 0x7f7abc0b2760 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:42.105 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.096+0000 7f7ac0a55700 1 --2- 172.21.15.158:0/1425389447 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7abc07b250 0x7f7abc07b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:42.105 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.096+0000 7f7ac0a55700 1 -- 172.21.15.158:0/1425389447 shutdown_connections 2019-12-05T03:50:42.105 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.096+0000 7f7ac0a55700 1 -- 172.21.15.158:0/1425389447 wait complete. 2019-12-05T03:50:42.106 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.096+0000 7f7ac0a55700 1 -- 172.21.15.158:0/1425389447 >> 172.21.15.158:0/1425389447 conn(0x7f7abc09cf60 msgr2=0x7f7abc1556a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:42.114 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2019-12-05T03:50:42.114 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2019-12-05T03:50:42.222 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.208+0000 7fae31b36700 1 Processor -- start 2019-12-05T03:50:42.222 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.208+0000 7fae31b36700 1 -- start start 2019-12-05T03:50:42.222 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.212+0000 7fae31b36700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fae2c0b6970 0x7fae2c09add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:42.222 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.212+0000 7fae31b36700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fae2c09ba40 0x7fae2c05a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:42.223 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.212+0000 7fae31b36700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fae2c05a950 0x7fae2c155290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:42.223 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.212+0000 7fae31b36700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae2c09d210 con 0x7fae2c05a950 2019-12-05T03:50:42.223 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.212+0000 7fae31b36700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae2c099b90 con 0x7fae2c0b6970 2019-12-05T03:50:42.223 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.212+0000 7fae31b36700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c099e30 con 0x7fae2c09ba40 2019-12-05T03:50:42.223 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.212+0000 7fae2bfff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fae2c0b6970 0x7fae2c09add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:42.223 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.212+0000 7fae2bfff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fae2c0b6970 0x7fae2c09add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54846/0 (socket says 172.21.15.158:54846) 2019-12-05T03:50:42.223 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.212+0000 7fae2bfff700 1 -- 172.21.15.158:0/2625766884 learned_addr learned my addr 172.21.15.158:0/2625766884 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:42.224 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.212+0000 7fae2b7fe700 1 --2- 172.21.15.158:0/2625766884 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fae2c09ba40 0x7fae2c05a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:42.224 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.212+0000 7fae308d4700 1 --2- 172.21.15.158:0/2625766884 >> v2:172.21.15.96:3300/0 conn(0x7fae2c05a950 0x7fae2c155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:42.224 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.212+0000 7fae2bfff700 1 -- 172.21.15.158:0/2625766884 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fae2c09ba40 msgr2=0x7fae2c05a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:42.224 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.212+0000 7fae2bfff700 1 --2- 172.21.15.158:0/2625766884 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fae2c09ba40 0x7fae2c05a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:42.224 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.212+0000 7fae2bfff700 1 -- 172.21.15.158:0/2625766884 >> v2:172.21.15.96:3300/0 conn(0x7fae2c05a950 msgr2=0x7fae2c155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:42.224 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.212+0000 7fae2bfff700 1 --2- 172.21.15.158:0/2625766884 >> v2:172.21.15.96:3300/0 conn(0x7fae2c05a950 0x7fae2c155290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:42.225 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.212+0000 7fae2bfff700 1 -- 172.21.15.158:0/2625766884 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae2c07e960 con 0x7fae2c0b6970 2019-12-05T03:50:42.225 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.212+0000 7fae2b7fe700 1 --2- 172.21.15.158:0/2625766884 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fae2c09ba40 0x7fae2c05a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:50:42.225 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.212+0000 7fae2bfff700 1 --2- 172.21.15.158:0/2625766884 >> v2:172.21.15.158:3300/0 conn(0x7fae2c0b6970 0x7fae2c09add0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fae20002f30 tx=0x7fae2000fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:42.225 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.212+0000 7fae2bfff700 1 --2- 172.21.15.158:0/2625766884 >> v2:172.21.15.158:3300/0 conn(0x7fae2c0b6970 0x7fae2c09add0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fae20002f30 tx=0x7fae2000fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:42.225 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.212+0000 7fae2bfff700 1 --2- 172.21.15.158:0/2625766884 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fae2c0b6970 0x7fae2c09add0 secure :-1 s=READY pgs=315 cs=0 l=1 rx=0x7fae20002f30 tx=0x7fae2000fdb0).ready entity=mon.1 client_cookie=69c38bcfa3134d36 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:42.225 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.212+0000 7fae2bfff700 1 --2- 172.21.15.158:0/2625766884 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fae2c0b6970 0x7fae2c09add0 secure :-1 s=THROTTLE_DONE pgs=315 cs=0 l=1 rx=0x7fae20002f30 tx=0x7fae2000fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:42.225 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.212+0000 7fae2affd700 1 -- 172.21.15.158:0/2625766884 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae20008c90 con 0x7fae2c0b6970 2019-12-05T03:50:42.226 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.212+0000 7fae2bfff700 1 --2- 172.21.15.158:0/2625766884 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fae2c0b6970 0x7fae2c09add0 secure :-1 s=THROTTLE_DONE pgs=315 cs=0 l=1 rx=0x7fae20002f30 tx=0x7fae2000fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:42.226 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.212+0000 7fae2bfff700 1 --2- 172.21.15.158:0/2625766884 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fae2c0b6970 0x7fae2c09add0 secure :-1 s=THROTTLE_DONE pgs=315 cs=0 l=1 rx=0x7fae20002f30 tx=0x7fae2000fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:42.226 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.212+0000 7fae2affd700 1 -- 172.21.15.158:0/2625766884 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae200088b0 con 0x7fae2c0b6970 2019-12-05T03:50:42.226 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.212+0000 7fae2affd700 1 -- 172.21.15.158:0/2625766884 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae20011b50 con 0x7fae2c0b6970 2019-12-05T03:50:42.226 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.212+0000 7fae31b36700 1 -- 172.21.15.158:0/2625766884 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fae2c0b6970 msgr2=0x7fae2c09add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:42.226 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.212+0000 7fae31b36700 1 --2- 172.21.15.158:0/2625766884 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fae2c0b6970 0x7fae2c09add0 secure :-1 s=READY pgs=315 cs=0 l=1 rx=0x7fae20002f30 tx=0x7fae2000fdb0).stop 2019-12-05T03:50:42.226 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.212+0000 7fae31b36700 1 -- 172.21.15.158:0/2625766884 shutdown_connections 2019-12-05T03:50:42.227 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.212+0000 7fae31b36700 1 --2- 172.21.15.158:0/2625766884 >> v2:172.21.15.96:3300/0 conn(0x7fae2c05a950 0x7fae2c155290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:42.227 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.212+0000 7fae31b36700 1 --2- 172.21.15.158:0/2625766884 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fae2c0b6970 0x7fae2c09add0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:42.227 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.212+0000 7fae31b36700 1 --2- 172.21.15.158:0/2625766884 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fae2c09ba40 0x7fae2c05a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:42.227 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.212+0000 7fae31b36700 1 -- 172.21.15.158:0/2625766884 shutdown_connections 2019-12-05T03:50:42.227 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.212+0000 7fae31b36700 1 -- 172.21.15.158:0/2625766884 wait complete. 2019-12-05T03:50:42.227 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.212+0000 7fae31b36700 1 -- 172.21.15.158:0/2625766884 >> 172.21.15.158:0/2625766884 conn(0x7fae2c0b7ef0 msgr2=0x7fae2c0b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:42.227 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.216+0000 7fae31b36700 1 Processor -- start 2019-12-05T03:50:42.230 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.216+0000 7fae31b36700 1 -- start start 2019-12-05T03:50:42.230 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.216+0000 7fae31b36700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fae2c0aec70 0x7fae2c0af0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:42.230 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.216+0000 7fae31b36700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae2c0af6d0 con 0x7fae2c0ae6a0 2019-12-05T03:50:42.230 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.216+0000 7fae31b36700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae2c0b17d0 con 0x7fae2c0ad1e0 2019-12-05T03:50:42.230 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.216+0000 7fae31b36700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae2c0af900 con 0x7fae2c0aec70 2019-12-05T03:50:42.231 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.216+0000 7fae308d4700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fae2c0ad1e0 0x7fae2c0b0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49634/0 (socket says 172.21.15.158:49634) 2019-12-05T03:50:42.231 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.216+0000 7fae308d4700 1 -- 172.21.15.158:0/2420326764 learned_addr learned my addr 172.21.15.158:0/2420326764 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:42.231 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.216+0000 7fae2b7fe700 1 --2- 172.21.15.158:0/2420326764 >> v2:172.21.15.96:3300/0 conn(0x7fae2c0aec70 0x7fae2c0af0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:42.231 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.220+0000 7fae2b7fe700 1 -- 172.21.15.158:0/2420326764 >> v1:172.21.15.158:6789/0 conn(0x7fae2c0ad1e0 legacy=0x7fae2c0b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:42.231 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.220+0000 7fae2b7fe700 1 -- 172.21.15.158:0/2420326764 >> v1:172.21.15.96:6789/0 conn(0x7fae2c0ae6a0 legacy=0x7fae2c13c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:42.231 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.220+0000 7fae2b7fe700 1 -- 172.21.15.158:0/2420326764 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae2c0b1a00 con 0x7fae2c0aec70 2019-12-05T03:50:42.231 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.220+0000 7fae2b7fe700 1 --2- 172.21.15.158:0/2420326764 >> v2:172.21.15.96:3300/0 conn(0x7fae2c0aec70 0x7fae2c0af0a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fae1c002f30 tx=0x7fae1c010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:42.232 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.220+0000 7fae2b7fe700 1 --2- 172.21.15.158:0/2420326764 >> v2:172.21.15.96:3300/0 conn(0x7fae2c0aec70 0x7fae2c0af0a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fae1c002f30 tx=0x7fae1c010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:42.232 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.220+0000 7fae2b7fe700 1 --2- 172.21.15.158:0/2420326764 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae2c0aec70 0x7fae2c0af0a0 secure :-1 s=READY pgs=228 cs=0 l=1 rx=0x7fae1c002f30 tx=0x7fae1c010b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:42.232 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.220+0000 7fae2b7fe700 1 --2- 172.21.15.158:0/2420326764 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae2c0aec70 0x7fae2c0af0a0 secure :-1 s=THROTTLE_DONE pgs=228 cs=0 l=1 rx=0x7fae1c002f30 tx=0x7fae1c010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:42.232 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.220+0000 7fae28ff9700 1 -- 172.21.15.158:0/2420326764 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae1c00d0b0 con 0x7fae2c0aec70 2019-12-05T03:50:42.232 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.220+0000 7fae31b36700 1 -- 172.21.15.158:0/2420326764 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae2c0ad610 con 0x7fae2c0aec70 2019-12-05T03:50:42.232 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.220+0000 7fae2b7fe700 1 --2- 172.21.15.158:0/2420326764 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae2c0aec70 0x7fae2c0af0a0 secure :-1 s=THROTTLE_DONE pgs=228 cs=0 l=1 rx=0x7fae1c002f30 tx=0x7fae1c010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:42.233 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.220+0000 7fae28ff9700 1 -- 172.21.15.158:0/2420326764 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1c007160 con 0x7fae2c0aec70 2019-12-05T03:50:42.233 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.220+0000 7fae2b7fe700 1 --2- 172.21.15.158:0/2420326764 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae2c0aec70 0x7fae2c0af0a0 secure :-1 s=THROTTLE_DONE pgs=228 cs=0 l=1 rx=0x7fae1c002f30 tx=0x7fae1c010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:42.233 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.220+0000 7fae28ff9700 1 -- 172.21.15.158:0/2420326764 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae1c005d00 con 0x7fae2c0aec70 2019-12-05T03:50:42.233 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.220+0000 7fae31b36700 1 -- 172.21.15.158:0/2420326764 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae2c146dc0 con 0x7fae2c0aec70 2019-12-05T03:50:42.233 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.220+0000 7fae2b7fe700 1 --2- 172.21.15.158:0/2420326764 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae2c0aec70 0x7fae2c0af0a0 secure :-1 s=THROTTLE_DONE pgs=228 cs=0 l=1 rx=0x7fae1c002f30 tx=0x7fae1c010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:42.233 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.224+0000 7fae28ff9700 1 -- 172.21.15.158:0/2420326764 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fae1c00e270 con 0x7fae2c0aec70 2019-12-05T03:50:42.233 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.224+0000 7fae2b7fe700 1 --2- 172.21.15.158:0/2420326764 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae2c0aec70 0x7fae2c0af0a0 secure :-1 s=THROTTLE_DONE pgs=228 cs=0 l=1 rx=0x7fae1c002f30 tx=0x7fae1c010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:42.234 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.224+0000 7fae28ff9700 1 --2- 172.21.15.158:0/2420326764 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fae0c03acc0 0x7fae0c03d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:42.234 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.224+0000 7fae28ff9700 1 -- 172.21.15.158:0/2420326764 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5200+0+0 (secure 0 0 0) 0x7fae1c04b400 con 0x7fae2c0aec70 2019-12-05T03:50:42.234 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.224+0000 7fae2bfff700 1 --2- 172.21.15.158:0/2420326764 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fae0c03acc0 0x7fae0c03d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:42.235 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.224+0000 7fae2bfff700 1 --2- 172.21.15.158:0/2420326764 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fae0c03acc0 0x7fae0c03d1d0 crc :-1 s=READY pgs=146 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:42.235 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.224+0000 7fae31b36700 1 -- 172.21.15.158:0/2420326764 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae2c0554e0 con 0x7fae2c0aec70 2019-12-05T03:50:42.239 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.232+0000 7fae2b7fe700 1 --2- 172.21.15.158:0/2420326764 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae2c0aec70 0x7fae2c0af0a0 secure :-1 s=THROTTLE_DONE pgs=228 cs=0 l=1 rx=0x7fae1c002f30 tx=0x7fae1c010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:42.239 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.232+0000 7fae28ff9700 1 -- 172.21.15.158:0/2420326764 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fae1c0326c0 con 0x7fae2c0aec70 2019-12-05T03:50:42.406 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:42.400+0000 7fae31b36700 1 -- 172.21.15.158:0/2420326764 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"} v 0) v1 -- 0x7fae2c066940 con 0x7fae2c0aec70 2019-12-05T03:50:43.233 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.224+0000 7fae2b7fe700 1 --2- 172.21.15.158:0/2420326764 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae2c0aec70 0x7fae2c0af0a0 secure :-1 s=THROTTLE_DONE pgs=228 cs=0 l=1 rx=0x7fae1c002f30 tx=0x7fae1c010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:43.233 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.224+0000 7fae28ff9700 1 -- 172.21.15.158:0/2420326764 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_metadata"}]=0 pool 'cephfs_metadata' created v29) v1 ==== 133+0+0 (secure 0 0 0) 0x7fae1c033270 con 0x7fae2c0aec70 2019-12-05T03:50:43.271 INFO:teuthology.orchestra.run.smithi158.stderr:pool 'cephfs_metadata' created 2019-12-05T03:50:43.275 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.268+0000 7fae31b36700 1 -- 172.21.15.158:0/2420326764 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fae0c03acc0 msgr2=0x7fae0c03d1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:43.275 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.268+0000 7fae31b36700 1 --2- 172.21.15.158:0/2420326764 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fae0c03acc0 0x7fae0c03d1d0 crc :-1 s=READY pgs=146 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:43.275 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.268+0000 7fae31b36700 1 -- 172.21.15.158:0/2420326764 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae2c0aec70 msgr2=0x7fae2c0af0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:43.276 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.268+0000 7fae31b36700 1 --2- 172.21.15.158:0/2420326764 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae2c0aec70 0x7fae2c0af0a0 secure :-1 s=READY pgs=228 cs=0 l=1 rx=0x7fae1c002f30 tx=0x7fae1c010b90).stop 2019-12-05T03:50:43.276 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.268+0000 7fae31b36700 1 -- 172.21.15.158:0/2420326764 shutdown_connections 2019-12-05T03:50:43.276 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.268+0000 7fae31b36700 1 --2- 172.21.15.158:0/2420326764 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fae0c03acc0 0x7fae0c03d1d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:43.276 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.268+0000 7fae31b36700 1 --2- 172.21.15.158:0/2420326764 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae2c0aec70 0x7fae2c0af0a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:43.276 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.268+0000 7fae31b36700 1 -- 172.21.15.158:0/2420326764 shutdown_connections 2019-12-05T03:50:43.276 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.268+0000 7fae31b36700 1 -- 172.21.15.158:0/2420326764 wait complete. 2019-12-05T03:50:43.277 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.268+0000 7fae31b36700 1 -- 172.21.15.158:0/2420326764 >> 172.21.15.158:0/2420326764 conn(0x7fae2c153e50 msgr2=0x7fae2c09a320 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:43.289 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2019-12-05T03:50:43.403 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.388+0000 7f15ce635700 1 Processor -- start 2019-12-05T03:50:43.403 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.388+0000 7f15ce635700 1 -- start start 2019-12-05T03:50:43.403 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.392+0000 7f15ce635700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15c809add0 0x7f15c80b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:43.404 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.392+0000 7f15ce635700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c8099e30 con 0x7f15c80b6970 2019-12-05T03:50:43.404 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.392+0000 7f15ce635700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c80b60c0 con 0x7f15c809ba40 2019-12-05T03:50:43.404 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.392+0000 7f15ce635700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c809d210 con 0x7f15c809add0 2019-12-05T03:50:43.404 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.392+0000 7f15c7fff700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f15c809ba40 0x7f15c80b5370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49638/0 (socket says 172.21.15.158:49638) 2019-12-05T03:50:43.404 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.392+0000 7f15c7fff700 1 -- 172.21.15.158:0/102866121 learned_addr learned my addr 172.21.15.158:0/102866121 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:43.405 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.392+0000 7f15cd3d3700 1 --2- 172.21.15.158:0/102866121 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15c809add0 0x7f15c80b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:43.405 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.392+0000 7f15c77fe700 1 -- 172.21.15.158:0/102866121 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3581294619 0 0) 0x7f15c80b60c0 con 0x7f15c809ba40 2019-12-05T03:50:43.405 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.392+0000 7f15c77fe700 1 -- 172.21.15.158:0/102866121 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15b40030b0 con 0x7f15c809ba40 2019-12-05T03:50:43.405 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.392+0000 7f15c77fe700 1 -- 172.21.15.158:0/102866121 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 491950814 0 0) 0x7f15c8099e30 con 0x7f15c80b6970 2019-12-05T03:50:43.405 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.392+0000 7f15c77fe700 1 -- 172.21.15.158:0/102866121 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15c80b60c0 con 0x7f15c80b6970 2019-12-05T03:50:43.405 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.392+0000 7f15cd3d3700 1 -- 172.21.15.158:0/102866121 >> v1:172.21.15.158:6789/0 conn(0x7f15c809ba40 legacy=0x7f15c80b5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:43.406 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.392+0000 7f15cd3d3700 1 -- 172.21.15.158:0/102866121 >> v1:172.21.15.96:6789/0 conn(0x7f15c80b6970 legacy=0x7f15c805a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:43.406 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.392+0000 7f15cd3d3700 1 -- 172.21.15.158:0/102866121 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c807e960 con 0x7f15c809add0 2019-12-05T03:50:43.406 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.392+0000 7f15cd3d3700 1 --2- 172.21.15.158:0/102866121 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15c809add0 0x7f15c80b5b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f15c0008b10 tx=0x7f15c000ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:43.406 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.392+0000 7f15cd3d3700 1 --2- 172.21.15.158:0/102866121 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15c809add0 0x7f15c80b5b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f15c0008b10 tx=0x7f15c000ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:43.406 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.392+0000 7f15cd3d3700 1 --2- 172.21.15.158:0/102866121 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15c809add0 0x7f15c80b5b70 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7f15c0008b10 tx=0x7f15c000ff70).ready entity=mon.2 client_cookie=4e148a2814a3be40 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:43.407 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.392+0000 7f15cd3d3700 1 --2- 172.21.15.158:0/102866121 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15c809add0 0x7f15c80b5b70 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f15c0008b10 tx=0x7f15c000ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:43.407 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.392+0000 7f15c77fe700 1 -- 172.21.15.158:0/102866121 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15c0010970 con 0x7f15c809add0 2019-12-05T03:50:43.407 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.392+0000 7f15cd3d3700 1 --2- 172.21.15.158:0/102866121 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15c809add0 0x7f15c80b5b70 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f15c0008b10 tx=0x7f15c000ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:43.407 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.392+0000 7f15cd3d3700 1 --2- 172.21.15.158:0/102866121 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15c809add0 0x7f15c80b5b70 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f15c0008b10 tx=0x7f15c000ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:43.407 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.392+0000 7f15c77fe700 1 -- 172.21.15.158:0/102866121 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c0008b50 con 0x7f15c809add0 2019-12-05T03:50:43.408 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.392+0000 7f15c77fe700 1 -- 172.21.15.158:0/102866121 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15c00110c0 con 0x7f15c809add0 2019-12-05T03:50:43.408 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.392+0000 7f15ce635700 1 -- 172.21.15.158:0/102866121 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15c809add0 msgr2=0x7f15c80b5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:43.408 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.392+0000 7f15ce635700 1 --2- 172.21.15.158:0/102866121 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15c809add0 0x7f15c80b5b70 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7f15c0008b10 tx=0x7f15c000ff70).stop 2019-12-05T03:50:43.408 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.392+0000 7f15ce635700 1 -- 172.21.15.158:0/102866121 shutdown_connections 2019-12-05T03:50:43.408 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.392+0000 7f15ce635700 1 --2- 172.21.15.158:0/102866121 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15c809add0 0x7f15c80b5b70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:43.408 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.392+0000 7f15ce635700 1 -- 172.21.15.158:0/102866121 shutdown_connections 2019-12-05T03:50:43.409 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.392+0000 7f15ce635700 1 -- 172.21.15.158:0/102866121 wait complete. 2019-12-05T03:50:43.409 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.392+0000 7f15ce635700 1 -- 172.21.15.158:0/102866121 >> 172.21.15.158:0/102866121 conn(0x7f15c80b7ef0 msgr2=0x7f15c80b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:43.409 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.396+0000 7f15ce635700 1 Processor -- start 2019-12-05T03:50:43.409 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.396+0000 7f15ce635700 1 -- start start 2019-12-05T03:50:43.411 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.396+0000 7f15ce635700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f15c8135550 0x7f15c81541b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:43.411 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.396+0000 7f15ce635700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15c8139bc0 0x7f15c80b3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:43.411 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.396+0000 7f15ce635700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f15c80b4390 0x7f15c80b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:43.412 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.396+0000 7f15ce635700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c805a500 con 0x7f15c80b4390 2019-12-05T03:50:43.412 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.396+0000 7f15ce635700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c8135980 con 0x7f15c8135550 2019-12-05T03:50:43.412 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.396+0000 7f15ce635700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c8139ff0 con 0x7f15c8139bc0 2019-12-05T03:50:43.412 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.396+0000 7f15ccbd2700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f15c8135550 0x7f15c81541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:43.412 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.396+0000 7f15ccbd2700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f15c8135550 0x7f15c81541b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54864/0 (socket says 172.21.15.158:54864) 2019-12-05T03:50:43.413 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.396+0000 7f15ccbd2700 1 -- 172.21.15.158:0/2029597646 learned_addr learned my addr 172.21.15.158:0/2029597646 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:43.413 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.396+0000 7f15c7fff700 1 --2- 172.21.15.158:0/2029597646 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15c8139bc0 0x7f15c80b3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:43.413 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.396+0000 7f15cd3d3700 1 --2- 172.21.15.158:0/2029597646 >> v2:172.21.15.96:3300/0 conn(0x7f15c80b4390 0x7f15c80b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:43.413 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.396+0000 7f15ccbd2700 1 -- 172.21.15.158:0/2029597646 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15c8139bc0 msgr2=0x7f15c80b3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:43.413 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.396+0000 7f15ccbd2700 1 --2- 172.21.15.158:0/2029597646 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15c8139bc0 0x7f15c80b3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:43.413 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.396+0000 7f15ccbd2700 1 -- 172.21.15.158:0/2029597646 >> v2:172.21.15.96:3300/0 conn(0x7f15c80b4390 msgr2=0x7f15c80b06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:43.413 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.396+0000 7f15ccbd2700 1 --2- 172.21.15.158:0/2029597646 >> v2:172.21.15.96:3300/0 conn(0x7f15c80b4390 0x7f15c80b06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:43.414 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.396+0000 7f15ccbd2700 1 -- 172.21.15.158:0/2029597646 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c805a7a0 con 0x7f15c8135550 2019-12-05T03:50:43.416 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.396+0000 7f15ccbd2700 1 --2- 172.21.15.158:0/2029597646 >> v2:172.21.15.158:3300/0 conn(0x7f15c8135550 0x7f15c81541b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f15b8000e90 tx=0x7f15b8010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:43.416 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.396+0000 7f15ccbd2700 1 --2- 172.21.15.158:0/2029597646 >> v2:172.21.15.158:3300/0 conn(0x7f15c8135550 0x7f15c81541b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f15b8000e90 tx=0x7f15b8010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:43.416 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.396+0000 7f15ccbd2700 1 --2- 172.21.15.158:0/2029597646 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15c8135550 0x7f15c81541b0 secure :-1 s=READY pgs=318 cs=0 l=1 rx=0x7f15b8000e90 tx=0x7f15b8010a20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:43.417 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.400+0000 7f15ccbd2700 1 --2- 172.21.15.158:0/2029597646 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15c8135550 0x7f15c81541b0 secure :-1 s=THROTTLE_DONE pgs=318 cs=0 l=1 rx=0x7f15b8000e90 tx=0x7f15b8010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:43.417 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.400+0000 7f15ccbd2700 1 --2- 172.21.15.158:0/2029597646 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15c8135550 0x7f15c81541b0 secure :-1 s=THROTTLE_DONE pgs=318 cs=0 l=1 rx=0x7f15b8000e90 tx=0x7f15b8010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:43.417 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.400+0000 7f15ccbd2700 1 --2- 172.21.15.158:0/2029597646 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15c8135550 0x7f15c81541b0 secure :-1 s=THROTTLE_DONE pgs=318 cs=0 l=1 rx=0x7f15b8000e90 tx=0x7f15b8010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:43.417 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.400+0000 7f15c57fa700 1 -- 172.21.15.158:0/2029597646 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15b800caa0 con 0x7f15c8135550 2019-12-05T03:50:43.417 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.400+0000 7f15c57fa700 1 -- 172.21.15.158:0/2029597646 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b800c6c0 con 0x7f15c8135550 2019-12-05T03:50:43.417 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.400+0000 7f15ce635700 1 -- 172.21.15.158:0/2029597646 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c8127e70 con 0x7f15c8135550 2019-12-05T03:50:43.418 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.400+0000 7f15c57fa700 1 -- 172.21.15.158:0/2029597646 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15b800d6a0 con 0x7f15c8135550 2019-12-05T03:50:43.418 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.400+0000 7f15ce635700 1 -- 172.21.15.158:0/2029597646 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c80b0e50 con 0x7f15c8135550 2019-12-05T03:50:43.418 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.400+0000 7f15ccbd2700 1 --2- 172.21.15.158:0/2029597646 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15c8135550 0x7f15c81541b0 secure :-1 s=THROTTLE_DONE pgs=318 cs=0 l=1 rx=0x7f15b8000e90 tx=0x7f15b8010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:43.418 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.400+0000 7f15ccbd2700 1 --2- 172.21.15.158:0/2029597646 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15c8135550 0x7f15c81541b0 secure :-1 s=THROTTLE_DONE pgs=318 cs=0 l=1 rx=0x7f15b8000e90 tx=0x7f15b8010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:43.418 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.400+0000 7f15c57fa700 1 -- 172.21.15.158:0/2029597646 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f15b800d8a0 con 0x7f15c8135550 2019-12-05T03:50:43.419 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.400+0000 7f15c57fa700 1 --2- 172.21.15.158:0/2029597646 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f15ac03ad40 0x7f15ac03d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:43.419 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.400+0000 7f15c57fa700 1 -- 172.21.15.158:0/2029597646 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f15b804b2e0 con 0x7f15c8135550 2019-12-05T03:50:43.419 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.400+0000 7f15c7fff700 1 --2- 172.21.15.158:0/2029597646 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f15ac03ad40 0x7f15ac03d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:43.419 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.400+0000 7f15c7fff700 1 --2- 172.21.15.158:0/2029597646 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f15ac03ad40 0x7f15ac03d250 crc :-1 s=READY pgs=147 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:43.419 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.404+0000 7f15ce635700 1 -- 172.21.15.158:0/2029597646 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c80554e0 con 0x7f15c8135550 2019-12-05T03:50:43.421 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.416+0000 7f15ccbd2700 1 --2- 172.21.15.158:0/2029597646 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15c8135550 0x7f15c81541b0 secure :-1 s=THROTTLE_DONE pgs=318 cs=0 l=1 rx=0x7f15b8000e90 tx=0x7f15b8010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:43.421 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.416+0000 7f15c57fa700 1 -- 172.21.15.158:0/2029597646 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f15b8032320 con 0x7f15c8135550 2019-12-05T03:50:43.588 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:43.580+0000 7f15ce635700 1 -- 172.21.15.158:0/2029597646 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"} v 0) v1 -- 0x7f15c80998d0 con 0x7f15c8135550 2019-12-05T03:50:44.238 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.232+0000 7f15ccbd2700 1 --2- 172.21.15.158:0/2029597646 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15c8135550 0x7f15c81541b0 secure :-1 s=THROTTLE_DONE pgs=318 cs=0 l=1 rx=0x7f15b8000e90 tx=0x7f15b8010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.239 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.232+0000 7f15c57fa700 1 -- 172.21.15.158:0/2029597646 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "cephfs_data"}]=0 pool 'cephfs_data' created v30) v1 ==== 125+0+0 (secure 0 0 0) 0x7f15b8032580 con 0x7f15c8135550 2019-12-05T03:50:44.254 INFO:teuthology.orchestra.run.smithi158.stderr:pool 'cephfs_data' created 2019-12-05T03:50:44.257 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.248+0000 7f15ce635700 1 -- 172.21.15.158:0/2029597646 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f15ac03ad40 msgr2=0x7f15ac03d250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:44.257 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.248+0000 7f15ce635700 1 --2- 172.21.15.158:0/2029597646 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f15ac03ad40 0x7f15ac03d250 crc :-1 s=READY pgs=147 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:44.258 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.248+0000 7f15ce635700 1 -- 172.21.15.158:0/2029597646 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15c8135550 msgr2=0x7f15c81541b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:44.258 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.248+0000 7f15ce635700 1 --2- 172.21.15.158:0/2029597646 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15c8135550 0x7f15c81541b0 secure :-1 s=READY pgs=318 cs=0 l=1 rx=0x7f15b8000e90 tx=0x7f15b8010a20).stop 2019-12-05T03:50:44.258 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.248+0000 7f15ce635700 1 -- 172.21.15.158:0/2029597646 shutdown_connections 2019-12-05T03:50:44.258 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.248+0000 7f15ce635700 1 --2- 172.21.15.158:0/2029597646 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f15ac03ad40 0x7f15ac03d250 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:44.258 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.248+0000 7f15ce635700 1 --2- 172.21.15.158:0/2029597646 >> v2:172.21.15.96:3300/0 conn(0x7f15c80b4390 0x7f15c80b06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:44.258 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.248+0000 7f15ce635700 1 --2- 172.21.15.158:0/2029597646 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f15c8135550 0x7f15c81541b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:44.259 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.248+0000 7f15ce635700 1 --2- 172.21.15.158:0/2029597646 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f15c8139bc0 0x7f15c80b3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:44.259 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.248+0000 7f15ce635700 1 -- 172.21.15.158:0/2029597646 shutdown_connections 2019-12-05T03:50:44.259 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.248+0000 7f15ce635700 1 -- 172.21.15.158:0/2029597646 wait complete. 2019-12-05T03:50:44.259 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.248+0000 7f15ce635700 1 -- 172.21.15.158:0/2029597646 >> 172.21.15.158:0/2029597646 conn(0x7f15c80b1780 msgr2=0x7f15c807b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:44.268 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2019-12-05T03:50:44.365 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.352+0000 7f006aaff700 1 Processor -- start 2019-12-05T03:50:44.365 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.352+0000 7f006aaff700 1 -- start start 2019-12-05T03:50:44.365 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.352+0000 7f006aaff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f00640b6970 0x7f006409add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:44.365 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.352+0000 7f006aaff700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f00640b5370 0x7f00640b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:44.365 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.352+0000 7f006aaff700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0064099e30 con 0x7f006409ba40 2019-12-05T03:50:44.366 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.352+0000 7f006aaff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f006409d210 con 0x7f00640b6970 2019-12-05T03:50:44.366 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.352+0000 7f006aaff700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0064099b90 con 0x7f00640b5370 2019-12-05T03:50:44.366 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.352+0000 7f006909c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f00640b6970 0x7f006409add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:44.366 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.352+0000 7f006909c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f00640b6970 0x7f006409add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54872/0 (socket says 172.21.15.158:54872) 2019-12-05T03:50:44.366 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.352+0000 7f006909c700 1 -- 172.21.15.158:0/3339875528 learned_addr learned my addr 172.21.15.158:0/3339875528 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:44.367 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.352+0000 7f006989d700 1 --2- 172.21.15.158:0/3339875528 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f00640b5370 0x7f00640b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:44.367 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.352+0000 7f006909c700 1 -- 172.21.15.158:0/3339875528 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f00640b5370 msgr2=0x7f00640b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:44.367 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.352+0000 7f006909c700 1 --2- 172.21.15.158:0/3339875528 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f00640b5370 0x7f00640b57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:44.367 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.352+0000 7f006909c700 1 -- 172.21.15.158:0/3339875528 >> v1:172.21.15.96:6789/0 conn(0x7f006409ba40 legacy=0x7f006405a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:44.367 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.352+0000 7f006909c700 1 -- 172.21.15.158:0/3339875528 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006407e960 con 0x7f00640b6970 2019-12-05T03:50:44.368 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.352+0000 7f006989d700 1 --2- 172.21.15.158:0/3339875528 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f00640b5370 0x7f00640b57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-12-05T03:50:44.368 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.352+0000 7f006909c700 1 --2- 172.21.15.158:0/3339875528 >> v2:172.21.15.158:3300/0 conn(0x7f00640b6970 0x7f006409add0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0054002f30 tx=0x7f005400fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.368 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.352+0000 7f006909c700 1 --2- 172.21.15.158:0/3339875528 >> v2:172.21.15.158:3300/0 conn(0x7f00640b6970 0x7f006409add0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0054002f30 tx=0x7f005400fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.368 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.352+0000 7f006909c700 1 --2- 172.21.15.158:0/3339875528 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f00640b6970 0x7f006409add0 secure :-1 s=READY pgs=319 cs=0 l=1 rx=0x7f0054002f30 tx=0x7f005400fd30).ready entity=mon.1 client_cookie=24cb0b83099605e8 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:44.368 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.352+0000 7f006909c700 1 --2- 172.21.15.158:0/3339875528 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f00640b6970 0x7f006409add0 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f0054002f30 tx=0x7f005400fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.369 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.352+0000 7f005bfff700 1 -- 172.21.15.158:0/3339875528 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0054008c90 con 0x7f00640b6970 2019-12-05T03:50:44.369 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.356+0000 7f006909c700 1 --2- 172.21.15.158:0/3339875528 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f00640b6970 0x7f006409add0 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f0054002f30 tx=0x7f005400fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.369 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.356+0000 7f006909c700 1 --2- 172.21.15.158:0/3339875528 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f00640b6970 0x7f006409add0 secure :-1 s=THROTTLE_DONE pgs=319 cs=0 l=1 rx=0x7f0054002f30 tx=0x7f005400fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.369 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.356+0000 7f005bfff700 1 -- 172.21.15.158:0/3339875528 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00540088b0 con 0x7f00640b6970 2019-12-05T03:50:44.369 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.356+0000 7f005bfff700 1 -- 172.21.15.158:0/3339875528 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0054011ad0 con 0x7f00640b6970 2019-12-05T03:50:44.369 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.356+0000 7f006aaff700 1 -- 172.21.15.158:0/3339875528 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f00640b6970 msgr2=0x7f006409add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:44.370 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.356+0000 7f006aaff700 1 --2- 172.21.15.158:0/3339875528 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f00640b6970 0x7f006409add0 secure :-1 s=READY pgs=319 cs=0 l=1 rx=0x7f0054002f30 tx=0x7f005400fd30).stop 2019-12-05T03:50:44.370 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.356+0000 7f006aaff700 1 -- 172.21.15.158:0/3339875528 shutdown_connections 2019-12-05T03:50:44.370 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.356+0000 7f006aaff700 1 --2- 172.21.15.158:0/3339875528 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f00640b5370 0x7f00640b57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:44.370 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.356+0000 7f006aaff700 1 --2- 172.21.15.158:0/3339875528 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f00640b6970 0x7f006409add0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:44.370 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.356+0000 7f006aaff700 1 -- 172.21.15.158:0/3339875528 shutdown_connections 2019-12-05T03:50:44.371 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.356+0000 7f006aaff700 1 -- 172.21.15.158:0/3339875528 wait complete. 2019-12-05T03:50:44.371 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.356+0000 7f006aaff700 1 -- 172.21.15.158:0/3339875528 >> 172.21.15.158:0/3339875528 conn(0x7f00640b7ef0 msgr2=0x7f00640b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:44.371 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.356+0000 7f006aaff700 1 Processor -- start 2019-12-05T03:50:44.371 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.356+0000 7f006aaff700 1 -- start start 2019-12-05T03:50:44.375 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.360+0000 7f006aaff700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f006413a8d0 0x7f0064154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:44.375 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.360+0000 7f006aaff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f006413e2c0 0x7f00640ac370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:44.376 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.360+0000 7f006aaff700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f006412cc90 con 0x7f006413de90 2019-12-05T03:50:44.376 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.360+0000 7f006aaff700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f006413e810 con 0x7f006413e2c0 2019-12-05T03:50:44.376 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.360+0000 7f006aaff700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f006413eab0 con 0x7f006413a8d0 2019-12-05T03:50:44.377 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.360+0000 7f006989d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f006413e2c0 0x7f00640ac370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:44.377 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.360+0000 7f006989d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f006413e2c0 0x7f00640ac370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54878/0 (socket says 172.21.15.158:54878) 2019-12-05T03:50:44.377 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.360+0000 7f006989d700 1 -- 172.21.15.158:0/769836065 learned_addr learned my addr 172.21.15.158:0/769836065 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:44.377 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.360+0000 7f006909c700 1 --2- 172.21.15.158:0/769836065 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f006413a8d0 0x7f0064154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:44.377 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.360+0000 7f006989d700 1 -- 172.21.15.158:0/769836065 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f006413a8d0 msgr2=0x7f0064154140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:44.377 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.360+0000 7f006989d700 1 --2- 172.21.15.158:0/769836065 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f006413a8d0 0x7f0064154140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:44.378 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.360+0000 7f006989d700 1 -- 172.21.15.158:0/769836065 >> v1:172.21.15.96:6789/0 conn(0x7f006413de90 legacy=0x7f006412c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:44.378 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.360+0000 7f006989d700 1 -- 172.21.15.158:0/769836065 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00640b3130 con 0x7f006413e2c0 2019-12-05T03:50:44.378 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.360+0000 7f006989d700 1 --2- 172.21.15.158:0/769836065 >> v2:172.21.15.158:3300/0 conn(0x7f006413e2c0 0x7f00640ac370 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f006413e9d0 tx=0x7f005c010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.378 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.360+0000 7f006989d700 1 --2- 172.21.15.158:0/769836065 >> v2:172.21.15.158:3300/0 conn(0x7f006413e2c0 0x7f00640ac370 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f006413e9d0 tx=0x7f005c010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.378 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.360+0000 7f006989d700 1 --2- 172.21.15.158:0/769836065 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f006413e2c0 0x7f00640ac370 secure :-1 s=READY pgs=320 cs=0 l=1 rx=0x7f006413e9d0 tx=0x7f005c010c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:44.378 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.360+0000 7f006989d700 1 --2- 172.21.15.158:0/769836065 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f006413e2c0 0x7f00640ac370 secure :-1 s=THROTTLE_DONE pgs=320 cs=0 l=1 rx=0x7f006413e9d0 tx=0x7f005c010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.378 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.360+0000 7f0059ffb700 1 -- 172.21.15.158:0/769836065 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f005c00f0b0 con 0x7f006413e2c0 2019-12-05T03:50:44.379 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.360+0000 7f006989d700 1 --2- 172.21.15.158:0/769836065 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f006413e2c0 0x7f00640ac370 secure :-1 s=THROTTLE_DONE pgs=320 cs=0 l=1 rx=0x7f006413e9d0 tx=0x7f005c010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.379 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.360+0000 7f0059ffb700 1 -- 172.21.15.158:0/769836065 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005c005cb0 con 0x7f006413e2c0 2019-12-05T03:50:44.379 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.360+0000 7f006989d700 1 --2- 172.21.15.158:0/769836065 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f006413e2c0 0x7f00640ac370 secure :-1 s=THROTTLE_DONE pgs=320 cs=0 l=1 rx=0x7f006413e9d0 tx=0x7f005c010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.379 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.360+0000 7f006aaff700 1 -- 172.21.15.158:0/769836065 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00640ac8c0 con 0x7f006413e2c0 2019-12-05T03:50:44.379 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.360+0000 7f0059ffb700 1 -- 172.21.15.158:0/769836065 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f005c012290 con 0x7f006413e2c0 2019-12-05T03:50:44.380 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.360+0000 7f006aaff700 1 -- 172.21.15.158:0/769836065 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00640ace70 con 0x7f006413e2c0 2019-12-05T03:50:44.380 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.360+0000 7f006989d700 1 --2- 172.21.15.158:0/769836065 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f006413e2c0 0x7f00640ac370 secure :-1 s=THROTTLE_DONE pgs=320 cs=0 l=1 rx=0x7f006413e9d0 tx=0x7f005c010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.380 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.360+0000 7f0059ffb700 1 -- 172.21.15.158:0/769836065 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f005c0125b0 con 0x7f006413e2c0 2019-12-05T03:50:44.380 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.360+0000 7f006989d700 1 --2- 172.21.15.158:0/769836065 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f006413e2c0 0x7f00640ac370 secure :-1 s=THROTTLE_DONE pgs=320 cs=0 l=1 rx=0x7f006413e9d0 tx=0x7f005c010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.380 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.360+0000 7f0059ffb700 1 --2- 172.21.15.158:0/769836065 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f004403ad90 0x7f004403d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:44.380 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.360+0000 7f0059ffb700 1 -- 172.21.15.158:0/769836065 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5904+0+0 (secure 0 0 0) 0x7f005c04b1d0 con 0x7f006413e2c0 2019-12-05T03:50:44.381 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.364+0000 7f006909c700 1 --2- 172.21.15.158:0/769836065 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f004403ad90 0x7f004403d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:44.381 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.364+0000 7f006909c700 1 --2- 172.21.15.158:0/769836065 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f004403ad90 0x7f004403d2a0 crc :-1 s=READY pgs=148 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:44.381 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.368+0000 7f006aaff700 1 -- 172.21.15.158:0/769836065 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00640554e0 con 0x7f006413e2c0 2019-12-05T03:50:44.383 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.376+0000 7f006989d700 1 --2- 172.21.15.158:0/769836065 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f006413e2c0 0x7f00640ac370 secure :-1 s=THROTTLE_DONE pgs=320 cs=0 l=1 rx=0x7f006413e9d0 tx=0x7f005c010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.384 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.376+0000 7f0059ffb700 1 -- 172.21.15.158:0/769836065 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f005c030de0 con 0x7f006413e2c0 2019-12-05T03:50:44.548 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.540+0000 7f006aaff700 1 -- 172.21.15.158:0/769836065 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"} v 0) v1 -- 0x7f0064066940 con 0x7f006413e2c0 2019-12-05T03:50:44.551 INFO:tasks.ceph.mon.b.smithi096.stderr:2019-12-05T03:50:44.544+0000 7fac1e63e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-12-05T03:50:44.560 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.552+0000 7f006989d700 1 --2- 172.21.15.158:0/769836065 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f006413e2c0 0x7f00640ac370 secure :-1 s=THROTTLE_DONE pgs=320 cs=0 l=1 rx=0x7f006413e9d0 tx=0x7f005c010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.561 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.552+0000 7f0059ffb700 1 -- 172.21.15.158:0/769836065 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "data": "cephfs_data", "fs_name": "cephfs", "metadata": "cephfs_metadata"}]=0 new fs with metadata pool 4 and data pool 5 v10) v1 ==== 172+0+0 (secure 0 0 0) 0x7f005c032230 con 0x7f006413e2c0 2019-12-05T03:50:44.563 INFO:teuthology.orchestra.run.smithi158.stderr:new fs with metadata pool 4 and data pool 5 2019-12-05T03:50:44.568 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.560+0000 7f006aaff700 1 -- 172.21.15.158:0/769836065 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f004403ad90 msgr2=0x7f004403d2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:44.569 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.560+0000 7f006aaff700 1 --2- 172.21.15.158:0/769836065 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f004403ad90 0x7f004403d2a0 crc :-1 s=READY pgs=148 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:44.569 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.560+0000 7f006aaff700 1 -- 172.21.15.158:0/769836065 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f006413e2c0 msgr2=0x7f00640ac370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:44.569 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.560+0000 7f006aaff700 1 --2- 172.21.15.158:0/769836065 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f006413e2c0 0x7f00640ac370 secure :-1 s=READY pgs=320 cs=0 l=1 rx=0x7f006413e9d0 tx=0x7f005c010c10).stop 2019-12-05T03:50:44.569 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.560+0000 7f006aaff700 1 -- 172.21.15.158:0/769836065 shutdown_connections 2019-12-05T03:50:44.569 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.560+0000 7f006aaff700 1 --2- 172.21.15.158:0/769836065 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f006413e2c0 0x7f00640ac370 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:44.569 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.560+0000 7f006aaff700 1 --2- 172.21.15.158:0/769836065 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f006413a8d0 0x7f0064154140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:44.570 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.560+0000 7f006aaff700 1 --2- 172.21.15.158:0/769836065 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f004403ad90 0x7f004403d2a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:44.570 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.560+0000 7f006aaff700 1 -- 172.21.15.158:0/769836065 shutdown_connections 2019-12-05T03:50:44.570 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.560+0000 7f006aaff700 1 -- 172.21.15.158:0/769836065 wait complete. 2019-12-05T03:50:44.570 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.560+0000 7f006aaff700 1 -- 172.21.15.158:0/769836065 >> 172.21.15.158:0/769836065 conn(0x7f006405a700 msgr2=0x7f0064155200 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:44.577 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-05T03:50:44.670 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.656+0000 7fa42075a700 1 Processor -- start 2019-12-05T03:50:44.670 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.656+0000 7fa42075a700 1 -- start start 2019-12-05T03:50:44.670 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.660+0000 7fa42075a700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa41809a320 0x7fa41805a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:44.671 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.660+0000 7fa42075a700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa4181553b0 0x7fa4181557e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:44.671 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.660+0000 7fa42075a700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4180accb0 con 0x7fa41809cf60 2019-12-05T03:50:44.671 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.660+0000 7fa42075a700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa41809a750 con 0x7fa4181553b0 2019-12-05T03:50:44.671 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.660+0000 7fa42075a700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4180b1730 con 0x7fa41809a320 2019-12-05T03:50:44.671 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.660+0000 7fa41e4f6700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa41809a320 0x7fa41805a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:44.671 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.660+0000 7fa41e4f6700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa41809a320 0x7fa41805a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54886/0 (socket says 172.21.15.158:54886) 2019-12-05T03:50:44.672 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.660+0000 7fa41e4f6700 1 -- 172.21.15.158:0/1054136767 learned_addr learned my addr 172.21.15.158:0/1054136767 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:44.672 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.660+0000 7fa41f4f8700 1 --2- 172.21.15.158:0/1054136767 >> v2:172.21.15.96:3300/0 conn(0x7fa4181553b0 0x7fa4181557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:44.672 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.660+0000 7fa41e4f6700 1 -- 172.21.15.158:0/1054136767 >> v2:172.21.15.96:3300/0 conn(0x7fa4181553b0 msgr2=0x7fa4181557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:44.672 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.660+0000 7fa41e4f6700 1 --2- 172.21.15.158:0/1054136767 >> v2:172.21.15.96:3300/0 conn(0x7fa4181553b0 0x7fa4181557e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:44.673 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.660+0000 7fa41e4f6700 1 -- 172.21.15.158:0/1054136767 >> v1:172.21.15.158:6789/0 conn(0x7fa41809cf60 legacy=0x7fa418151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:44.673 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.660+0000 7fa41e4f6700 1 -- 172.21.15.158:0/1054136767 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4180b6980 con 0x7fa41809a320 2019-12-05T03:50:44.673 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.660+0000 7fa41e4f6700 1 --2- 172.21.15.158:0/1054136767 >> v2:172.21.15.158:3300/0 conn(0x7fa41809a320 0x7fa41805a740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa40c008790 tx=0x7fa40c00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.673 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.660+0000 7fa41e4f6700 1 --2- 172.21.15.158:0/1054136767 >> v2:172.21.15.158:3300/0 conn(0x7fa41809a320 0x7fa41805a740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa40c008790 tx=0x7fa40c00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.673 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.660+0000 7fa41e4f6700 1 --2- 172.21.15.158:0/1054136767 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa41809a320 0x7fa41805a740 secure :-1 s=READY pgs=322 cs=0 l=1 rx=0x7fa40c008790 tx=0x7fa40c00fd30).ready entity=mon.1 client_cookie=5f15d63628ef3763 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:44.673 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.660+0000 7fa41e4f6700 1 --2- 172.21.15.158:0/1054136767 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa41809a320 0x7fa41805a740 secure :-1 s=THROTTLE_DONE pgs=322 cs=0 l=1 rx=0x7fa40c008790 tx=0x7fa40c00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.673 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.660+0000 7fa41dcf5700 1 -- 172.21.15.158:0/1054136767 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa40c008c90 con 0x7fa41809a320 2019-12-05T03:50:44.674 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.660+0000 7fa41e4f6700 1 --2- 172.21.15.158:0/1054136767 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa41809a320 0x7fa41805a740 secure :-1 s=THROTTLE_DONE pgs=322 cs=0 l=1 rx=0x7fa40c008790 tx=0x7fa40c00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.674 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.660+0000 7fa41dcf5700 1 -- 172.21.15.158:0/1054136767 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa40c0088b0 con 0x7fa41809a320 2019-12-05T03:50:44.674 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.660+0000 7fa41e4f6700 1 --2- 172.21.15.158:0/1054136767 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa41809a320 0x7fa41805a740 secure :-1 s=THROTTLE_DONE pgs=322 cs=0 l=1 rx=0x7fa40c008790 tx=0x7fa40c00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.674 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.660+0000 7fa42075a700 1 -- 172.21.15.158:0/1054136767 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa41809a320 msgr2=0x7fa41805a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:44.674 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.660+0000 7fa41dcf5700 1 -- 172.21.15.158:0/1054136767 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa40c011ad0 con 0x7fa41809a320 2019-12-05T03:50:44.674 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.660+0000 7fa42075a700 1 --2- 172.21.15.158:0/1054136767 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa41809a320 0x7fa41805a740 secure :-1 s=READY pgs=322 cs=0 l=1 rx=0x7fa40c008790 tx=0x7fa40c00fd30).stop 2019-12-05T03:50:44.675 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.660+0000 7fa42075a700 1 -- 172.21.15.158:0/1054136767 shutdown_connections 2019-12-05T03:50:44.675 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.660+0000 7fa42075a700 1 --2- 172.21.15.158:0/1054136767 >> v2:172.21.15.96:3300/0 conn(0x7fa4181553b0 0x7fa4181557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:44.675 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.660+0000 7fa42075a700 1 --2- 172.21.15.158:0/1054136767 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa41809a320 0x7fa41805a740 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:44.675 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.660+0000 7fa42075a700 1 -- 172.21.15.158:0/1054136767 shutdown_connections 2019-12-05T03:50:44.675 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.660+0000 7fa42075a700 1 -- 172.21.15.158:0/1054136767 wait complete. 2019-12-05T03:50:44.675 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.660+0000 7fa42075a700 1 -- 172.21.15.158:0/1054136767 >> 172.21.15.158:0/1054136767 conn(0x7fa4180b7e60 msgr2=0x7fa4180b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:44.680 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.664+0000 7fa42075a700 1 Processor -- start 2019-12-05T03:50:44.680 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.664+0000 7fa42075a700 1 -- start start 2019-12-05T03:50:44.680 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.664+0000 7fa42075a700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa41813fe60 0x7fa41809aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:44.680 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.664+0000 7fa42075a700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa41807b7c0 con 0x7fa4180af960 2019-12-05T03:50:44.681 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.664+0000 7fa42075a700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa41809b030 con 0x7fa418065260 2019-12-05T03:50:44.681 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.664+0000 7fa42075a700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4180b0de0 con 0x7fa41813fe60 2019-12-05T03:50:44.681 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.664+0000 7fa41e4f6700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fa418065260 0x7fa41813be90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49672/0 (socket says 172.21.15.158:49672) 2019-12-05T03:50:44.681 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.664+0000 7fa41e4f6700 1 -- 172.21.15.158:0/3578175419 learned_addr learned my addr 172.21.15.158:0/3578175419 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:44.681 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.664+0000 7fa41f4f8700 1 --2- 172.21.15.158:0/3578175419 >> v2:172.21.15.96:3300/0 conn(0x7fa41813fe60 0x7fa41809aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:44.682 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.668+0000 7fa4177fe700 1 -- 172.21.15.158:0/3578175419 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 104435916 0 0) 0x7fa41809b030 con 0x7fa418065260 2019-12-05T03:50:44.682 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.668+0000 7fa4177fe700 1 -- 172.21.15.158:0/3578175419 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3f80030b0 con 0x7fa418065260 2019-12-05T03:50:44.682 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.668+0000 7fa4177fe700 1 -- 172.21.15.158:0/3578175419 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 507599805 0 0) 0x7fa41807b7c0 con 0x7fa4180af960 2019-12-05T03:50:44.682 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.668+0000 7fa41f4f8700 1 -- 172.21.15.158:0/3578175419 >> v1:172.21.15.158:6789/0 conn(0x7fa418065260 legacy=0x7fa41813be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:44.682 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.668+0000 7fa41f4f8700 1 -- 172.21.15.158:0/3578175419 >> v1:172.21.15.96:6789/0 conn(0x7fa4180af960 legacy=0x7fa41807afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:44.682 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.668+0000 7fa41f4f8700 1 -- 172.21.15.158:0/3578175419 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa41813c690 con 0x7fa41813fe60 2019-12-05T03:50:44.683 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.668+0000 7fa41f4f8700 1 --2- 172.21.15.158:0/3578175419 >> v2:172.21.15.96:3300/0 conn(0x7fa41813fe60 0x7fa41809aae0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa4180b1b20 tx=0x7fa408010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.683 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.668+0000 7fa41f4f8700 1 --2- 172.21.15.158:0/3578175419 >> v2:172.21.15.96:3300/0 conn(0x7fa41813fe60 0x7fa41809aae0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa4180b1b20 tx=0x7fa408010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.683 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.668+0000 7fa41f4f8700 1 --2- 172.21.15.158:0/3578175419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa41813fe60 0x7fa41809aae0 secure :-1 s=READY pgs=233 cs=0 l=1 rx=0x7fa4180b1b20 tx=0x7fa408010a20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:44.683 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.668+0000 7fa41f4f8700 1 --2- 172.21.15.158:0/3578175419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa41813fe60 0x7fa41809aae0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7fa4180b1b20 tx=0x7fa408010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.683 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.668+0000 7fa4177fe700 1 -- 172.21.15.158:0/3578175419 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa40800a160 con 0x7fa41813fe60 2019-12-05T03:50:44.684 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.668+0000 7fa41f4f8700 1 --2- 172.21.15.158:0/3578175419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa41813fe60 0x7fa41809aae0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7fa4180b1b20 tx=0x7fa408010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.684 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.668+0000 7fa41f4f8700 1 --2- 172.21.15.158:0/3578175419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa41813fe60 0x7fa41809aae0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7fa4180b1b20 tx=0x7fa408010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.684 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.668+0000 7fa4177fe700 1 -- 172.21.15.158:0/3578175419 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa408008be0 con 0x7fa41813fe60 2019-12-05T03:50:44.684 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.668+0000 7fa42075a700 1 -- 172.21.15.158:0/3578175419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa41813c960 con 0x7fa41813fe60 2019-12-05T03:50:44.684 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.668+0000 7fa4177fe700 1 -- 172.21.15.158:0/3578175419 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa40800a740 con 0x7fa41813fe60 2019-12-05T03:50:44.684 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.668+0000 7fa42075a700 1 -- 172.21.15.158:0/3578175419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa41813ce30 con 0x7fa41813fe60 2019-12-05T03:50:44.685 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.668+0000 7fa41f4f8700 1 --2- 172.21.15.158:0/3578175419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa41813fe60 0x7fa41809aae0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7fa4180b1b20 tx=0x7fa408010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.685 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.668+0000 7fa4177fe700 1 -- 172.21.15.158:0/3578175419 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fa40800a9e0 con 0x7fa41813fe60 2019-12-05T03:50:44.685 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.668+0000 7fa41f4f8700 1 --2- 172.21.15.158:0/3578175419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa41813fe60 0x7fa41809aae0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7fa4180b1b20 tx=0x7fa408010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.685 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.668+0000 7fa4177fe700 1 --2- 172.21.15.158:0/3578175419 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa3f803b1e0 0x7fa3f803d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:44.685 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.668+0000 7fa4177fe700 1 -- 172.21.15.158:0/3578175419 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fa40804b0b0 con 0x7fa41813fe60 2019-12-05T03:50:44.685 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.668+0000 7fa41ecf7700 1 --2- 172.21.15.158:0/3578175419 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa3f803b1e0 0x7fa3f803d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:44.686 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.672+0000 7fa41ecf7700 1 --2- 172.21.15.158:0/3578175419 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa3f803b1e0 0x7fa3f803d6f0 crc :-1 s=READY pgs=149 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:44.686 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.672+0000 7fa42075a700 1 -- 172.21.15.158:0/3578175419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4180554e0 con 0x7fa41813fe60 2019-12-05T03:50:44.690 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.684+0000 7fa41f4f8700 1 --2- 172.21.15.158:0/3578175419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa41813fe60 0x7fa41809aae0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7fa4180b1b20 tx=0x7fa408010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.690 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.684+0000 7fa4177fe700 1 -- 172.21.15.158:0/3578175419 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fa408032110 con 0x7fa41813fe60 2019-12-05T03:50:44.858 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.852+0000 7fa42075a700 1 -- 172.21.15.158:0/3578175419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa418066940 con 0x7fa41813fe60 2019-12-05T03:50:44.860 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.852+0000 7fa41f4f8700 1 --2- 172.21.15.158:0/3578175419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa41813fe60 0x7fa41809aae0 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7fa4180b1b20 tx=0x7fa408010a20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.860 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.852+0000 7fa4177fe700 1 -- 172.21.15.158:0/3578175419 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+14918 (secure 0 0 0) 0x7fa408032370 con 0x7fa41813fe60 2019-12-05T03:50:44.861 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:44.862 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":31,"fsid":"a91186ae-f496-4de1-918d-820c55ff1feb","created":"2019-12-05T03:49:39.187523+0000","modified":"2019-12-05T03:50:44.548726+0000","last_up_change":"2019-12-05T03:49:48.551934+0000","last_in_change":"2019-12-05T03:49:48.551934+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-05T03:49:52.900870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2019-12-05T03:50:42.436744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2019-12-05T03:50:43.620710+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"782c4258-e28c-4a11-9d54-3c9c7a36fba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":12192},{"type":"v1","addr":"172.21.15.158:6801","nonce":12192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":12192},{"type":"v1","addr":"172.21.15.158:6803","nonce":12192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":12192},{"type":"v1","addr":"172.21.15.158:6807","nonce":12192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":12192},{"type":"v1","addr":"172.21.15.158:6805","nonce":12192}]},"public_addr":"172.21.15.158:6801/12192","cluster_addr":"172.21.15.158:6803/12192","heartbeat_back_addr":"172.21.15.158:6807/12192","heartbeat_front_addr":"172.21.15.158:6805/12192","state":["exists","up"]},{"osd":1,"uuid":"d4426b21-b666-4158-bf34-a24b14572731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":12193},{"type":"v1","addr":"172.21.15.158:6809","nonce":12193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":12193},{"type":"v1","addr":"172.21.15.158:6811","nonce":12193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":12193},{"type":"v1","addr":"172.21.15.158:6815","nonce":12193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":12193},{"type":"v1","addr":"172.21.15.158:6813","nonce":12193}]},"public_addr":"172.21.15.158:6809/12193","cluster_addr":"172.21.15.158:6811/12193","heartbeat_back_addr":"172.21.15.158:6815/12193","heartbeat_front_addr":"172.21.15.158:6813/12193","state":["exists","up"]},{"osd":2,"uuid":"22680edd-6490-4ab0-bb15-0605830e4cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":12195},{"type":"v1","addr":"172.21.15.158:6825","nonce":12195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":12195},{"type":"v1","addr":"172.21.15.158:6827","nonce":12195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":12195},{"type":"v1","addr":"172.21.15.158:6831","nonce":12195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":12195},{"type":"v1","addr":"172.21.15.158:6829","nonce":12195}]},"public_addr":"172.21.15.158:6825/12195","cluster_addr":"172.21.15.158:6827/12195","heartbeat_back_addr":"172.21.15.158:6831/12195","heartbeat_front_addr":"172.21.15.158:6829/12195","state":["exists","up"]},{"osd":3,"uuid":"7ec999ee-ace8-4ccb-a4f9-6f5d313bbbd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":12194},{"type":"v1","addr":"172.21.15.158:6817","nonce":12194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":12194},{"type":"v1","addr":"172.21.15.158:6819","nonce":12194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":12194},{"type":"v1","addr":"172.21.15.158:6823","nonce":12194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":12194},{"type":"v1","addr":"172.21.15.158:6821","nonce":12194}]},"public_addr":"172.21.15.158:6817/12194","cluster_addr":"172.21.15.158:6819/12194","heartbeat_back_addr":"172.21.15.158:6823/12194","heartbeat_front_addr":"172.21.15.158:6821/12194","state":["exists","up"]},{"osd":4,"uuid":"186e69c4-b69f-4dd1-bb8f-faf759c60484","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":12460},{"type":"v1","addr":"172.21.15.96:6803","nonce":12460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":12460},{"type":"v1","addr":"172.21.15.96:6805","nonce":12460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":12460},{"type":"v1","addr":"172.21.15.96:6809","nonce":12460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":12460},{"type":"v1","addr":"172.21.15.96:6807","nonce":12460}]},"public_addr":"172.21.15.96:6803/12460","cluster_addr":"172.21.15.96:6805/12460","heartbeat_back_addr":"172.21.15.96:6809/12460","heartbeat_front_addr":"172.21.15.96:6807/12460","state":["exists","up"]},{"osd":5,"uuid":"86b658b2-8b40-4cea-8163-305a3982758b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":12461},{"type":"v1","addr":"172.21.15.96:6811","nonce":12461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":12461},{"type":"v1","addr":"172.21.15.96:6813","nonce":12461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":12461},{"type":"v1","addr":"172.21.15.96:6817","nonce":12461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":12461},{"type":"v1","addr":"172.21.15.96:6815","nonce":12461}]},"public_addr":"172.21.15.96:6811/12461","cluster_addr":"172.21.15.96:6813/12461","heartbeat_back_addr":"172.21.15.96:6817/12461","heartbeat_front_addr":"172.21.15.96:6815/12461","state":["exists","up"]},{"osd":6,"uuid":"bdadaea8-9296-4788-bc59-d9c9eb8defdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":12463},{"type":"v1","addr":"172.21.15.96:6827","nonce":12463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":12463},{"type":"v1","addr":"172.21.15.96:6829","nonce":12463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":12463},{"type":"v1","addr":"172.21.15.96:6833","nonce":12463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":12463},{"type":"v1","addr":"172.21.15.96:6831","nonce":12463}]},"public_addr":"172.21.15.96:6827/12463","cluster_addr":"172.21.15.96:6829/12463","heartbeat_back_addr":"172.21.15.96:6833/12463","heartbeat_front_addr":"172.21.15.96:6831/12463","state":["exists","up"]},{"osd":7,"uuid":"c6d71846-d68e-430f-ab72-0fb8ea4bf640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":12462},{"type":"v1","addr":"172.21.15.96:6819","nonce":12462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":12462},{"type":"v1","addr":"172.21.15.96:6821","nonce":12462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":12462},{"type":"v1","addr":"172.21.15.96:6825","nonce":12462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":12462},{"type":"v1","addr":"172.21.15.96:6823","nonce":12462}]},"public_addr":"172.21.15.96:6819/12462","cluster_addr":"172.21.15.96:6821/12462","heartbeat_back_addr":"172.21.15.96:6825/12462","heartbeat_front_addr":"172.21.15.96:6823/12462","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.875762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.900817+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.210347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.133973+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.864697+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.131015+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.237225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.154377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-05T03:50:44.866 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.860+0000 7fa42075a700 1 -- 172.21.15.158:0/3578175419 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa3f803b1e0 msgr2=0x7fa3f803d6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:44.867 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.860+0000 7fa42075a700 1 --2- 172.21.15.158:0/3578175419 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa3f803b1e0 0x7fa3f803d6f0 crc :-1 s=READY pgs=149 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:44.867 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.860+0000 7fa42075a700 1 -- 172.21.15.158:0/3578175419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa41813fe60 msgr2=0x7fa41809aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:44.867 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.860+0000 7fa42075a700 1 --2- 172.21.15.158:0/3578175419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa41813fe60 0x7fa41809aae0 secure :-1 s=READY pgs=233 cs=0 l=1 rx=0x7fa4180b1b20 tx=0x7fa408010a20).stop 2019-12-05T03:50:44.867 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.860+0000 7fa42075a700 1 -- 172.21.15.158:0/3578175419 shutdown_connections 2019-12-05T03:50:44.867 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.860+0000 7fa42075a700 1 --2- 172.21.15.158:0/3578175419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa41813fe60 0x7fa41809aae0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:44.868 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.860+0000 7fa42075a700 1 --2- 172.21.15.158:0/3578175419 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa3f803b1e0 0x7fa3f803d6f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:44.868 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.860+0000 7fa42075a700 1 -- 172.21.15.158:0/3578175419 shutdown_connections 2019-12-05T03:50:44.868 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.860+0000 7fa42075a700 1 -- 172.21.15.158:0/3578175419 wait complete. 2019-12-05T03:50:44.868 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.860+0000 7fa42075a700 1 -- 172.21.15.158:0/3578175419 >> 172.21.15.158:0/3578175419 conn(0x7fa41809a320 msgr2=0x7fa4181555c0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:44.876 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-05T03:50:44.966 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.956+0000 7f20c8876700 1 Processor -- start 2019-12-05T03:50:44.967 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.956+0000 7f20c8876700 1 -- start start 2019-12-05T03:50:44.967 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.956+0000 7f20c8876700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f20c409cf60 0x7f20c409a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:44.967 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.956+0000 7f20c8876700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f20c41553b0 0x7f20c41557e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:44.967 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.956+0000 7f20c8876700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20c40accb0 con 0x7f20c405a740 2019-12-05T03:50:44.967 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.956+0000 7f20c8876700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20c40b1730 con 0x7f20c41553b0 2019-12-05T03:50:44.968 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.956+0000 7f20c8876700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c40b19d0 con 0x7f20c409cf60 2019-12-05T03:50:44.968 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.956+0000 7f20c359e700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f20c41553b0 0x7f20c41557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:44.968 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.956+0000 7f20c359e700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f20c41553b0 0x7f20c41557e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.158:41492/0 (socket says 172.21.15.158:41492) 2019-12-05T03:50:44.968 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.956+0000 7f20c2d9d700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f20c409cf60 0x7f20c409a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:44.969 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.956+0000 7f20c359e700 1 -- 172.21.15.158:0/3937359349 learned_addr learned my addr 172.21.15.158:0/3937359349 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:44.969 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.956+0000 7f20c359e700 1 -- 172.21.15.158:0/3937359349 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f20c409cf60 msgr2=0x7f20c409a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:44.969 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.956+0000 7f20c359e700 1 --2- 172.21.15.158:0/3937359349 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f20c409cf60 0x7f20c409a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:44.969 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.956+0000 7f20c359e700 1 -- 172.21.15.158:0/3937359349 >> v1:172.21.15.96:6789/0 conn(0x7f20c405a740 legacy=0x7f20c4151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:44.969 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.956+0000 7f20c359e700 1 -- 172.21.15.158:0/3937359349 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c405ab70 con 0x7f20c41553b0 2019-12-05T03:50:44.970 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.956+0000 7f20c359e700 1 --2- 172.21.15.158:0/3937359349 >> v2:172.21.15.96:3300/0 conn(0x7f20c41553b0 0x7f20c41557e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f20c40b18f0 tx=0x7f20bc00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.970 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.956+0000 7f20c359e700 1 --2- 172.21.15.158:0/3937359349 >> v2:172.21.15.96:3300/0 conn(0x7f20c41553b0 0x7f20c41557e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f20c40b18f0 tx=0x7f20bc00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.970 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.956+0000 7f20c359e700 1 --2- 172.21.15.158:0/3937359349 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20c41553b0 0x7f20c41557e0 secure :-1 s=READY pgs=235 cs=0 l=1 rx=0x7f20c40b18f0 tx=0x7f20bc00fd30).ready entity=mon.0 client_cookie=3b2e0dc12c5abe70 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:44.970 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.956+0000 7f20c359e700 1 --2- 172.21.15.158:0/3937359349 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20c41553b0 0x7f20c41557e0 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f20c40b18f0 tx=0x7f20bc00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.970 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.956+0000 7f20c1d9b700 1 -- 172.21.15.158:0/3937359349 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20bc0113b0 con 0x7f20c41553b0 2019-12-05T03:50:44.970 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.956+0000 7f20c359e700 1 --2- 172.21.15.158:0/3937359349 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20c41553b0 0x7f20c41557e0 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f20c40b18f0 tx=0x7f20bc00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.971 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.956+0000 7f20c1d9b700 1 -- 172.21.15.158:0/3937359349 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20bc008bb0 con 0x7f20c41553b0 2019-12-05T03:50:44.971 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.956+0000 7f20c359e700 1 --2- 172.21.15.158:0/3937359349 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20c41553b0 0x7f20c41557e0 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f20c40b18f0 tx=0x7f20bc00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.971 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.956+0000 7f20c8876700 1 -- 172.21.15.158:0/3937359349 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20c41553b0 msgr2=0x7f20c41557e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:44.971 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.956+0000 7f20c1d9b700 1 -- 172.21.15.158:0/3937359349 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20bc011990 con 0x7f20c41553b0 2019-12-05T03:50:44.972 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.956+0000 7f20c8876700 1 --2- 172.21.15.158:0/3937359349 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20c41553b0 0x7f20c41557e0 secure :-1 s=READY pgs=235 cs=0 l=1 rx=0x7f20c40b18f0 tx=0x7f20bc00fd30).stop 2019-12-05T03:50:44.972 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.960+0000 7f20c8876700 1 -- 172.21.15.158:0/3937359349 shutdown_connections 2019-12-05T03:50:44.972 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.960+0000 7f20c8876700 1 --2- 172.21.15.158:0/3937359349 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20c41553b0 0x7f20c41557e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:44.972 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.960+0000 7f20c8876700 1 --2- 172.21.15.158:0/3937359349 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f20c409cf60 0x7f20c409a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:44.972 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.960+0000 7f20c8876700 1 -- 172.21.15.158:0/3937359349 shutdown_connections 2019-12-05T03:50:44.972 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.960+0000 7f20c8876700 1 -- 172.21.15.158:0/3937359349 wait complete. 2019-12-05T03:50:44.973 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.960+0000 7f20c8876700 1 -- 172.21.15.158:0/3937359349 >> 172.21.15.158:0/3937359349 conn(0x7f20c40b7e60 msgr2=0x7f20c40b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:44.976 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.960+0000 7f20c8876700 1 Processor -- start 2019-12-05T03:50:44.976 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.960+0000 7f20c8876700 1 -- start start 2019-12-05T03:50:44.977 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.960+0000 7f20c8876700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f20c412f7e0 0x7f20c412ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:44.977 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.960+0000 7f20c8876700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f20c4064460 0x7f20c413c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:44.977 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.960+0000 7f20c8876700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20c407bf50 con 0x7f20c412a3f0 2019-12-05T03:50:44.977 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.960+0000 7f20c8876700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20c4064d60 con 0x7f20c412f7e0 2019-12-05T03:50:44.978 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.960+0000 7f20c8876700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c4065000 con 0x7f20c4064460 2019-12-05T03:50:44.978 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.960+0000 7f20c2d9d700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f20c412a3f0 0x7f20c407b750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49686/0 (socket says 172.21.15.158:49686) 2019-12-05T03:50:44.979 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.960+0000 7f20c2d9d700 1 -- 172.21.15.158:0/722276897 learned_addr learned my addr 172.21.15.158:0/722276897 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:44.979 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.960+0000 7f20c359e700 1 --2- 172.21.15.158:0/722276897 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f20c4064460 0x7f20c413c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:44.980 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.960+0000 7f20c259c700 1 --2- 172.21.15.158:0/722276897 >> v2:172.21.15.96:3300/0 conn(0x7f20c412f7e0 0x7f20c412ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:44.980 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.960+0000 7f20b37fe700 1 -- 172.21.15.158:0/722276897 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 67397636 0 0) 0x7f20c407bf50 con 0x7f20c412a3f0 2019-12-05T03:50:44.980 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.964+0000 7f20b37fe700 1 -- 172.21.15.158:0/722276897 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20a80030b0 con 0x7f20c412a3f0 2019-12-05T03:50:44.980 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.964+0000 7f20c359e700 1 -- 172.21.15.158:0/722276897 >> v2:172.21.15.96:3300/0 conn(0x7f20c412f7e0 msgr2=0x7f20c412ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:44.981 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.964+0000 7f20c359e700 1 --2- 172.21.15.158:0/722276897 >> v2:172.21.15.96:3300/0 conn(0x7f20c412f7e0 0x7f20c412ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:44.981 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.964+0000 7f20c359e700 1 -- 172.21.15.158:0/722276897 >> v1:172.21.15.158:6789/0 conn(0x7f20c412a3f0 legacy=0x7f20c407b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:44.981 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.964+0000 7f20c359e700 1 -- 172.21.15.158:0/722276897 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c4064890 con 0x7f20c4064460 2019-12-05T03:50:44.981 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.964+0000 7f20c359e700 1 --2- 172.21.15.158:0/722276897 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f20c4064460 0x7f20c413c000 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f20c40b18f0 tx=0x7f20bc011f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.981 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.964+0000 7f20c359e700 1 --2- 172.21.15.158:0/722276897 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f20c4064460 0x7f20c413c000 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f20c40b18f0 tx=0x7f20bc011f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.982 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.964+0000 7f20c359e700 1 --2- 172.21.15.158:0/722276897 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f20c4064460 0x7f20c413c000 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f20c40b18f0 tx=0x7f20bc011f60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:44.982 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.964+0000 7f20c359e700 1 --2- 172.21.15.158:0/722276897 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f20c4064460 0x7f20c413c000 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f20c40b18f0 tx=0x7f20bc011f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.982 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.964+0000 7f20b37fe700 1 -- 172.21.15.158:0/722276897 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20bc007340 con 0x7f20c4064460 2019-12-05T03:50:44.982 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.964+0000 7f20c359e700 1 --2- 172.21.15.158:0/722276897 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f20c4064460 0x7f20c413c000 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f20c40b18f0 tx=0x7f20bc011f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.982 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.964+0000 7f20c8876700 1 -- 172.21.15.158:0/722276897 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20c413c550 con 0x7f20c4064460 2019-12-05T03:50:44.982 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.964+0000 7f20b37fe700 1 -- 172.21.15.158:0/722276897 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20bc0115b0 con 0x7f20c4064460 2019-12-05T03:50:44.983 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.964+0000 7f20c359e700 1 --2- 172.21.15.158:0/722276897 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f20c4064460 0x7f20c413c000 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f20c40b18f0 tx=0x7f20bc011f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.983 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.964+0000 7f20b37fe700 1 -- 172.21.15.158:0/722276897 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20bc005540 con 0x7f20c4064460 2019-12-05T03:50:44.983 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.964+0000 7f20c8876700 1 -- 172.21.15.158:0/722276897 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20c413ca50 con 0x7f20c4064460 2019-12-05T03:50:44.983 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.964+0000 7f20c359e700 1 --2- 172.21.15.158:0/722276897 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f20c4064460 0x7f20c413c000 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f20c40b18f0 tx=0x7f20bc011f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.983 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.964+0000 7f20b37fe700 1 -- 172.21.15.158:0/722276897 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f20bc005790 con 0x7f20c4064460 2019-12-05T03:50:44.984 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.964+0000 7f20c359e700 1 --2- 172.21.15.158:0/722276897 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f20c4064460 0x7f20c413c000 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f20c40b18f0 tx=0x7f20bc011f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.984 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.964+0000 7f20b37fe700 1 --2- 172.21.15.158:0/722276897 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f20a803b280 0x7f20a803d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:44.984 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.964+0000 7f20b37fe700 1 -- 172.21.15.158:0/722276897 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f20bc04b280 con 0x7f20c4064460 2019-12-05T03:50:44.984 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.964+0000 7f20c2d9d700 1 --2- 172.21.15.158:0/722276897 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f20a803b280 0x7f20a803d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:44.984 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.964+0000 7f20c2d9d700 1 --2- 172.21.15.158:0/722276897 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f20a803b280 0x7f20a803d790 crc :-1 s=READY pgs=150 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:44.985 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.972+0000 7f20c8876700 1 -- 172.21.15.158:0/722276897 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20c40554e0 con 0x7f20c4064460 2019-12-05T03:50:44.988 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.980+0000 7f20c359e700 1 --2- 172.21.15.158:0/722276897 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f20c4064460 0x7f20c413c000 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f20c40b18f0 tx=0x7f20bc011f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:44.988 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:44.980+0000 7f20b37fe700 1 -- 172.21.15.158:0/722276897 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f20bc0322e0 con 0x7f20c4064460 2019-12-05T03:50:45.157 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.148+0000 7f20c8876700 1 -- 172.21.15.158:0/722276897 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20c4066940 con 0x7f20c4064460 2019-12-05T03:50:45.159 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.152+0000 7f20c359e700 1 --2- 172.21.15.158:0/722276897 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f20c4064460 0x7f20c413c000 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f20c40b18f0 tx=0x7f20bc011f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:45.159 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.152+0000 7f20b37fe700 1 -- 172.21.15.158:0/722276897 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+14918 (secure 0 0 0) 0x7f20bc02ff00 con 0x7f20c4064460 2019-12-05T03:50:45.160 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:45.161 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":31,"fsid":"a91186ae-f496-4de1-918d-820c55ff1feb","created":"2019-12-05T03:49:39.187523+0000","modified":"2019-12-05T03:50:44.548726+0000","last_up_change":"2019-12-05T03:49:48.551934+0000","last_in_change":"2019-12-05T03:49:48.551934+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-05T03:49:52.900870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2019-12-05T03:50:42.436744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2019-12-05T03:50:43.620710+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"782c4258-e28c-4a11-9d54-3c9c7a36fba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":12192},{"type":"v1","addr":"172.21.15.158:6801","nonce":12192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":12192},{"type":"v1","addr":"172.21.15.158:6803","nonce":12192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":12192},{"type":"v1","addr":"172.21.15.158:6807","nonce":12192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":12192},{"type":"v1","addr":"172.21.15.158:6805","nonce":12192}]},"public_addr":"172.21.15.158:6801/12192","cluster_addr":"172.21.15.158:6803/12192","heartbeat_back_addr":"172.21.15.158:6807/12192","heartbeat_front_addr":"172.21.15.158:6805/12192","state":["exists","up"]},{"osd":1,"uuid":"d4426b21-b666-4158-bf34-a24b14572731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":12193},{"type":"v1","addr":"172.21.15.158:6809","nonce":12193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":12193},{"type":"v1","addr":"172.21.15.158:6811","nonce":12193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":12193},{"type":"v1","addr":"172.21.15.158:6815","nonce":12193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":12193},{"type":"v1","addr":"172.21.15.158:6813","nonce":12193}]},"public_addr":"172.21.15.158:6809/12193","cluster_addr":"172.21.15.158:6811/12193","heartbeat_back_addr":"172.21.15.158:6815/12193","heartbeat_front_addr":"172.21.15.158:6813/12193","state":["exists","up"]},{"osd":2,"uuid":"22680edd-6490-4ab0-bb15-0605830e4cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":12195},{"type":"v1","addr":"172.21.15.158:6825","nonce":12195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":12195},{"type":"v1","addr":"172.21.15.158:6827","nonce":12195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":12195},{"type":"v1","addr":"172.21.15.158:6831","nonce":12195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":12195},{"type":"v1","addr":"172.21.15.158:6829","nonce":12195}]},"public_addr":"172.21.15.158:6825/12195","cluster_addr":"172.21.15.158:6827/12195","heartbeat_back_addr":"172.21.15.158:6831/12195","heartbeat_front_addr":"172.21.15.158:6829/12195","state":["exists","up"]},{"osd":3,"uuid":"7ec999ee-ace8-4ccb-a4f9-6f5d313bbbd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":12194},{"type":"v1","addr":"172.21.15.158:6817","nonce":12194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":12194},{"type":"v1","addr":"172.21.15.158:6819","nonce":12194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":12194},{"type":"v1","addr":"172.21.15.158:6823","nonce":12194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":12194},{"type":"v1","addr":"172.21.15.158:6821","nonce":12194}]},"public_addr":"172.21.15.158:6817/12194","cluster_addr":"172.21.15.158:6819/12194","heartbeat_back_addr":"172.21.15.158:6823/12194","heartbeat_front_addr":"172.21.15.158:6821/12194","state":["exists","up"]},{"osd":4,"uuid":"186e69c4-b69f-4dd1-bb8f-faf759c60484","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":12460},{"type":"v1","addr":"172.21.15.96:6803","nonce":12460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":12460},{"type":"v1","addr":"172.21.15.96:6805","nonce":12460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":12460},{"type":"v1","addr":"172.21.15.96:6809","nonce":12460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":12460},{"type":"v1","addr":"172.21.15.96:6807","nonce":12460}]},"public_addr":"172.21.15.96:6803/12460","cluster_addr":"172.21.15.96:6805/12460","heartbeat_back_addr":"172.21.15.96:6809/12460","heartbeat_front_addr":"172.21.15.96:6807/12460","state":["exists","up"]},{"osd":5,"uuid":"86b658b2-8b40-4cea-8163-305a3982758b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":12461},{"type":"v1","addr":"172.21.15.96:6811","nonce":12461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":12461},{"type":"v1","addr":"172.21.15.96:6813","nonce":12461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":12461},{"type":"v1","addr":"172.21.15.96:6817","nonce":12461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":12461},{"type":"v1","addr":"172.21.15.96:6815","nonce":12461}]},"public_addr":"172.21.15.96:6811/12461","cluster_addr":"172.21.15.96:6813/12461","heartbeat_back_addr":"172.21.15.96:6817/12461","heartbeat_front_addr":"172.21.15.96:6815/12461","state":["exists","up"]},{"osd":6,"uuid":"bdadaea8-9296-4788-bc59-d9c9eb8defdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":12463},{"type":"v1","addr":"172.21.15.96:6827","nonce":12463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":12463},{"type":"v1","addr":"172.21.15.96:6829","nonce":12463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":12463},{"type":"v1","addr":"172.21.15.96:6833","nonce":12463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":12463},{"type":"v1","addr":"172.21.15.96:6831","nonce":12463}]},"public_addr":"172.21.15.96:6827/12463","cluster_addr":"172.21.15.96:6829/12463","heartbeat_back_addr":"172.21.15.96:6833/12463","heartbeat_front_addr":"172.21.15.96:6831/12463","state":["exists","up"]},{"osd":7,"uuid":"c6d71846-d68e-430f-ab72-0fb8ea4bf640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":12462},{"type":"v1","addr":"172.21.15.96:6819","nonce":12462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":12462},{"type":"v1","addr":"172.21.15.96:6821","nonce":12462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":12462},{"type":"v1","addr":"172.21.15.96:6825","nonce":12462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":12462},{"type":"v1","addr":"172.21.15.96:6823","nonce":12462}]},"public_addr":"172.21.15.96:6819/12462","cluster_addr":"172.21.15.96:6821/12462","heartbeat_back_addr":"172.21.15.96:6825/12462","heartbeat_front_addr":"172.21.15.96:6823/12462","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.875762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.900817+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.210347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.133973+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.864697+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.131015+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.237225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.154377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-05T03:50:45.165 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.156+0000 7f20c8876700 1 -- 172.21.15.158:0/722276897 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f20a803b280 msgr2=0x7f20a803d790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:45.165 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.156+0000 7f20c8876700 1 --2- 172.21.15.158:0/722276897 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f20a803b280 0x7f20a803d790 crc :-1 s=READY pgs=150 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:45.166 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.156+0000 7f20c8876700 1 -- 172.21.15.158:0/722276897 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f20c4064460 msgr2=0x7f20c413c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:45.166 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.156+0000 7f20c8876700 1 --2- 172.21.15.158:0/722276897 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f20c4064460 0x7f20c413c000 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f20c40b18f0 tx=0x7f20bc011f60).stop 2019-12-05T03:50:45.166 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.156+0000 7f20c8876700 1 -- 172.21.15.158:0/722276897 shutdown_connections 2019-12-05T03:50:45.166 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.156+0000 7f20c8876700 1 --2- 172.21.15.158:0/722276897 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f20a803b280 0x7f20a803d790 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:45.166 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.156+0000 7f20c8876700 1 --2- 172.21.15.158:0/722276897 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f20c4064460 0x7f20c413c000 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:45.166 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.156+0000 7f20c8876700 1 --2- 172.21.15.158:0/722276897 >> v2:172.21.15.96:3300/0 conn(0x7f20c412f7e0 0x7f20c412ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:45.167 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.156+0000 7f20c8876700 1 -- 172.21.15.158:0/722276897 shutdown_connections 2019-12-05T03:50:45.167 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.156+0000 7f20c8876700 1 -- 172.21.15.158:0/722276897 wait complete. 2019-12-05T03:50:45.168 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.156+0000 7f20c8876700 1 -- 172.21.15.158:0/722276897 >> 172.21.15.158:0/722276897 conn(0x7f20c40ac820 msgr2=0x7f20c412e090 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:45.174 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2019-12-05T03:50:45.287 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.272+0000 7f5124dd6700 1 Processor -- start 2019-12-05T03:50:45.287 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.272+0000 7f5124dd6700 1 -- start start 2019-12-05T03:50:45.288 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.276+0000 7f5124dd6700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f512009ba40 0x7f512009add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:45.288 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.276+0000 7f5124dd6700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f51200b5370 0x7f51200b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:45.288 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.276+0000 7f5124dd6700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5120099e30 con 0x7f51200b6970 2019-12-05T03:50:45.288 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.276+0000 7f5124dd6700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f512009d210 con 0x7f51200b5370 2019-12-05T03:50:45.288 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.276+0000 7f5124dd6700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5120099b90 con 0x7f512009ba40 2019-12-05T03:50:45.289 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.276+0000 7f511ed9d700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f51200b6970 0x7f512005a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49694/0 (socket says 172.21.15.158:49694) 2019-12-05T03:50:45.289 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.276+0000 7f511ed9d700 1 -- 172.21.15.158:0/573356171 learned_addr learned my addr 172.21.15.158:0/573356171 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:45.289 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.276+0000 7f511f59e700 1 --2- 172.21.15.158:0/573356171 >> v2:172.21.15.158:3300/0 conn(0x7f51200b5370 0x7f51200b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:45.289 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.276+0000 7f511e59c700 1 --2- 172.21.15.158:0/573356171 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f512009ba40 0x7f512009add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:45.289 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.276+0000 7f511dd9b700 1 -- 172.21.15.158:0/573356171 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3614905622 0 0) 0x7f5120099e30 con 0x7f51200b6970 2019-12-05T03:50:45.290 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.276+0000 7f511dd9b700 1 -- 172.21.15.158:0/573356171 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f510c0030b0 con 0x7f51200b6970 2019-12-05T03:50:45.290 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.276+0000 7f511e59c700 1 -- 172.21.15.158:0/573356171 >> v2:172.21.15.158:3300/0 conn(0x7f51200b5370 msgr2=0x7f51200b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:45.290 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.276+0000 7f511e59c700 1 --2- 172.21.15.158:0/573356171 >> v2:172.21.15.158:3300/0 conn(0x7f51200b5370 0x7f51200b57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:45.290 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.276+0000 7f511e59c700 1 -- 172.21.15.158:0/573356171 >> v1:172.21.15.158:6789/0 conn(0x7f51200b6970 legacy=0x7f512005a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:45.290 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.276+0000 7f511dd9b700 1 -- 172.21.15.158:0/573356171 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1645723953 0 0) 0x7f510c0030b0 con 0x7f51200b6970 2019-12-05T03:50:45.290 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.276+0000 7f511e59c700 1 -- 172.21.15.158:0/573356171 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f512007e960 con 0x7f512009ba40 2019-12-05T03:50:45.291 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.276+0000 7f511e59c700 1 --2- 172.21.15.158:0/573356171 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f512009ba40 0x7f512009add0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5108008790 tx=0x7f510800fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:45.291 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.276+0000 7f511e59c700 1 --2- 172.21.15.158:0/573356171 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f512009ba40 0x7f512009add0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5108008790 tx=0x7f510800fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:45.291 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.276+0000 7f511e59c700 1 --2- 172.21.15.158:0/573356171 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f512009ba40 0x7f512009add0 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7f5108008790 tx=0x7f510800fc70).ready entity=mon.2 client_cookie=b97ed98187fc37b server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:45.291 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.276+0000 7f511e59c700 1 --2- 172.21.15.158:0/573356171 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f512009ba40 0x7f512009add0 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f5108008790 tx=0x7f510800fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:45.291 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.276+0000 7f511dd9b700 1 -- 172.21.15.158:0/573356171 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5108008bb0 con 0x7f512009ba40 2019-12-05T03:50:45.292 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.276+0000 7f511e59c700 1 --2- 172.21.15.158:0/573356171 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f512009ba40 0x7f512009add0 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f5108008790 tx=0x7f510800fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:45.292 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.276+0000 7f511e59c700 1 --2- 172.21.15.158:0/573356171 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f512009ba40 0x7f512009add0 secure :-1 s=THROTTLE_DONE pgs=70 cs=0 l=1 rx=0x7f5108008790 tx=0x7f510800fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:45.292 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.276+0000 7f511dd9b700 1 -- 172.21.15.158:0/573356171 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51080087d0 con 0x7f512009ba40 2019-12-05T03:50:45.292 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.276+0000 7f511dd9b700 1 -- 172.21.15.158:0/573356171 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5108011860 con 0x7f512009ba40 2019-12-05T03:50:45.292 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.276+0000 7f5124dd6700 1 -- 172.21.15.158:0/573356171 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f512009ba40 msgr2=0x7f512009add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:45.293 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.276+0000 7f5124dd6700 1 --2- 172.21.15.158:0/573356171 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f512009ba40 0x7f512009add0 secure :-1 s=READY pgs=70 cs=0 l=1 rx=0x7f5108008790 tx=0x7f510800fc70).stop 2019-12-05T03:50:45.293 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.280+0000 7f5124dd6700 1 -- 172.21.15.158:0/573356171 shutdown_connections 2019-12-05T03:50:45.293 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.280+0000 7f5124dd6700 1 --2- 172.21.15.158:0/573356171 >> v2:172.21.15.158:3300/0 conn(0x7f51200b5370 0x7f51200b57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:45.293 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.280+0000 7f5124dd6700 1 --2- 172.21.15.158:0/573356171 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f512009ba40 0x7f512009add0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:45.294 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.280+0000 7f5124dd6700 1 -- 172.21.15.158:0/573356171 shutdown_connections 2019-12-05T03:50:45.294 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.280+0000 7f5124dd6700 1 -- 172.21.15.158:0/573356171 wait complete. 2019-12-05T03:50:45.294 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.280+0000 7f5124dd6700 1 -- 172.21.15.158:0/573356171 >> 172.21.15.158:0/573356171 conn(0x7f51200b7ef0 msgr2=0x7f51200b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:45.298 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.280+0000 7f5124dd6700 1 Processor -- start 2019-12-05T03:50:45.299 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.280+0000 7f5124dd6700 1 -- start start 2019-12-05T03:50:45.299 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.280+0000 7f5124dd6700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f51200ac360 0x7f51201541a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:45.299 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.280+0000 7f5124dd6700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f512007d3f0 0x7f51200ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:45.299 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.280+0000 7f5124dd6700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f512007ad40 con 0x7f512007cfc0 2019-12-05T03:50:45.300 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.280+0000 7f5124dd6700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f512013b160 con 0x7f51200ac360 2019-12-05T03:50:45.300 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.280+0000 7f5124dd6700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f512013b400 con 0x7f512007d3f0 2019-12-05T03:50:45.300 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.284+0000 7f511e59c700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f512007cfc0 0x7f512013db90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49700/0 (socket says 172.21.15.158:49700) 2019-12-05T03:50:45.300 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.284+0000 7f511e59c700 1 -- 172.21.15.158:0/1594487403 learned_addr learned my addr 172.21.15.158:0/1594487403 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:45.300 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.284+0000 7f511ed9d700 1 --2- 172.21.15.158:0/1594487403 >> v2:172.21.15.96:3300/0 conn(0x7f51200ac360 0x7f51201541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:45.300 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.284+0000 7f511f59e700 1 --2- 172.21.15.158:0/1594487403 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f512007d3f0 0x7f51200ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:45.301 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.284+0000 7f51177fe700 1 -- 172.21.15.158:0/1594487403 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2284573471 0 0) 0x7f512007ad40 con 0x7f512007cfc0 2019-12-05T03:50:45.301 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.284+0000 7f51177fe700 1 -- 172.21.15.158:0/1594487403 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51040030b0 con 0x7f512007cfc0 2019-12-05T03:50:45.301 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.284+0000 7f511f59e700 1 -- 172.21.15.158:0/1594487403 >> v2:172.21.15.96:3300/0 conn(0x7f51200ac360 msgr2=0x7f51201541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:45.301 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.284+0000 7f511f59e700 1 --2- 172.21.15.158:0/1594487403 >> v2:172.21.15.96:3300/0 conn(0x7f51200ac360 0x7f51201541a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:45.301 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.284+0000 7f511f59e700 1 -- 172.21.15.158:0/1594487403 >> v1:172.21.15.158:6789/0 conn(0x7f512007cfc0 legacy=0x7f512013db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:45.302 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.284+0000 7f511f59e700 1 -- 172.21.15.158:0/1594487403 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f512013e390 con 0x7f512007d3f0 2019-12-05T03:50:45.302 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.284+0000 7f511f59e700 1 --2- 172.21.15.158:0/1594487403 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f512007d3f0 0x7f51200ae900 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5118002f30 tx=0x7f51180109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:45.308 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.284+0000 7f511f59e700 1 --2- 172.21.15.158:0/1594487403 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f512007d3f0 0x7f51200ae900 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5118002f30 tx=0x7f51180109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:45.308 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.284+0000 7f511f59e700 1 --2- 172.21.15.158:0/1594487403 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f512007d3f0 0x7f51200ae900 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f5118002f30 tx=0x7f51180109b0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:45.309 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.284+0000 7f511f59e700 1 --2- 172.21.15.158:0/1594487403 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f512007d3f0 0x7f51200ae900 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f5118002f30 tx=0x7f51180109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:45.309 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.284+0000 7f51177fe700 1 -- 172.21.15.158:0/1594487403 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5118005930 con 0x7f512007d3f0 2019-12-05T03:50:45.309 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.284+0000 7f511f59e700 1 --2- 172.21.15.158:0/1594487403 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f512007d3f0 0x7f51200ae900 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f5118002f30 tx=0x7f51180109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:45.309 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.284+0000 7f511f59e700 1 --2- 172.21.15.158:0/1594487403 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f512007d3f0 0x7f51200ae900 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f5118002f30 tx=0x7f51180109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:45.309 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.284+0000 7f51177fe700 1 -- 172.21.15.158:0/1594487403 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5118007160 con 0x7f512007d3f0 2019-12-05T03:50:45.310 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.284+0000 7f51177fe700 1 -- 172.21.15.158:0/1594487403 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51180060c0 con 0x7f512007d3f0 2019-12-05T03:50:45.316 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.284+0000 7f5124dd6700 1 -- 172.21.15.158:0/1594487403 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f512013e660 con 0x7f512007d3f0 2019-12-05T03:50:45.316 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.284+0000 7f5124dd6700 1 -- 172.21.15.158:0/1594487403 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5120144dd0 con 0x7f512007d3f0 2019-12-05T03:50:45.316 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.284+0000 7f511f59e700 1 --2- 172.21.15.158:0/1594487403 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f512007d3f0 0x7f51200ae900 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f5118002f30 tx=0x7f51180109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:45.317 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.284+0000 7f51177fe700 1 -- 172.21.15.158:0/1594487403 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f51180063d0 con 0x7f512007d3f0 2019-12-05T03:50:45.317 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.284+0000 7f511f59e700 1 --2- 172.21.15.158:0/1594487403 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f512007d3f0 0x7f51200ae900 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f5118002f30 tx=0x7f51180109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:45.317 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.284+0000 7f51177fe700 1 --2- 172.21.15.158:0/1594487403 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f510403b280 0x7f510403d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:45.317 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.288+0000 7f51177fe700 1 -- 172.21.15.158:0/1594487403 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f511804ad00 con 0x7f512007d3f0 2019-12-05T03:50:45.317 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.288+0000 7f511ed9d700 1 --2- 172.21.15.158:0/1594487403 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f510403b280 0x7f510403d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:45.318 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.288+0000 7f511ed9d700 1 --2- 172.21.15.158:0/1594487403 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f510403b280 0x7f510403d790 crc :-1 s=READY pgs=151 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:45.318 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.288+0000 7f5124dd6700 1 -- 172.21.15.158:0/1594487403 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f512013b5c0 con 0x7f512007d3f0 2019-12-05T03:50:45.318 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.300+0000 7f511f59e700 1 --2- 172.21.15.158:0/1594487403 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f512007d3f0 0x7f51200ae900 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f5118002f30 tx=0x7f51180109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:45.318 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.300+0000 7f51177fe700 1 -- 172.21.15.158:0/1594487403 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f5118031d80 con 0x7f512007d3f0 2019-12-05T03:50:45.474 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:45.468+0000 7f5124dd6700 1 -- 172.21.15.158:0/1594487403 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"} v 0) v1 -- 0x7f51200554e0 con 0x7f512007d3f0 2019-12-05T03:50:46.256 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.248+0000 7f511f59e700 1 --2- 172.21.15.158:0/1594487403 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f512007d3f0 0x7f51200ae900 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f5118002f30 tx=0x7f51180109b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:46.257 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.248+0000 7f51177fe700 1 -- 172.21.15.158:0/1594487403 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"var": "standby_count_wanted", "prefix": "fs set", "fs_name": "cephfs", "val": "0"}]=0 v11) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5118031fe0 con 0x7f512007d3f0 2019-12-05T03:50:46.294 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.288+0000 7f5124dd6700 1 -- 172.21.15.158:0/1594487403 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f510403b280 msgr2=0x7f510403d790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:46.295 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.288+0000 7f5124dd6700 1 --2- 172.21.15.158:0/1594487403 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f510403b280 0x7f510403d790 crc :-1 s=READY pgs=151 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:46.295 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.288+0000 7f5124dd6700 1 -- 172.21.15.158:0/1594487403 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f512007d3f0 msgr2=0x7f51200ae900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:46.295 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.288+0000 7f5124dd6700 1 --2- 172.21.15.158:0/1594487403 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f512007d3f0 0x7f51200ae900 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f5118002f30 tx=0x7f51180109b0).stop 2019-12-05T03:50:46.295 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.288+0000 7f5124dd6700 1 -- 172.21.15.158:0/1594487403 shutdown_connections 2019-12-05T03:50:46.295 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.288+0000 7f5124dd6700 1 --2- 172.21.15.158:0/1594487403 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f510403b280 0x7f510403d790 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:46.295 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.288+0000 7f5124dd6700 1 --2- 172.21.15.158:0/1594487403 >> v2:172.21.15.96:3300/0 conn(0x7f51200ac360 0x7f51201541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:46.295 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.288+0000 7f5124dd6700 1 --2- 172.21.15.158:0/1594487403 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f512007d3f0 0x7f51200ae900 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:46.296 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.288+0000 7f5124dd6700 1 -- 172.21.15.158:0/1594487403 shutdown_connections 2019-12-05T03:50:46.296 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.288+0000 7f5124dd6700 1 -- 172.21.15.158:0/1594487403 wait complete. 2019-12-05T03:50:46.296 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.288+0000 7f5124dd6700 1 -- 172.21.15.158:0/1594487403 >> 172.21.15.158:0/1594487403 conn(0x7f51200b7ef0 msgr2=0x7f512009a320 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:46.307 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-12-05T03:50:46.418 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.404+0000 7f523213d700 1 Processor -- start 2019-12-05T03:50:46.418 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.404+0000 7f523213d700 1 -- start start 2019-12-05T03:50:46.418 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.408+0000 7f523213d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f522c05a740 0x7f522c155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:46.419 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.408+0000 7f523213d700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f522c0accb0 con 0x7f522c09cf60 2019-12-05T03:50:46.419 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.408+0000 7f523213d700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f522c156100 con 0x7f522c09a320 2019-12-05T03:50:46.419 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.408+0000 7f523213d700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f522c09a750 con 0x7f522c05a740 2019-12-05T03:50:46.419 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.408+0000 7f5230edb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f522c05a740 0x7f522c155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:46.420 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.408+0000 7f5230edb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f522c05a740 0x7f522c155bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54932/0 (socket says 172.21.15.158:54932) 2019-12-05T03:50:46.420 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.408+0000 7f522b7fe700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f522c09a320 0x7f522c1553b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49710/0 (socket says 172.21.15.158:49710) 2019-12-05T03:50:46.420 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.408+0000 7f5230edb700 1 -- 172.21.15.158:0/2786823027 learned_addr learned my addr 172.21.15.158:0/2786823027 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:46.420 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.408+0000 7f5230edb700 1 -- 172.21.15.158:0/2786823027 >> v1:172.21.15.158:6789/0 conn(0x7f522c09a320 legacy=0x7f522c1553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:46.421 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.408+0000 7f5230edb700 1 -- 172.21.15.158:0/2786823027 >> v1:172.21.15.96:6789/0 conn(0x7f522c09cf60 legacy=0x7f522c151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:46.421 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.408+0000 7f522affd700 1 -- 172.21.15.158:0/2786823027 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1746229434 0 0) 0x7f522c156100 con 0x7f522c09a320 2019-12-05T03:50:46.421 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.408+0000 7f5230edb700 1 -- 172.21.15.158:0/2786823027 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f522c05ab70 con 0x7f522c05a740 2019-12-05T03:50:46.421 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.408+0000 7f5230edb700 1 --2- 172.21.15.158:0/2786823027 >> v2:172.21.15.158:3300/0 conn(0x7f522c05a740 0x7f522c155bb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f522c09c740 tx=0x7f5224010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:46.422 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.408+0000 7f5230edb700 1 --2- 172.21.15.158:0/2786823027 >> v2:172.21.15.158:3300/0 conn(0x7f522c05a740 0x7f522c155bb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f522c09c740 tx=0x7f5224010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:46.422 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.408+0000 7f5230edb700 1 --2- 172.21.15.158:0/2786823027 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f522c05a740 0x7f522c155bb0 secure :-1 s=READY pgs=328 cs=0 l=1 rx=0x7f522c09c740 tx=0x7f5224010030).ready entity=mon.1 client_cookie=a65952784b07f682 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:46.422 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.408+0000 7f5230edb700 1 --2- 172.21.15.158:0/2786823027 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f522c05a740 0x7f522c155bb0 secure :-1 s=THROTTLE_DONE pgs=328 cs=0 l=1 rx=0x7f522c09c740 tx=0x7f5224010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:46.422 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.408+0000 7f522affd700 1 -- 172.21.15.158:0/2786823027 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52240110c0 con 0x7f522c05a740 2019-12-05T03:50:46.423 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.408+0000 7f5230edb700 1 --2- 172.21.15.158:0/2786823027 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f522c05a740 0x7f522c155bb0 secure :-1 s=THROTTLE_DONE pgs=328 cs=0 l=1 rx=0x7f522c09c740 tx=0x7f5224010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:46.423 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.408+0000 7f5230edb700 1 --2- 172.21.15.158:0/2786823027 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f522c05a740 0x7f522c155bb0 secure :-1 s=THROTTLE_DONE pgs=328 cs=0 l=1 rx=0x7f522c09c740 tx=0x7f5224010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:46.423 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.408+0000 7f522affd700 1 -- 172.21.15.158:0/2786823027 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5224010a30 con 0x7f522c05a740 2019-12-05T03:50:46.423 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.408+0000 7f522affd700 1 -- 172.21.15.158:0/2786823027 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52240114b0 con 0x7f522c05a740 2019-12-05T03:50:46.424 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.408+0000 7f523213d700 1 -- 172.21.15.158:0/2786823027 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f522c05a740 msgr2=0x7f522c155bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:46.424 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.408+0000 7f523213d700 1 --2- 172.21.15.158:0/2786823027 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f522c05a740 0x7f522c155bb0 secure :-1 s=READY pgs=328 cs=0 l=1 rx=0x7f522c09c740 tx=0x7f5224010030).stop 2019-12-05T03:50:46.424 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.408+0000 7f523213d700 1 -- 172.21.15.158:0/2786823027 shutdown_connections 2019-12-05T03:50:46.426 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.408+0000 7f523213d700 1 --2- 172.21.15.158:0/2786823027 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f522c05a740 0x7f522c155bb0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:46.426 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.408+0000 7f523213d700 1 -- 172.21.15.158:0/2786823027 shutdown_connections 2019-12-05T03:50:46.426 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.408+0000 7f523213d700 1 -- 172.21.15.158:0/2786823027 wait complete. 2019-12-05T03:50:46.427 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.408+0000 7f523213d700 1 -- 172.21.15.158:0/2786823027 >> 172.21.15.158:0/2786823027 conn(0x7f522c0b7e60 msgr2=0x7f522c0b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:46.432 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.412+0000 7f523213d700 1 Processor -- start 2019-12-05T03:50:46.432 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.412+0000 7f523213d700 1 -- start start 2019-12-05T03:50:46.433 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.412+0000 7f523213d700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f522c12d1f0 0x7f522c07b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:46.433 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.412+0000 7f523213d700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f522c138e30 0x7f522c139260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:46.433 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.412+0000 7f523213d700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f522c152a60 con 0x7f522c12dda0 2019-12-05T03:50:46.433 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.412+0000 7f523213d700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f522c12ca10 con 0x7f522c12d1f0 2019-12-05T03:50:46.434 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.412+0000 7f523213d700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f522c12ccb0 con 0x7f522c138e30 2019-12-05T03:50:46.434 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.412+0000 7f522bfff700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f522c12dda0 0x7f522c07caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49714/0 (socket says 172.21.15.158:49714) 2019-12-05T03:50:46.435 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.412+0000 7f522bfff700 1 -- 172.21.15.158:0/3662881565 learned_addr learned my addr 172.21.15.158:0/3662881565 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:46.435 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.412+0000 7f522b7fe700 1 --2- 172.21.15.158:0/3662881565 >> v2:172.21.15.158:3300/0 conn(0x7f522c12d1f0 0x7f522c07b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:46.436 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.412+0000 7f5230edb700 1 --2- 172.21.15.158:0/3662881565 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f522c138e30 0x7f522c139260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:46.437 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.412+0000 7f522b7fe700 1 -- 172.21.15.158:0/3662881565 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f522c138e30 msgr2=0x7f522c139260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:46.437 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.412+0000 7f522b7fe700 1 --2- 172.21.15.158:0/3662881565 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f522c138e30 0x7f522c139260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:46.437 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.412+0000 7f522b7fe700 1 -- 172.21.15.158:0/3662881565 >> v1:172.21.15.158:6789/0 conn(0x7f522c12dda0 legacy=0x7f522c07caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:46.437 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.412+0000 7f5228ff9700 1 -- 172.21.15.158:0/3662881565 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1413269031 0 0) 0x7f522c152a60 con 0x7f522c12dda0 2019-12-05T03:50:46.438 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.416+0000 7f522b7fe700 1 -- 172.21.15.158:0/3662881565 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f522c12c5e0 con 0x7f522c12d1f0 2019-12-05T03:50:46.438 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.416+0000 7f522b7fe700 1 --2- 172.21.15.158:0/3662881565 >> v2:172.21.15.158:3300/0 conn(0x7f522c12d1f0 0x7f522c07b300 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f522c12cbd0 tx=0x7f5220010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:46.438 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.416+0000 7f522b7fe700 1 --2- 172.21.15.158:0/3662881565 >> v2:172.21.15.158:3300/0 conn(0x7f522c12d1f0 0x7f522c07b300 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f522c12cbd0 tx=0x7f5220010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:46.438 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.416+0000 7f522b7fe700 1 --2- 172.21.15.158:0/3662881565 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f522c12d1f0 0x7f522c07b300 secure :-1 s=READY pgs=330 cs=0 l=1 rx=0x7f522c12cbd0 tx=0x7f5220010840).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:46.439 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.416+0000 7f522b7fe700 1 --2- 172.21.15.158:0/3662881565 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f522c12d1f0 0x7f522c07b300 secure :-1 s=THROTTLE_DONE pgs=330 cs=0 l=1 rx=0x7f522c12cbd0 tx=0x7f5220010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:46.439 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.416+0000 7f5228ff9700 1 -- 172.21.15.158:0/3662881565 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5220006850 con 0x7f522c12d1f0 2019-12-05T03:50:46.439 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.416+0000 7f522b7fe700 1 --2- 172.21.15.158:0/3662881565 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f522c12d1f0 0x7f522c07b300 secure :-1 s=THROTTLE_DONE pgs=330 cs=0 l=1 rx=0x7f522c12cbd0 tx=0x7f5220010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:46.439 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.416+0000 7f5228ff9700 1 -- 172.21.15.158:0/3662881565 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5220006470 con 0x7f522c12d1f0 2019-12-05T03:50:46.440 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.416+0000 7f522b7fe700 1 --2- 172.21.15.158:0/3662881565 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f522c12d1f0 0x7f522c07b300 secure :-1 s=THROTTLE_DONE pgs=330 cs=0 l=1 rx=0x7f522c12cbd0 tx=0x7f5220010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:46.440 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.416+0000 7f5228ff9700 1 -- 172.21.15.158:0/3662881565 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5220011060 con 0x7f522c12d1f0 2019-12-05T03:50:46.440 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.416+0000 7f523213d700 1 -- 172.21.15.158:0/3662881565 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f522c1397b0 con 0x7f522c12d1f0 2019-12-05T03:50:46.440 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.416+0000 7f523213d700 1 -- 172.21.15.158:0/3662881565 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f522c143590 con 0x7f522c12d1f0 2019-12-05T03:50:46.441 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.416+0000 7f522b7fe700 1 --2- 172.21.15.158:0/3662881565 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f522c12d1f0 0x7f522c07b300 secure :-1 s=THROTTLE_DONE pgs=330 cs=0 l=1 rx=0x7f522c12cbd0 tx=0x7f5220010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:46.441 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.416+0000 7f5228ff9700 1 -- 172.21.15.158:0/3662881565 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f5220011380 con 0x7f522c12d1f0 2019-12-05T03:50:46.441 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.416+0000 7f522b7fe700 1 --2- 172.21.15.158:0/3662881565 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f522c12d1f0 0x7f522c07b300 secure :-1 s=THROTTLE_DONE pgs=330 cs=0 l=1 rx=0x7f522c12cbd0 tx=0x7f5220010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:46.442 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.416+0000 7f5228ff9700 1 --2- 172.21.15.158:0/3662881565 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f520c03ac00 0x7f520c03d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:46.442 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.416+0000 7f5228ff9700 1 -- 172.21.15.158:0/3662881565 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f522004af80 con 0x7f522c12d1f0 2019-12-05T03:50:46.442 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.416+0000 7f522bfff700 1 --2- 172.21.15.158:0/3662881565 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f520c03ac00 0x7f520c03d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:46.442 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.416+0000 7f522bfff700 1 --2- 172.21.15.158:0/3662881565 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f520c03ac00 0x7f520c03d110 crc :-1 s=READY pgs=152 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:46.443 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.420+0000 7f523213d700 1 -- 172.21.15.158:0/3662881565 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f522c0554e0 con 0x7f522c12d1f0 2019-12-05T03:50:46.444 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.428+0000 7f522b7fe700 1 --2- 172.21.15.158:0/3662881565 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f522c12d1f0 0x7f522c07b300 secure :-1 s=THROTTLE_DONE pgs=330 cs=0 l=1 rx=0x7f522c12cbd0 tx=0x7f5220010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:46.444 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.428+0000 7f5228ff9700 1 -- 172.21.15.158:0/3662881565 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f5220031fe0 con 0x7f522c12d1f0 2019-12-05T03:50:46.598 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.592+0000 7f523213d700 1 -- 172.21.15.158:0/3662881565 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f522c09a530 con 0x7f522c12d1f0 2019-12-05T03:50:46.600 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.592+0000 7f522b7fe700 1 --2- 172.21.15.158:0/3662881565 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f522c12d1f0 0x7f522c07b300 secure :-1 s=THROTTLE_DONE pgs=330 cs=0 l=1 rx=0x7f522c12cbd0 tx=0x7f5220010840).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:46.600 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.592+0000 7f5228ff9700 1 -- 172.21.15.158:0/3662881565 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+1422 (secure 0 0 0) 0x7f5220032240 con 0x7f522c12d1f0 2019-12-05T03:50:46.600 INFO:teuthology.orchestra.run.smithi158.stderr:dumped fsmap epoch 11 2019-12-05T03:50:46.601 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:46.601 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":11,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-12-05T03:50:44.549123+0000","modified":"2019-12-05T03:50:46.242804+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2019-12-05T03:50:46.603 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.596+0000 7f523213d700 1 -- 172.21.15.158:0/3662881565 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f520c03ac00 msgr2=0x7f520c03d110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:46.603 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.596+0000 7f523213d700 1 --2- 172.21.15.158:0/3662881565 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f520c03ac00 0x7f520c03d110 crc :-1 s=READY pgs=152 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:46.604 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.596+0000 7f523213d700 1 -- 172.21.15.158:0/3662881565 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f522c12d1f0 msgr2=0x7f522c07b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:46.604 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.596+0000 7f523213d700 1 --2- 172.21.15.158:0/3662881565 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f522c12d1f0 0x7f522c07b300 secure :-1 s=READY pgs=330 cs=0 l=1 rx=0x7f522c12cbd0 tx=0x7f5220010840).stop 2019-12-05T03:50:46.604 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.596+0000 7f523213d700 1 -- 172.21.15.158:0/3662881565 shutdown_connections 2019-12-05T03:50:46.604 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.596+0000 7f523213d700 1 --2- 172.21.15.158:0/3662881565 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f520c03ac00 0x7f520c03d110 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:46.605 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.596+0000 7f523213d700 1 --2- 172.21.15.158:0/3662881565 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f522c138e30 0x7f522c139260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:46.605 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.596+0000 7f523213d700 1 --2- 172.21.15.158:0/3662881565 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f522c12d1f0 0x7f522c07b300 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:46.605 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.596+0000 7f523213d700 1 -- 172.21.15.158:0/3662881565 shutdown_connections 2019-12-05T03:50:46.605 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.596+0000 7f523213d700 1 -- 172.21.15.158:0/3662881565 wait complete. 2019-12-05T03:50:46.606 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.596+0000 7f523213d700 1 -- 172.21.15.158:0/3662881565 >> 172.21.15.158:0/3662881565 conn(0x7f522c05a740 msgr2=0x7f522c07e040 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:46.619 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-05T03:50:46.723 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.708+0000 7f867bd53700 1 Processor -- start 2019-12-05T03:50:46.724 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.708+0000 7f867bd53700 1 -- start start 2019-12-05T03:50:46.724 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.708+0000 7f867bd53700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f867409cf60 0x7f867409a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:46.724 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.708+0000 7f867bd53700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f867405a740 0x7f8674151460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:46.725 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.708+0000 7f867bd53700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f86741519b0 0x7f86740b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:46.726 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.708+0000 7f867bd53700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86740b1730 con 0x7f86741519b0 2019-12-05T03:50:46.726 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.708+0000 7f867bd53700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86740b19d0 con 0x7f867409cf60 2019-12-05T03:50:46.726 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.708+0000 7f867bd53700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867405ab70 con 0x7f867405a740 2019-12-05T03:50:46.727 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.708+0000 7f867a2f0700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f867409cf60 0x7f867409a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:46.727 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.708+0000 7f867a2f0700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f867409cf60 0x7f867409a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54942/0 (socket says 172.21.15.158:54942) 2019-12-05T03:50:46.727 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.708+0000 7f867a2f0700 1 -- 172.21.15.158:0/3402272804 learned_addr learned my addr 172.21.15.158:0/3402272804 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:46.727 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.712+0000 7f867aaf1700 1 --2- 172.21.15.158:0/3402272804 >> v2:172.21.15.96:3300/0 conn(0x7f86741519b0 0x7f86740b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:46.728 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.712+0000 7f8679aef700 1 --2- 172.21.15.158:0/3402272804 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f867405a740 0x7f8674151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:46.728 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.712+0000 7f867a2f0700 1 -- 172.21.15.158:0/3402272804 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f867405a740 msgr2=0x7f8674151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:46.728 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.712+0000 7f867a2f0700 1 --2- 172.21.15.158:0/3402272804 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f867405a740 0x7f8674151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:46.728 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.712+0000 7f867a2f0700 1 -- 172.21.15.158:0/3402272804 >> v2:172.21.15.96:3300/0 conn(0x7f86741519b0 msgr2=0x7f86740b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:46.729 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.712+0000 7f867a2f0700 1 --2- 172.21.15.158:0/3402272804 >> v2:172.21.15.96:3300/0 conn(0x7f86741519b0 0x7f86740b52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:46.729 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.712+0000 7f867a2f0700 1 -- 172.21.15.158:0/3402272804 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86740accb0 con 0x7f867409cf60 2019-12-05T03:50:46.729 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.712+0000 7f867a2f0700 1 --2- 172.21.15.158:0/3402272804 >> v2:172.21.15.158:3300/0 conn(0x7f867409cf60 0x7f867409a320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f86740b1b90 tx=0x7f867000fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:46.729 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.712+0000 7f867a2f0700 1 --2- 172.21.15.158:0/3402272804 >> v2:172.21.15.158:3300/0 conn(0x7f867409cf60 0x7f867409a320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f86740b1b90 tx=0x7f867000fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:46.730 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.712+0000 7f867a2f0700 1 --2- 172.21.15.158:0/3402272804 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f867409cf60 0x7f867409a320 secure :-1 s=READY pgs=331 cs=0 l=1 rx=0x7f86740b1b90 tx=0x7f867000fdb0).ready entity=mon.1 client_cookie=5a26483f260ac3ed server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:46.730 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.712+0000 7f867a2f0700 1 --2- 172.21.15.158:0/3402272804 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f867409cf60 0x7f867409a320 secure :-1 s=THROTTLE_DONE pgs=331 cs=0 l=1 rx=0x7f86740b1b90 tx=0x7f867000fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:46.730 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.712+0000 7f867a2f0700 1 --2- 172.21.15.158:0/3402272804 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f867409cf60 0x7f867409a320 secure :-1 s=THROTTLE_DONE pgs=331 cs=0 l=1 rx=0x7f86740b1b90 tx=0x7f867000fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:46.730 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.712+0000 7f867a2f0700 1 --2- 172.21.15.158:0/3402272804 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f867409cf60 0x7f867409a320 secure :-1 s=THROTTLE_DONE pgs=331 cs=0 l=1 rx=0x7f86740b1b90 tx=0x7f867000fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:46.731 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.712+0000 7f86792ee700 1 -- 172.21.15.158:0/3402272804 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86700113f0 con 0x7f867409cf60 2019-12-05T03:50:46.731 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.712+0000 7f86792ee700 1 -- 172.21.15.158:0/3402272804 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8670008bb0 con 0x7f867409cf60 2019-12-05T03:50:46.731 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.712+0000 7f86792ee700 1 -- 172.21.15.158:0/3402272804 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86700119d0 con 0x7f867409cf60 2019-12-05T03:50:46.731 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.712+0000 7f867bd53700 1 -- 172.21.15.158:0/3402272804 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f867409cf60 msgr2=0x7f867409a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:46.732 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.712+0000 7f867bd53700 1 --2- 172.21.15.158:0/3402272804 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f867409cf60 0x7f867409a320 secure :-1 s=READY pgs=331 cs=0 l=1 rx=0x7f86740b1b90 tx=0x7f867000fdb0).stop 2019-12-05T03:50:46.732 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.712+0000 7f867bd53700 1 -- 172.21.15.158:0/3402272804 shutdown_connections 2019-12-05T03:50:46.732 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.712+0000 7f867bd53700 1 --2- 172.21.15.158:0/3402272804 >> v2:172.21.15.96:3300/0 conn(0x7f86741519b0 0x7f86740b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:46.732 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.712+0000 7f867bd53700 1 --2- 172.21.15.158:0/3402272804 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f867409cf60 0x7f867409a320 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:46.733 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.712+0000 7f867bd53700 1 --2- 172.21.15.158:0/3402272804 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f867405a740 0x7f8674151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:46.733 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.712+0000 7f867bd53700 1 -- 172.21.15.158:0/3402272804 shutdown_connections 2019-12-05T03:50:46.733 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.712+0000 7f867bd53700 1 -- 172.21.15.158:0/3402272804 wait complete. 2019-12-05T03:50:46.733 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.712+0000 7f867bd53700 1 -- 172.21.15.158:0/3402272804 >> 172.21.15.158:0/3402272804 conn(0x7f86740b7e60 msgr2=0x7f86740b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:46.734 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.716+0000 7f867bd53700 1 Processor -- start 2019-12-05T03:50:46.734 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.716+0000 7f867bd53700 1 -- start start 2019-12-05T03:50:46.742 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.716+0000 7f867bd53700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f867407b630 0x7f867413bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:46.742 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.716+0000 7f867bd53700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f86740b0d40 0x7f8674153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:46.742 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.716+0000 7f867bd53700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8674154300 con 0x7f867413c490 2019-12-05T03:50:46.742 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.716+0000 7f867bd53700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f867407c940 con 0x7f867407b630 2019-12-05T03:50:46.743 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.716+0000 7f867bd53700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86740b49a0 con 0x7f86740b0d40 2019-12-05T03:50:46.743 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.716+0000 7f8679aef700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f867413c490 0x7f86740b41a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49728/0 (socket says 172.21.15.158:49728) 2019-12-05T03:50:46.743 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.716+0000 7f8679aef700 1 -- 172.21.15.158:0/1383194656 learned_addr learned my addr 172.21.15.158:0/1383194656 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:46.743 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.716+0000 7f867aaf1700 1 --2- 172.21.15.158:0/1383194656 >> v2:172.21.15.158:3300/0 conn(0x7f86740b0d40 0x7f8674153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:46.744 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.716+0000 7f867a2f0700 1 --2- 172.21.15.158:0/1383194656 >> v2:172.21.15.96:3300/0 conn(0x7f867407b630 0x7f867413bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:46.744 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.716+0000 7f866affd700 1 -- 172.21.15.158:0/1383194656 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2699893046 0 0) 0x7f8674154300 con 0x7f867413c490 2019-12-05T03:50:46.744 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.716+0000 7f866affd700 1 -- 172.21.15.158:0/1383194656 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f865c0030b0 con 0x7f867413c490 2019-12-05T03:50:46.744 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.716+0000 7f867aaf1700 1 -- 172.21.15.158:0/1383194656 >> v2:172.21.15.96:3300/0 conn(0x7f867407b630 msgr2=0x7f867413bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:46.745 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.716+0000 7f867aaf1700 1 --2- 172.21.15.158:0/1383194656 >> v2:172.21.15.96:3300/0 conn(0x7f867407b630 0x7f867413bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:46.745 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.716+0000 7f867aaf1700 1 -- 172.21.15.158:0/1383194656 >> v1:172.21.15.158:6789/0 conn(0x7f867413c490 legacy=0x7f86740b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:46.745 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.716+0000 7f867aaf1700 1 -- 172.21.15.158:0/1383194656 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8674154530 con 0x7f86740b0d40 2019-12-05T03:50:46.745 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.716+0000 7f867aaf1700 1 --2- 172.21.15.158:0/1383194656 >> v2:172.21.15.158:3300/0 conn(0x7f86740b0d40 0x7f8674153db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f867409b950 tx=0x7f866c010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:46.746 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.720+0000 7f867aaf1700 1 --2- 172.21.15.158:0/1383194656 >> v2:172.21.15.158:3300/0 conn(0x7f86740b0d40 0x7f8674153db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f867409b950 tx=0x7f866c010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:46.746 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.720+0000 7f867aaf1700 1 --2- 172.21.15.158:0/1383194656 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f86740b0d40 0x7f8674153db0 secure :-1 s=READY pgs=333 cs=0 l=1 rx=0x7f867409b950 tx=0x7f866c010d10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:46.747 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.720+0000 7f867aaf1700 1 --2- 172.21.15.158:0/1383194656 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f86740b0d40 0x7f8674153db0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7f867409b950 tx=0x7f866c010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:46.747 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.720+0000 7f866affd700 1 -- 172.21.15.158:0/1383194656 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f866c007350 con 0x7f86740b0d40 2019-12-05T03:50:46.747 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.720+0000 7f867aaf1700 1 --2- 172.21.15.158:0/1383194656 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f86740b0d40 0x7f8674153db0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7f867409b950 tx=0x7f866c010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:46.747 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.720+0000 7f867aaf1700 1 --2- 172.21.15.158:0/1383194656 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f86740b0d40 0x7f8674153db0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7f867409b950 tx=0x7f866c010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:46.747 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.720+0000 7f866affd700 1 -- 172.21.15.158:0/1383194656 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866c005cb0 con 0x7f86740b0d40 2019-12-05T03:50:46.747 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.720+0000 7f866affd700 1 -- 172.21.15.158:0/1383194656 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f866c012390 con 0x7f86740b0d40 2019-12-05T03:50:46.748 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.720+0000 7f867bd53700 1 -- 172.21.15.158:0/1383194656 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8674154800 con 0x7f86740b0d40 2019-12-05T03:50:46.748 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.720+0000 7f867bd53700 1 -- 172.21.15.158:0/1383194656 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8674154d50 con 0x7f86740b0d40 2019-12-05T03:50:46.748 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.720+0000 7f867aaf1700 1 --2- 172.21.15.158:0/1383194656 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f86740b0d40 0x7f8674153db0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7f867409b950 tx=0x7f866c010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:46.748 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.720+0000 7f866affd700 1 -- 172.21.15.158:0/1383194656 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f866c012660 con 0x7f86740b0d40 2019-12-05T03:50:46.748 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.720+0000 7f867aaf1700 1 --2- 172.21.15.158:0/1383194656 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f86740b0d40 0x7f8674153db0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7f867409b950 tx=0x7f866c010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:46.748 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.720+0000 7f866affd700 1 --2- 172.21.15.158:0/1383194656 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f865c03b2b0 0x7f865c03d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:46.749 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.720+0000 7f866affd700 1 -- 172.21.15.158:0/1383194656 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f866c04b730 con 0x7f86740b0d40 2019-12-05T03:50:46.749 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.720+0000 7f867a2f0700 1 --2- 172.21.15.158:0/1383194656 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f865c03b2b0 0x7f865c03d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:46.749 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.720+0000 7f867a2f0700 1 --2- 172.21.15.158:0/1383194656 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f865c03b2b0 0x7f865c03d7c0 crc :-1 s=READY pgs=153 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:46.749 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.724+0000 7f867bd53700 1 -- 172.21.15.158:0/1383194656 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86740554e0 con 0x7f86740b0d40 2019-12-05T03:50:46.749 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.728+0000 7f867aaf1700 1 --2- 172.21.15.158:0/1383194656 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f86740b0d40 0x7f8674153db0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7f867409b950 tx=0x7f866c010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:46.749 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.728+0000 7f866affd700 1 -- 172.21.15.158:0/1383194656 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f866c0327b0 con 0x7f86740b0d40 2019-12-05T03:50:46.902 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.896+0000 7f867bd53700 1 -- 172.21.15.158:0/1383194656 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8674066940 con 0x7f86740b0d40 2019-12-05T03:50:46.910 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.896+0000 7f867aaf1700 1 --2- 172.21.15.158:0/1383194656 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f86740b0d40 0x7f8674153db0 secure :-1 s=THROTTLE_DONE pgs=333 cs=0 l=1 rx=0x7f867409b950 tx=0x7f866c010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:46.910 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.896+0000 7f866affd700 1 -- 172.21.15.158:0/1383194656 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+14905 (secure 0 0 0) 0x7f866c032a10 con 0x7f86740b0d40 2019-12-05T03:50:46.910 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.900+0000 7f867bd53700 1 -- 172.21.15.158:0/1383194656 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f865c03b2b0 msgr2=0x7f865c03d7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:46.910 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.900+0000 7f867bd53700 1 --2- 172.21.15.158:0/1383194656 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f865c03b2b0 0x7f865c03d7c0 crc :-1 s=READY pgs=153 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:46.910 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.900+0000 7f867bd53700 1 -- 172.21.15.158:0/1383194656 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f86740b0d40 msgr2=0x7f8674153db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:46.911 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.900+0000 7f867bd53700 1 --2- 172.21.15.158:0/1383194656 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f86740b0d40 0x7f8674153db0 secure :-1 s=READY pgs=333 cs=0 l=1 rx=0x7f867409b950 tx=0x7f866c010d10).stop 2019-12-05T03:50:46.911 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.900+0000 7f867bd53700 1 -- 172.21.15.158:0/1383194656 shutdown_connections 2019-12-05T03:50:46.911 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.900+0000 7f867bd53700 1 --2- 172.21.15.158:0/1383194656 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f865c03b2b0 0x7f865c03d7c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:46.911 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.900+0000 7f867bd53700 1 --2- 172.21.15.158:0/1383194656 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f86740b0d40 0x7f8674153db0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:46.911 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.900+0000 7f867bd53700 1 --2- 172.21.15.158:0/1383194656 >> v2:172.21.15.96:3300/0 conn(0x7f867407b630 0x7f867413bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:46.911 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.900+0000 7f867bd53700 1 -- 172.21.15.158:0/1383194656 shutdown_connections 2019-12-05T03:50:46.911 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.900+0000 7f867bd53700 1 -- 172.21.15.158:0/1383194656 wait complete. 2019-12-05T03:50:46.912 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:46.900+0000 7f867bd53700 1 -- 172.21.15.158:0/1383194656 >> 172.21.15.158:0/1383194656 conn(0x7f867407e410 msgr2=0x7f8674155320 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:46.912 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:46.912 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":32,"fsid":"a91186ae-f496-4de1-918d-820c55ff1feb","created":"2019-12-05T03:49:39.187523+0000","modified":"2019-12-05T03:50:45.552171+0000","last_up_change":"2019-12-05T03:49:48.551934+0000","last_in_change":"2019-12-05T03:49:48.551934+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-05T03:49:52.900870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2019-12-05T03:50:42.436744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2019-12-05T03:50:43.620710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"782c4258-e28c-4a11-9d54-3c9c7a36fba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":12192},{"type":"v1","addr":"172.21.15.158:6801","nonce":12192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":12192},{"type":"v1","addr":"172.21.15.158:6803","nonce":12192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":12192},{"type":"v1","addr":"172.21.15.158:6807","nonce":12192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":12192},{"type":"v1","addr":"172.21.15.158:6805","nonce":12192}]},"public_addr":"172.21.15.158:6801/12192","cluster_addr":"172.21.15.158:6803/12192","heartbeat_back_addr":"172.21.15.158:6807/12192","heartbeat_front_addr":"172.21.15.158:6805/12192","state":["exists","up"]},{"osd":1,"uuid":"d4426b21-b666-4158-bf34-a24b14572731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":12193},{"type":"v1","addr":"172.21.15.158:6809","nonce":12193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":12193},{"type":"v1","addr":"172.21.15.158:6811","nonce":12193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":12193},{"type":"v1","addr":"172.21.15.158:6815","nonce":12193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":12193},{"type":"v1","addr":"172.21.15.158:6813","nonce":12193}]},"public_addr":"172.21.15.158:6809/12193","cluster_addr":"172.21.15.158:6811/12193","heartbeat_back_addr":"172.21.15.158:6815/12193","heartbeat_front_addr":"172.21.15.158:6813/12193","state":["exists","up"]},{"osd":2,"uuid":"22680edd-6490-4ab0-bb15-0605830e4cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":12195},{"type":"v1","addr":"172.21.15.158:6825","nonce":12195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":12195},{"type":"v1","addr":"172.21.15.158:6827","nonce":12195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":12195},{"type":"v1","addr":"172.21.15.158:6831","nonce":12195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":12195},{"type":"v1","addr":"172.21.15.158:6829","nonce":12195}]},"public_addr":"172.21.15.158:6825/12195","cluster_addr":"172.21.15.158:6827/12195","heartbeat_back_addr":"172.21.15.158:6831/12195","heartbeat_front_addr":"172.21.15.158:6829/12195","state":["exists","up"]},{"osd":3,"uuid":"7ec999ee-ace8-4ccb-a4f9-6f5d313bbbd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":12194},{"type":"v1","addr":"172.21.15.158:6817","nonce":12194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":12194},{"type":"v1","addr":"172.21.15.158:6819","nonce":12194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":12194},{"type":"v1","addr":"172.21.15.158:6823","nonce":12194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":12194},{"type":"v1","addr":"172.21.15.158:6821","nonce":12194}]},"public_addr":"172.21.15.158:6817/12194","cluster_addr":"172.21.15.158:6819/12194","heartbeat_back_addr":"172.21.15.158:6823/12194","heartbeat_front_addr":"172.21.15.158:6821/12194","state":["exists","up"]},{"osd":4,"uuid":"186e69c4-b69f-4dd1-bb8f-faf759c60484","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":12460},{"type":"v1","addr":"172.21.15.96:6803","nonce":12460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":12460},{"type":"v1","addr":"172.21.15.96:6805","nonce":12460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":12460},{"type":"v1","addr":"172.21.15.96:6809","nonce":12460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":12460},{"type":"v1","addr":"172.21.15.96:6807","nonce":12460}]},"public_addr":"172.21.15.96:6803/12460","cluster_addr":"172.21.15.96:6805/12460","heartbeat_back_addr":"172.21.15.96:6809/12460","heartbeat_front_addr":"172.21.15.96:6807/12460","state":["exists","up"]},{"osd":5,"uuid":"86b658b2-8b40-4cea-8163-305a3982758b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":12461},{"type":"v1","addr":"172.21.15.96:6811","nonce":12461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":12461},{"type":"v1","addr":"172.21.15.96:6813","nonce":12461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":12461},{"type":"v1","addr":"172.21.15.96:6817","nonce":12461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":12461},{"type":"v1","addr":"172.21.15.96:6815","nonce":12461}]},"public_addr":"172.21.15.96:6811/12461","cluster_addr":"172.21.15.96:6813/12461","heartbeat_back_addr":"172.21.15.96:6817/12461","heartbeat_front_addr":"172.21.15.96:6815/12461","state":["exists","up"]},{"osd":6,"uuid":"bdadaea8-9296-4788-bc59-d9c9eb8defdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":12463},{"type":"v1","addr":"172.21.15.96:6827","nonce":12463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":12463},{"type":"v1","addr":"172.21.15.96:6829","nonce":12463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":12463},{"type":"v1","addr":"172.21.15.96:6833","nonce":12463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":12463},{"type":"v1","addr":"172.21.15.96:6831","nonce":12463}]},"public_addr":"172.21.15.96:6827/12463","cluster_addr":"172.21.15.96:6829/12463","heartbeat_back_addr":"172.21.15.96:6833/12463","heartbeat_front_addr":"172.21.15.96:6831/12463","state":["exists","up"]},{"osd":7,"uuid":"c6d71846-d68e-430f-ab72-0fb8ea4bf640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":12462},{"type":"v1","addr":"172.21.15.96:6819","nonce":12462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":12462},{"type":"v1","addr":"172.21.15.96:6821","nonce":12462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":12462},{"type":"v1","addr":"172.21.15.96:6825","nonce":12462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":12462},{"type":"v1","addr":"172.21.15.96:6823","nonce":12462}]},"public_addr":"172.21.15.96:6819/12462","cluster_addr":"172.21.15.96:6821/12462","heartbeat_back_addr":"172.21.15.96:6825/12462","heartbeat_front_addr":"172.21.15.96:6823/12462","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.875762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.900817+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.210347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.133973+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.864697+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.131015+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.237225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.154377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-05T03:50:46.919 INFO:tasks.ceph.mds.a:Restarting daemon 2019-12-05T03:50:46.919 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2019-12-05T03:50:46.920 INFO:tasks.ceph.mds.b:Restarting daemon 2019-12-05T03:50:46.920 INFO:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2019-12-05T03:50:46.923 INFO:tasks.ceph.mds.a:Started 2019-12-05T03:50:46.923 DEBUG:teuthology.parallel:result is None 2019-12-05T03:50:46.924 INFO:tasks.ceph.mds.b:Started 2019-12-05T03:50:46.924 DEBUG:teuthology.parallel:result is None 2019-12-05T03:50:46.925 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-12-05T03:50:46.978 INFO:tasks.ceph.mds.b.smithi096.stdout:starting mds.b at 2019-12-05T03:50:46.980 INFO:tasks.ceph.mds.a.smithi158.stdout:starting mds.a at 2019-12-05T03:50:47.041 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.028+0000 7f4b46253700 1 Processor -- start 2019-12-05T03:50:47.041 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.028+0000 7f4b46253700 1 -- start start 2019-12-05T03:50:47.042 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.028+0000 7f4b46253700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b40099140 0x7f4b4009bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:47.042 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.028+0000 7f4b46253700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b400984f0 con 0x7f4b4009c180 2019-12-05T03:50:47.042 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.028+0000 7f4b46253700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b4007e8c0 con 0x7f4b40096910 2019-12-05T03:50:47.042 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.028+0000 7f4b46253700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4007eaf0 con 0x7f4b40099140 2019-12-05T03:50:47.042 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.028+0000 7f4b3ffff700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f4b40096910 0x7f4b400b34a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49748/0 (socket says 172.21.15.158:49748) 2019-12-05T03:50:47.042 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.028+0000 7f4b3ffff700 1 -- 172.21.15.158:0/995216484 learned_addr learned my addr 172.21.15.158:0/995216484 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:47.042 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.028+0000 7f4b3f7fe700 1 --2- 172.21.15.158:0/995216484 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b40099140 0x7f4b4009bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:47.043 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.028+0000 7f4b3effd700 1 -- 172.21.15.158:0/995216484 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 909403974 0 0) 0x7f4b4007e8c0 con 0x7f4b40096910 2019-12-05T03:50:47.043 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.028+0000 7f4b3effd700 1 -- 172.21.15.158:0/995216484 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b280030b0 con 0x7f4b40096910 2019-12-05T03:50:47.043 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.028+0000 7f4b3effd700 1 -- 172.21.15.158:0/995216484 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4230413291 0 0) 0x7f4b400984f0 con 0x7f4b4009c180 2019-12-05T03:50:47.043 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.028+0000 7f4b3effd700 1 -- 172.21.15.158:0/995216484 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b4007e8c0 con 0x7f4b4009c180 2019-12-05T03:50:47.043 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.028+0000 7f4b3effd700 1 -- 172.21.15.158:0/995216484 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 660200778 0 0) 0x7f4b280030b0 con 0x7f4b40096910 2019-12-05T03:50:47.043 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.028+0000 7f4b3effd700 1 -- 172.21.15.158:0/995216484 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b40099140 msgr2=0x7f4b4009bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:47.043 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.028+0000 7f4b3effd700 1 --2- 172.21.15.158:0/995216484 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b40099140 0x7f4b4009bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:47.044 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.028+0000 7f4b3effd700 1 -- 172.21.15.158:0/995216484 >> v1:172.21.15.96:6789/0 conn(0x7f4b4009c180 legacy=0x7f4b4009c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:47.044 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.028+0000 7f4b3effd700 1 -- 172.21.15.158:0/995216484 --> v1:172.21.15.158:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4009cdb0 con 0x7f4b40096910 2019-12-05T03:50:47.044 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.028+0000 7f4b3effd700 1 -- 172.21.15.158:0/995216484 <== mon.1 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 828730332 0 0) 0x7f4b30001ad0 con 0x7f4b40096910 2019-12-05T03:50:47.044 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.028+0000 7f4b3effd700 1 -- 172.21.15.158:0/995216484 >> v1:172.21.15.158:6789/0 conn(0x7f4b40096910 legacy=0x7f4b400b34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:47.045 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.028+0000 7f4b3effd700 1 --2- 172.21.15.158:0/995216484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b28003910 0x7f4b28003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:47.045 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.028+0000 7f4b3effd700 1 --2- 172.21.15.158:0/995216484 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b28004420 0x7f4b280048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:47.045 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.028+0000 7f4b3effd700 1 --2- 172.21.15.158:0/995216484 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b28004ec0 0x7f4b2804f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:47.045 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.028+0000 7f4b3effd700 1 -- 172.21.15.158:0/995216484 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4007eaf0 con 0x7f4b28003910 2019-12-05T03:50:47.045 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.028+0000 7f4b3effd700 1 -- 172.21.15.158:0/995216484 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2804fdb0 con 0x7f4b28004ec0 2019-12-05T03:50:47.045 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.028+0000 7f4b3effd700 1 -- 172.21.15.158:0/995216484 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2804fff0 con 0x7f4b28004420 2019-12-05T03:50:47.045 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.028+0000 7f4b3f7fe700 1 --2- 172.21.15.158:0/995216484 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b40099140 0x7f4b4009bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:50:47.046 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.028+0000 7f4b3ffff700 1 --2- 172.21.15.158:0/995216484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b28003910 0x7f4b28003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:47.046 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.028+0000 7f4b44ff1700 1 --2- 172.21.15.158:0/995216484 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b28004ec0 0x7f4b2804f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:47.046 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.028+0000 7f4b3f7fe700 1 --2- 172.21.15.158:0/995216484 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b28004420 0x7f4b280048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:47.046 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.028+0000 7f4b44ff1700 1 -- 172.21.15.158:0/995216484 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b28004420 msgr2=0x7f4b280048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:47.046 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.028+0000 7f4b44ff1700 1 --2- 172.21.15.158:0/995216484 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f4b28004420 0x7f4b280048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:47.047 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.028+0000 7f4b44ff1700 1 -- 172.21.15.158:0/995216484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b28003910 msgr2=0x7f4b28003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:47.047 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.028+0000 7f4b44ff1700 1 --2- 172.21.15.158:0/995216484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b28003910 0x7f4b28003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:47.047 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.028+0000 7f4b44ff1700 1 -- 172.21.15.158:0/995216484 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b280502f0 con 0x7f4b28004ec0 2019-12-05T03:50:47.047 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.028+0000 7f4b3ffff700 1 --2- 172.21.15.158:0/995216484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b28003910 0x7f4b28003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:50:47.047 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.028+0000 7f4b44ff1700 1 --2- 172.21.15.158:0/995216484 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b28004ec0 0x7f4b2804f680 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4b38001000 tx=0x7f4b3800be40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.047 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.032+0000 7f4b44ff1700 1 --2- 172.21.15.158:0/995216484 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b28004ec0 0x7f4b2804f680 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4b38001000 tx=0x7f4b3800be40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.047 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.032+0000 7f4b44ff1700 1 --2- 172.21.15.158:0/995216484 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b28004ec0 0x7f4b2804f680 secure :-1 s=READY pgs=340 cs=0 l=1 rx=0x7f4b38001000 tx=0x7f4b3800be40).ready entity=mon.1 client_cookie=f18ee894f45743fc server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:47.048 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.032+0000 7f4b44ff1700 1 --2- 172.21.15.158:0/995216484 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b28004ec0 0x7f4b2804f680 secure :-1 s=THROTTLE_DONE pgs=340 cs=0 l=1 rx=0x7f4b38001000 tx=0x7f4b3800be40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.048 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.032+0000 7f4b3effd700 1 -- 172.21.15.158:0/995216484 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b38010af0 con 0x7f4b28004ec0 2019-12-05T03:50:47.048 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.032+0000 7f4b44ff1700 1 --2- 172.21.15.158:0/995216484 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b28004ec0 0x7f4b2804f680 secure :-1 s=THROTTLE_DONE pgs=340 cs=0 l=1 rx=0x7f4b38001000 tx=0x7f4b3800be40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.048 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.032+0000 7f4b44ff1700 1 --2- 172.21.15.158:0/995216484 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b28004ec0 0x7f4b2804f680 secure :-1 s=THROTTLE_DONE pgs=340 cs=0 l=1 rx=0x7f4b38001000 tx=0x7f4b3800be40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.048 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.032+0000 7f4b3effd700 1 -- 172.21.15.158:0/995216484 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b38010710 con 0x7f4b28004ec0 2019-12-05T03:50:47.048 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.032+0000 7f4b3effd700 1 -- 172.21.15.158:0/995216484 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b3800c760 con 0x7f4b28004ec0 2019-12-05T03:50:47.048 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.032+0000 7f4b46253700 1 -- 172.21.15.158:0/995216484 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b28004ec0 msgr2=0x7f4b2804f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:47.049 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.032+0000 7f4b46253700 1 --2- 172.21.15.158:0/995216484 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b28004ec0 0x7f4b2804f680 secure :-1 s=READY pgs=340 cs=0 l=1 rx=0x7f4b38001000 tx=0x7f4b3800be40).stop 2019-12-05T03:50:47.049 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.032+0000 7f4b44ff1700 1 -- 172.21.15.158:0/995216484 reap_dead start 2019-12-05T03:50:47.049 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.032+0000 7f4b46253700 1 -- 172.21.15.158:0/995216484 shutdown_connections 2019-12-05T03:50:47.049 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.032+0000 7f4b46253700 1 -- 172.21.15.158:0/995216484 shutdown_connections 2019-12-05T03:50:47.049 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.032+0000 7f4b46253700 1 -- 172.21.15.158:0/995216484 wait complete. 2019-12-05T03:50:47.049 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.032+0000 7f4b46253700 1 -- 172.21.15.158:0/995216484 >> 172.21.15.158:0/995216484 conn(0x7f4b4005d8a0 msgr2=0x7f4b4005dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:47.049 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.032+0000 7f4b46253700 1 Processor -- start 2019-12-05T03:50:47.050 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.032+0000 7f4b46253700 1 -- start start 2019-12-05T03:50:47.052 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.036+0000 7f4b46253700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4b4012dbd0 0x7f4b4007c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:47.053 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.036+0000 7f4b46253700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4b4007cde0 0x7f4b40151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:47.053 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.036+0000 7f4b46253700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b40140500 con 0x7f4b400b11b0 2019-12-05T03:50:47.053 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.036+0000 7f4b46253700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b40153ba0 con 0x7f4b4012dbd0 2019-12-05T03:50:47.053 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.036+0000 7f4b46253700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b4013d5a0 con 0x7f4b4007cde0 2019-12-05T03:50:47.053 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.036+0000 7f4b3f7fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4b4007cde0 0x7f4b40151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:47.053 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.036+0000 7f4b3f7fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f4b4007cde0 0x7f4b40151b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:54982/0 (socket says 172.21.15.158:54982) 2019-12-05T03:50:47.053 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.036+0000 7f4b3f7fe700 1 -- 172.21.15.158:0/1893561373 learned_addr learned my addr 172.21.15.158:0/1893561373 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:47.054 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.036+0000 7f4b3ffff700 1 --2- 172.21.15.158:0/1893561373 >> v2:172.21.15.96:3300/0 conn(0x7f4b4012dbd0 0x7f4b4007c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:47.054 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.036+0000 7f4b3f7fe700 1 -- 172.21.15.158:0/1893561373 >> v2:172.21.15.96:3300/0 conn(0x7f4b4012dbd0 msgr2=0x7f4b4007c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:47.054 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.036+0000 7f4b3f7fe700 1 --2- 172.21.15.158:0/1893561373 >> v2:172.21.15.96:3300/0 conn(0x7f4b4012dbd0 0x7f4b4007c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:47.054 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.036+0000 7f4b3f7fe700 1 -- 172.21.15.158:0/1893561373 >> v1:172.21.15.96:6789/0 conn(0x7f4b400b11b0 legacy=0x7f4b40152050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:47.055 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.036+0000 7f4b3f7fe700 1 -- 172.21.15.158:0/1893561373 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b40152850 con 0x7f4b4007cde0 2019-12-05T03:50:47.055 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.036+0000 7f4b3f7fe700 1 --2- 172.21.15.158:0/1893561373 >> v2:172.21.15.158:3300/0 conn(0x7f4b4007cde0 0x7f4b40151b00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4b34000e50 tx=0x7f4b34010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.055 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.036+0000 7f4b3f7fe700 1 --2- 172.21.15.158:0/1893561373 >> v2:172.21.15.158:3300/0 conn(0x7f4b4007cde0 0x7f4b40151b00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4b34000e50 tx=0x7f4b34010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.055 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.036+0000 7f4b3f7fe700 1 --2- 172.21.15.158:0/1893561373 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b4007cde0 0x7f4b40151b00 secure :-1 s=READY pgs=341 cs=0 l=1 rx=0x7f4b34000e50 tx=0x7f4b34010c80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:47.056 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.036+0000 7f4b3f7fe700 1 --2- 172.21.15.158:0/1893561373 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b4007cde0 0x7f4b40151b00 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7f4b34000e50 tx=0x7f4b34010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.056 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.036+0000 7f4b3cff9700 1 -- 172.21.15.158:0/1893561373 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b34005750 con 0x7f4b4007cde0 2019-12-05T03:50:47.056 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.036+0000 7f4b3f7fe700 1 --2- 172.21.15.158:0/1893561373 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b4007cde0 0x7f4b40151b00 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7f4b34000e50 tx=0x7f4b34010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.056 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.036+0000 7f4b3f7fe700 1 --2- 172.21.15.158:0/1893561373 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b4007cde0 0x7f4b40151b00 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7f4b34000e50 tx=0x7f4b34010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.056 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.036+0000 7f4b3cff9700 1 -- 172.21.15.158:0/1893561373 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b34007160 con 0x7f4b4007cde0 2019-12-05T03:50:47.056 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.036+0000 7f4b46253700 1 -- 172.21.15.158:0/1893561373 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b400b40c0 con 0x7f4b4007cde0 2019-12-05T03:50:47.056 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.036+0000 7f4b3cff9700 1 -- 172.21.15.158:0/1893561373 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b34005d70 con 0x7f4b4007cde0 2019-12-05T03:50:47.057 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.036+0000 7f4b46253700 1 -- 172.21.15.158:0/1893561373 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b400b0710 con 0x7f4b4007cde0 2019-12-05T03:50:47.057 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.036+0000 7f4b3f7fe700 1 --2- 172.21.15.158:0/1893561373 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b4007cde0 0x7f4b40151b00 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7f4b34000e50 tx=0x7f4b34010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.057 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.040+0000 7f4b3cff9700 1 -- 172.21.15.158:0/1893561373 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f4b3400d410 con 0x7f4b4007cde0 2019-12-05T03:50:47.057 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.040+0000 7f4b3f7fe700 1 --2- 172.21.15.158:0/1893561373 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b4007cde0 0x7f4b40151b00 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7f4b34000e50 tx=0x7f4b34010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.058 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.040+0000 7f4b3cff9700 1 --2- 172.21.15.158:0/1893561373 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f4b2003acd0 0x7f4b2003d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:47.058 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.040+0000 7f4b3cff9700 1 -- 172.21.15.158:0/1893561373 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f4b34007f50 con 0x7f4b4007cde0 2019-12-05T03:50:47.058 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.040+0000 7f4b3ffff700 1 --2- 172.21.15.158:0/1893561373 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f4b2003acd0 0x7f4b2003d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:47.064 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.040+0000 7f4b3ffff700 1 --2- 172.21.15.158:0/1893561373 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f4b2003acd0 0x7f4b2003d1e0 crc :-1 s=READY pgs=154 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:47.064 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.040+0000 7f4b46253700 1 -- 172.21.15.158:0/1893561373 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b40154980 con 0x7f4b4007cde0 2019-12-05T03:50:47.065 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.048+0000 7f4b3f7fe700 1 --2- 172.21.15.158:0/1893561373 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b4007cde0 0x7f4b40151b00 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7f4b34000e50 tx=0x7f4b34010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.065 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.048+0000 7f4b3cff9700 1 -- 172.21.15.158:0/1893561373 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f4b340323f0 con 0x7f4b4007cde0 2019-12-05T03:50:47.221 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.216+0000 7f4b46253700 1 -- 172.21.15.158:0/1893561373 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f4b40066940 con 0x7f4b4007cde0 2019-12-05T03:50:47.231 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.224+0000 7f4b3f7fe700 1 --2- 172.21.15.158:0/1893561373 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b4007cde0 0x7f4b40151b00 secure :-1 s=THROTTLE_DONE pgs=341 cs=0 l=1 rx=0x7f4b34000e50 tx=0x7f4b34010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.232 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.224+0000 7f4b3cff9700 1 -- 172.21.15.158:0/1893561373 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v13) v1 ==== 184+0+0 (secure 0 0 0) 0x7f4b34032650 con 0x7f4b4007cde0 2019-12-05T03:50:47.237 INFO:teuthology.orchestra.run.smithi158.stderr:updated caps for client.0 2019-12-05T03:50:47.240 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.232+0000 7f4b46253700 1 -- 172.21.15.158:0/1893561373 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f4b2003acd0 msgr2=0x7f4b2003d1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:47.240 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.232+0000 7f4b46253700 1 --2- 172.21.15.158:0/1893561373 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f4b2003acd0 0x7f4b2003d1e0 crc :-1 s=READY pgs=154 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:47.241 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.232+0000 7f4b46253700 1 -- 172.21.15.158:0/1893561373 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b4007cde0 msgr2=0x7f4b40151b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:47.241 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.232+0000 7f4b46253700 1 --2- 172.21.15.158:0/1893561373 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b4007cde0 0x7f4b40151b00 secure :-1 s=READY pgs=341 cs=0 l=1 rx=0x7f4b34000e50 tx=0x7f4b34010c80).stop 2019-12-05T03:50:47.241 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.232+0000 7f4b46253700 1 -- 172.21.15.158:0/1893561373 shutdown_connections 2019-12-05T03:50:47.241 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.232+0000 7f4b46253700 1 --2- 172.21.15.158:0/1893561373 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f4b2003acd0 0x7f4b2003d1e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:47.241 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.232+0000 7f4b46253700 1 --2- 172.21.15.158:0/1893561373 >> v2:172.21.15.96:3300/0 conn(0x7f4b4012dbd0 0x7f4b4007c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:47.241 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.232+0000 7f4b46253700 1 --2- 172.21.15.158:0/1893561373 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f4b4007cde0 0x7f4b40151b00 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:47.241 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.232+0000 7f4b46253700 1 -- 172.21.15.158:0/1893561373 shutdown_connections 2019-12-05T03:50:47.242 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.232+0000 7f4b46253700 1 -- 172.21.15.158:0/1893561373 wait complete. 2019-12-05T03:50:47.242 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.232+0000 7f4b46253700 1 -- 172.21.15.158:0/1893561373 >> 172.21.15.158:0/1893561373 conn(0x7f4b40096910 msgr2=0x7f4b400593f0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:47.251 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-12-05T03:50:47.377 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.364+0000 7f676f9f0700 1 Processor -- start 2019-12-05T03:50:47.377 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.364+0000 7f676f9f0700 1 -- start start 2019-12-05T03:50:47.377 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.364+0000 7f676f9f0700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6768099130 0x7f676809bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:47.378 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.364+0000 7f676f9f0700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f676809c170 0x7f676809c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:47.378 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.364+0000 7f676f9f0700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67680984e0 con 0x7f6768096900 2019-12-05T03:50:47.378 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.364+0000 7f676f9f0700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6768097fa0 con 0x7f6768099130 2019-12-05T03:50:47.378 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.364+0000 7f676f9f0700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6768098240 con 0x7f676809c170 2019-12-05T03:50:47.378 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.368+0000 7f676e78e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f676809c170 0x7f676809c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:47.379 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.368+0000 7f676e78e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f676809c170 0x7f676809c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:55002/0 (socket says 172.21.15.158:55002) 2019-12-05T03:50:47.379 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.368+0000 7f676df8d700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f6768096900 0x7f67680b3490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49778/0 (socket says 172.21.15.158:49778) 2019-12-05T03:50:47.379 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.368+0000 7f676e78e700 1 -- 172.21.15.158:0/438791243 learned_addr learned my addr 172.21.15.158:0/438791243 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:47.379 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.368+0000 7f676d78c700 1 --2- 172.21.15.158:0/438791243 >> v2:172.21.15.96:3300/0 conn(0x7f6768099130 0x7f676809bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:47.379 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.368+0000 7f676e78e700 1 -- 172.21.15.158:0/438791243 >> v2:172.21.15.96:3300/0 conn(0x7f6768099130 msgr2=0x7f676809bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:47.379 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.368+0000 7f676e78e700 1 --2- 172.21.15.158:0/438791243 >> v2:172.21.15.96:3300/0 conn(0x7f6768099130 0x7f676809bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:47.380 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.368+0000 7f676e78e700 1 -- 172.21.15.158:0/438791243 >> v1:172.21.15.158:6789/0 conn(0x7f6768096900 legacy=0x7f67680b3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:47.380 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.368+0000 7f676e78e700 1 -- 172.21.15.158:0/438791243 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f676807e8b0 con 0x7f676809c170 2019-12-05T03:50:47.380 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.368+0000 7f676cf8b700 1 -- 172.21.15.158:0/438791243 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2060393542 0 0) 0x7f67680984e0 con 0x7f6768096900 2019-12-05T03:50:47.380 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.368+0000 7f676e78e700 1 --2- 172.21.15.158:0/438791243 >> v2:172.21.15.158:3300/0 conn(0x7f676809c170 0x7f676809c5a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f67600032b0 tx=0x7f67600100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.380 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.368+0000 7f676e78e700 1 --2- 172.21.15.158:0/438791243 >> v2:172.21.15.158:3300/0 conn(0x7f676809c170 0x7f676809c5a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f67600032b0 tx=0x7f67600100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.380 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.368+0000 7f676e78e700 1 --2- 172.21.15.158:0/438791243 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f676809c170 0x7f676809c5a0 secure :-1 s=READY pgs=343 cs=0 l=1 rx=0x7f67600032b0 tx=0x7f67600100b0).ready entity=mon.1 client_cookie=d2ad26f901021791 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:47.380 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.368+0000 7f676e78e700 1 --2- 172.21.15.158:0/438791243 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f676809c170 0x7f676809c5a0 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7f67600032b0 tx=0x7f67600100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.381 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.368+0000 7f676cf8b700 1 -- 172.21.15.158:0/438791243 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6760010d60 con 0x7f676809c170 2019-12-05T03:50:47.381 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.368+0000 7f676e78e700 1 --2- 172.21.15.158:0/438791243 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f676809c170 0x7f676809c5a0 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7f67600032b0 tx=0x7f67600100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.381 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.368+0000 7f676e78e700 1 --2- 172.21.15.158:0/438791243 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f676809c170 0x7f676809c5a0 secure :-1 s=THROTTLE_DONE pgs=343 cs=0 l=1 rx=0x7f67600032b0 tx=0x7f67600100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.381 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.368+0000 7f676cf8b700 1 -- 172.21.15.158:0/438791243 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6760010980 con 0x7f676809c170 2019-12-05T03:50:47.382 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.368+0000 7f676cf8b700 1 -- 172.21.15.158:0/438791243 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67600114a0 con 0x7f676809c170 2019-12-05T03:50:47.382 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.368+0000 7f676f9f0700 1 -- 172.21.15.158:0/438791243 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f676809c170 msgr2=0x7f676809c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:47.382 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.368+0000 7f676f9f0700 1 --2- 172.21.15.158:0/438791243 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f676809c170 0x7f676809c5a0 secure :-1 s=READY pgs=343 cs=0 l=1 rx=0x7f67600032b0 tx=0x7f67600100b0).stop 2019-12-05T03:50:47.382 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.368+0000 7f676f9f0700 1 -- 172.21.15.158:0/438791243 shutdown_connections 2019-12-05T03:50:47.382 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.368+0000 7f676f9f0700 1 --2- 172.21.15.158:0/438791243 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f676809c170 0x7f676809c5a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:47.382 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.368+0000 7f676f9f0700 1 --2- 172.21.15.158:0/438791243 >> v2:172.21.15.96:3300/0 conn(0x7f6768099130 0x7f676809bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:47.382 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.368+0000 7f676f9f0700 1 -- 172.21.15.158:0/438791243 shutdown_connections 2019-12-05T03:50:47.383 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.368+0000 7f676f9f0700 1 -- 172.21.15.158:0/438791243 wait complete. 2019-12-05T03:50:47.383 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.368+0000 7f676f9f0700 1 -- 172.21.15.158:0/438791243 >> 172.21.15.158:0/438791243 conn(0x7f676805d890 msgr2=0x7f676805dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:47.387 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.372+0000 7f676f9f0700 1 Processor -- start 2019-12-05T03:50:47.387 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.372+0000 7f676f9f0700 1 -- start start 2019-12-05T03:50:47.387 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.372+0000 7f676f9f0700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f67681418f0 0x7f676813d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:47.388 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.372+0000 7f676f9f0700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67680b4960 con 0x7f676805f730 2019-12-05T03:50:47.388 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.372+0000 7f676f9f0700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f676813e620 con 0x7f6768063bf0 2019-12-05T03:50:47.389 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.372+0000 7f676f9f0700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f676813e380 con 0x7f67681418f0 2019-12-05T03:50:47.389 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.372+0000 7f676d78c700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f6768063bf0 0x7f6768140db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49788/0 (socket says 172.21.15.158:49788) 2019-12-05T03:50:47.389 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.372+0000 7f676d78c700 1 -- 172.21.15.158:0/3694756216 learned_addr learned my addr 172.21.15.158:0/3694756216 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:47.390 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.372+0000 7f676df8d700 1 --2- 172.21.15.158:0/3694756216 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f67681418f0 0x7f676813d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:47.390 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.372+0000 7f675a7fc700 1 -- 172.21.15.158:0/3694756216 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376267028 0 0) 0x7f676813e620 con 0x7f6768063bf0 2019-12-05T03:50:47.390 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.372+0000 7f675a7fc700 1 -- 172.21.15.158:0/3694756216 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67500030b0 con 0x7f6768063bf0 2019-12-05T03:50:47.390 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.372+0000 7f675a7fc700 1 -- 172.21.15.158:0/3694756216 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 568874417 0 0) 0x7f67680b4960 con 0x7f676805f730 2019-12-05T03:50:47.390 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.376+0000 7f675a7fc700 1 -- 172.21.15.158:0/3694756216 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f676813e620 con 0x7f676805f730 2019-12-05T03:50:47.390 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.376+0000 7f676df8d700 1 -- 172.21.15.158:0/3694756216 >> v1:172.21.15.158:6789/0 conn(0x7f6768063bf0 legacy=0x7f6768140db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:47.391 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.376+0000 7f676df8d700 1 -- 172.21.15.158:0/3694756216 >> v1:172.21.15.96:6789/0 conn(0x7f676805f730 legacy=0x7f676805fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:47.391 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.376+0000 7f676df8d700 1 -- 172.21.15.158:0/3694756216 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6768060360 con 0x7f67681418f0 2019-12-05T03:50:47.391 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.376+0000 7f676df8d700 1 --2- 172.21.15.158:0/3694756216 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f67681418f0 0x7f676813d200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6764000b80 tx=0x7f67640107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.391 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.376+0000 7f676df8d700 1 --2- 172.21.15.158:0/3694756216 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f67681418f0 0x7f676813d200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6764000b80 tx=0x7f67640107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.391 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.376+0000 7f676df8d700 1 --2- 172.21.15.158:0/3694756216 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f67681418f0 0x7f676813d200 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7f6764000b80 tx=0x7f67640107f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:47.391 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.376+0000 7f676df8d700 1 --2- 172.21.15.158:0/3694756216 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f67681418f0 0x7f676813d200 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f6764000b80 tx=0x7f67640107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.392 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.376+0000 7f675a7fc700 1 -- 172.21.15.158:0/3694756216 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6764006850 con 0x7f67681418f0 2019-12-05T03:50:47.392 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.376+0000 7f676df8d700 1 --2- 172.21.15.158:0/3694756216 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f67681418f0 0x7f676813d200 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f6764000b80 tx=0x7f67640107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.392 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.376+0000 7f676df8d700 1 --2- 172.21.15.158:0/3694756216 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f67681418f0 0x7f676813d200 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f6764000b80 tx=0x7f67640107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.392 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.376+0000 7f675a7fc700 1 -- 172.21.15.158:0/3694756216 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6764006470 con 0x7f67681418f0 2019-12-05T03:50:47.392 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.376+0000 7f676f9f0700 1 -- 172.21.15.158:0/3694756216 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6768060630 con 0x7f67681418f0 2019-12-05T03:50:47.393 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.376+0000 7f675a7fc700 1 -- 172.21.15.158:0/3694756216 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6764011230 con 0x7f67681418f0 2019-12-05T03:50:47.393 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.376+0000 7f676f9f0700 1 -- 172.21.15.158:0/3694756216 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6768149000 con 0x7f67681418f0 2019-12-05T03:50:47.393 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.376+0000 7f676df8d700 1 --2- 172.21.15.158:0/3694756216 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f67681418f0 0x7f676813d200 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f6764000b80 tx=0x7f67640107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.393 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.376+0000 7f675a7fc700 1 -- 172.21.15.158:0/3694756216 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f6764011500 con 0x7f67681418f0 2019-12-05T03:50:47.393 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.376+0000 7f676df8d700 1 --2- 172.21.15.158:0/3694756216 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f67681418f0 0x7f676813d200 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f6764000b80 tx=0x7f67640107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.393 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.376+0000 7f675a7fc700 1 --2- 172.21.15.158:0/3694756216 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f675003b4c0 0x7f675003d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:47.394 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.376+0000 7f675a7fc700 1 -- 172.21.15.158:0/3694756216 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f676404af20 con 0x7f67681418f0 2019-12-05T03:50:47.394 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.376+0000 7f676d78c700 1 --2- 172.21.15.158:0/3694756216 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f675003b4c0 0x7f675003d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:47.394 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.380+0000 7f676d78c700 1 --2- 172.21.15.158:0/3694756216 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f675003b4c0 0x7f675003d9d0 crc :-1 s=READY pgs=156 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:47.394 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.380+0000 7f676f9f0700 1 -- 172.21.15.158:0/3694756216 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67680554d0 con 0x7f67681418f0 2019-12-05T03:50:47.397 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.388+0000 7f676df8d700 1 --2- 172.21.15.158:0/3694756216 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f67681418f0 0x7f676813d200 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f6764000b80 tx=0x7f67640107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.397 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.388+0000 7f675a7fc700 1 -- 172.21.15.158:0/3694756216 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f6764031fa0 con 0x7f67681418f0 2019-12-05T03:50:47.563 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.556+0000 7f676f9f0700 1 -- 172.21.15.158:0/3694756216 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f6768066930 con 0x7f67681418f0 2019-12-05T03:50:47.572 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.564+0000 7f676df8d700 1 --2- 172.21.15.158:0/3694756216 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f67681418f0 0x7f676813d200 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f6764000b80 tx=0x7f67640107f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.572 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.564+0000 7f675a7fc700 1 -- 172.21.15.158:0/3694756216 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v14) v1 ==== 184+0+0 (secure 0 0 0) 0x7f6764032200 con 0x7f67681418f0 2019-12-05T03:50:47.578 INFO:teuthology.orchestra.run.smithi158.stderr:updated caps for client.1 2019-12-05T03:50:47.582 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.576+0000 7f676f9f0700 1 -- 172.21.15.158:0/3694756216 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f675003b4c0 msgr2=0x7f675003d9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:47.582 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.576+0000 7f676f9f0700 1 --2- 172.21.15.158:0/3694756216 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f675003b4c0 0x7f675003d9d0 crc :-1 s=READY pgs=156 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:47.582 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.576+0000 7f676f9f0700 1 -- 172.21.15.158:0/3694756216 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f67681418f0 msgr2=0x7f676813d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:47.582 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.576+0000 7f676f9f0700 1 --2- 172.21.15.158:0/3694756216 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f67681418f0 0x7f676813d200 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7f6764000b80 tx=0x7f67640107f0).stop 2019-12-05T03:50:47.582 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.576+0000 7f676f9f0700 1 -- 172.21.15.158:0/3694756216 shutdown_connections 2019-12-05T03:50:47.582 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.576+0000 7f676f9f0700 1 --2- 172.21.15.158:0/3694756216 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f675003b4c0 0x7f675003d9d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:47.583 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.576+0000 7f676f9f0700 1 --2- 172.21.15.158:0/3694756216 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f67681418f0 0x7f676813d200 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:47.583 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.576+0000 7f676f9f0700 1 -- 172.21.15.158:0/3694756216 shutdown_connections 2019-12-05T03:50:47.583 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.576+0000 7f676f9f0700 1 -- 172.21.15.158:0/3694756216 wait complete. 2019-12-05T03:50:47.583 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.576+0000 7f676f9f0700 1 -- 172.21.15.158:0/3694756216 >> 172.21.15.158:0/3694756216 conn(0x7f676809cf30 msgr2=0x7f6768098440 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:47.594 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-12-05T03:50:47.700 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.684+0000 7f3e9345e700 1 Processor -- start 2019-12-05T03:50:47.700 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.688+0000 7f3e9345e700 1 -- start start 2019-12-05T03:50:47.700 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.688+0000 7f3e9345e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f3e8c096910 0x7f3e8c099140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:47.701 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.688+0000 7f3e9345e700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3e8c0b34a0 0x7f3e8c0b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:47.701 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.688+0000 7f3e9345e700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3e8c1550d0 0x7f3e8c155500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:47.701 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.688+0000 7f3e9345e700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e8c097fb0 con 0x7f3e8c0b34a0 2019-12-05T03:50:47.701 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.688+0000 7f3e9345e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e8c098250 con 0x7f3e8c096910 2019-12-05T03:50:47.701 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.688+0000 7f3e9345e700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c0984f0 con 0x7f3e8c1550d0 2019-12-05T03:50:47.701 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.688+0000 7f3e919fb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f3e8c096910 0x7f3e8c099140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:47.702 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.688+0000 7f3e919fb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f3e8c096910 0x7f3e8c099140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:55012/0 (socket says 172.21.15.158:55012) 2019-12-05T03:50:47.702 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.688+0000 7f3e919fb700 1 -- 172.21.15.158:0/1017287244 learned_addr learned my addr 172.21.15.158:0/1017287244 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:47.702 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.688+0000 7f3e911fa700 1 --2- 172.21.15.158:0/1017287244 >> v2:172.21.15.96:3300/0 conn(0x7f3e8c0b34a0 0x7f3e8c0b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:47.702 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.688+0000 7f3e921fc700 1 --2- 172.21.15.158:0/1017287244 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3e8c1550d0 0x7f3e8c155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:47.702 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.688+0000 7f3e919fb700 1 -- 172.21.15.158:0/1017287244 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3e8c1550d0 msgr2=0x7f3e8c155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:47.702 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.688+0000 7f3e919fb700 1 --2- 172.21.15.158:0/1017287244 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3e8c1550d0 0x7f3e8c155500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:47.703 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.688+0000 7f3e919fb700 1 -- 172.21.15.158:0/1017287244 >> v2:172.21.15.96:3300/0 conn(0x7f3e8c0b34a0 msgr2=0x7f3e8c0b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:47.703 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.688+0000 7f3e919fb700 1 --2- 172.21.15.158:0/1017287244 >> v2:172.21.15.96:3300/0 conn(0x7f3e8c0b34a0 0x7f3e8c0b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:47.703 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.688+0000 7f3e919fb700 1 -- 172.21.15.158:0/1017287244 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e8c07e8c0 con 0x7f3e8c096910 2019-12-05T03:50:47.703 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.688+0000 7f3e921fc700 1 --2- 172.21.15.158:0/1017287244 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3e8c1550d0 0x7f3e8c155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-12-05T03:50:47.703 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.688+0000 7f3e919fb700 1 --2- 172.21.15.158:0/1017287244 >> v2:172.21.15.158:3300/0 conn(0x7f3e8c096910 0x7f3e8c099140 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3e840032b0 tx=0x7f3e84010130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.703 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.688+0000 7f3e919fb700 1 --2- 172.21.15.158:0/1017287244 >> v2:172.21.15.158:3300/0 conn(0x7f3e8c096910 0x7f3e8c099140 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3e840032b0 tx=0x7f3e84010130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.703 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.688+0000 7f3e919fb700 1 --2- 172.21.15.158:0/1017287244 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3e8c096910 0x7f3e8c099140 secure :-1 s=READY pgs=345 cs=0 l=1 rx=0x7f3e840032b0 tx=0x7f3e84010130).ready entity=mon.1 client_cookie=70a11a27fef5c356 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:47.704 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.688+0000 7f3e919fb700 1 --2- 172.21.15.158:0/1017287244 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3e8c096910 0x7f3e8c099140 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7f3e840032b0 tx=0x7f3e84010130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.704 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.688+0000 7f3e919fb700 1 --2- 172.21.15.158:0/1017287244 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3e8c096910 0x7f3e8c099140 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7f3e840032b0 tx=0x7f3e84010130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.704 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.688+0000 7f3e909f9700 1 -- 172.21.15.158:0/1017287244 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e8400a160 con 0x7f3e8c096910 2019-12-05T03:50:47.704 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.688+0000 7f3e919fb700 1 --2- 172.21.15.158:0/1017287244 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3e8c096910 0x7f3e8c099140 secure :-1 s=THROTTLE_DONE pgs=345 cs=0 l=1 rx=0x7f3e840032b0 tx=0x7f3e84010130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.705 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.688+0000 7f3e909f9700 1 -- 172.21.15.158:0/1017287244 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e84011a70 con 0x7f3e8c096910 2019-12-05T03:50:47.705 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.688+0000 7f3e909f9700 1 -- 172.21.15.158:0/1017287244 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e8400a740 con 0x7f3e8c096910 2019-12-05T03:50:47.705 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.688+0000 7f3e9345e700 1 -- 172.21.15.158:0/1017287244 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3e8c096910 msgr2=0x7f3e8c099140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:47.705 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.688+0000 7f3e9345e700 1 --2- 172.21.15.158:0/1017287244 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3e8c096910 0x7f3e8c099140 secure :-1 s=READY pgs=345 cs=0 l=1 rx=0x7f3e840032b0 tx=0x7f3e84010130).stop 2019-12-05T03:50:47.705 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.692+0000 7f3e9345e700 1 -- 172.21.15.158:0/1017287244 shutdown_connections 2019-12-05T03:50:47.705 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.692+0000 7f3e9345e700 1 --2- 172.21.15.158:0/1017287244 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f3e8c1550d0 0x7f3e8c155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:47.705 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.692+0000 7f3e9345e700 1 --2- 172.21.15.158:0/1017287244 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3e8c096910 0x7f3e8c099140 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:47.706 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.692+0000 7f3e9345e700 1 --2- 172.21.15.158:0/1017287244 >> v2:172.21.15.96:3300/0 conn(0x7f3e8c0b34a0 0x7f3e8c0b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:47.706 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.692+0000 7f3e9345e700 1 -- 172.21.15.158:0/1017287244 shutdown_connections 2019-12-05T03:50:47.706 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.692+0000 7f3e9345e700 1 -- 172.21.15.158:0/1017287244 wait complete. 2019-12-05T03:50:47.706 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.692+0000 7f3e9345e700 1 -- 172.21.15.158:0/1017287244 >> 172.21.15.158:0/1017287244 conn(0x7f3e8c05d8a0 msgr2=0x7f3e8c05dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:47.706 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.692+0000 7f3e9345e700 1 Processor -- start 2019-12-05T03:50:47.706 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.692+0000 7f3e9345e700 1 -- start start 2019-12-05T03:50:47.709 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.696+0000 7f3e9345e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f3e8c140700 0x7f3e8c153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:47.709 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.696+0000 7f3e9345e700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3e8c13c5e0 0x7f3e8c13ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:47.709 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.696+0000 7f3e9345e700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e8c12b710 con 0x7f3e8c07d950 2019-12-05T03:50:47.710 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.696+0000 7f3e9345e700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e8c154470 con 0x7f3e8c13c5e0 2019-12-05T03:50:47.710 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.696+0000 7f3e9345e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e8c065120 con 0x7f3e8c140700 2019-12-05T03:50:47.710 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.696+0000 7f3e919fb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f3e8c140700 0x7f3e8c153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:47.710 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.696+0000 7f3e919fb700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f3e8c140700 0x7f3e8c153f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:55018/0 (socket says 172.21.15.158:55018) 2019-12-05T03:50:47.710 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.696+0000 7f3e919fb700 1 -- 172.21.15.158:0/3078283703 learned_addr learned my addr 172.21.15.158:0/3078283703 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:47.710 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.696+0000 7f3e921fc700 1 --2- 172.21.15.158:0/3078283703 >> v2:172.21.15.96:3300/0 conn(0x7f3e8c13c5e0 0x7f3e8c13ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:47.711 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.696+0000 7f3e919fb700 1 -- 172.21.15.158:0/3078283703 >> v2:172.21.15.96:3300/0 conn(0x7f3e8c13c5e0 msgr2=0x7f3e8c13ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:47.711 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.696+0000 7f3e919fb700 1 --2- 172.21.15.158:0/3078283703 >> v2:172.21.15.96:3300/0 conn(0x7f3e8c13c5e0 0x7f3e8c13ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:47.711 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.696+0000 7f3e919fb700 1 -- 172.21.15.158:0/3078283703 >> v1:172.21.15.96:6789/0 conn(0x7f3e8c07d950 legacy=0x7f3e8c09bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:47.711 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.696+0000 7f3e919fb700 1 -- 172.21.15.158:0/3078283703 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e8c0653c0 con 0x7f3e8c140700 2019-12-05T03:50:47.711 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.696+0000 7f3e919fb700 1 --2- 172.21.15.158:0/3078283703 >> v2:172.21.15.158:3300/0 conn(0x7f3e8c140700 0x7f3e8c153f20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3e8c099a80 tx=0x7f3e84011e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.711 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.696+0000 7f3e919fb700 1 --2- 172.21.15.158:0/3078283703 >> v2:172.21.15.158:3300/0 conn(0x7f3e8c140700 0x7f3e8c153f20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3e8c099a80 tx=0x7f3e84011e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.711 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.696+0000 7f3e919fb700 1 --2- 172.21.15.158:0/3078283703 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3e8c140700 0x7f3e8c153f20 secure :-1 s=READY pgs=346 cs=0 l=1 rx=0x7f3e8c099a80 tx=0x7f3e84011e00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:47.712 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.696+0000 7f3e919fb700 1 --2- 172.21.15.158:0/3078283703 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3e8c140700 0x7f3e8c153f20 secure :-1 s=THROTTLE_DONE pgs=346 cs=0 l=1 rx=0x7f3e8c099a80 tx=0x7f3e84011e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.712 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.696+0000 7f3e919fb700 1 --2- 172.21.15.158:0/3078283703 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3e8c140700 0x7f3e8c153f20 secure :-1 s=THROTTLE_DONE pgs=346 cs=0 l=1 rx=0x7f3e8c099a80 tx=0x7f3e84011e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.712 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.696+0000 7f3e8a7fc700 1 -- 172.21.15.158:0/3078283703 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e840058c0 con 0x7f3e8c140700 2019-12-05T03:50:47.712 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.696+0000 7f3e919fb700 1 --2- 172.21.15.158:0/3078283703 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3e8c140700 0x7f3e8c153f20 secure :-1 s=THROTTLE_DONE pgs=346 cs=0 l=1 rx=0x7f3e8c099a80 tx=0x7f3e84011e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.712 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.696+0000 7f3e8a7fc700 1 -- 172.21.15.158:0/3078283703 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8400a360 con 0x7f3e8c140700 2019-12-05T03:50:47.712 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.696+0000 7f3e9345e700 1 -- 172.21.15.158:0/3078283703 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e8c13cf60 con 0x7f3e8c140700 2019-12-05T03:50:47.713 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.696+0000 7f3e8a7fc700 1 -- 172.21.15.158:0/3078283703 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e84005cb0 con 0x7f3e8c140700 2019-12-05T03:50:47.713 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.696+0000 7f3e9345e700 1 -- 172.21.15.158:0/3078283703 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e8c13d490 con 0x7f3e8c140700 2019-12-05T03:50:47.713 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.696+0000 7f3e919fb700 1 --2- 172.21.15.158:0/3078283703 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3e8c140700 0x7f3e8c153f20 secure :-1 s=THROTTLE_DONE pgs=346 cs=0 l=1 rx=0x7f3e8c099a80 tx=0x7f3e84011e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.713 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.696+0000 7f3e8a7fc700 1 -- 172.21.15.158:0/3078283703 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f3e84007150 con 0x7f3e8c140700 2019-12-05T03:50:47.713 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.696+0000 7f3e919fb700 1 --2- 172.21.15.158:0/3078283703 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3e8c140700 0x7f3e8c153f20 secure :-1 s=THROTTLE_DONE pgs=346 cs=0 l=1 rx=0x7f3e8c099a80 tx=0x7f3e84011e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.713 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.696+0000 7f3e8a7fc700 1 --2- 172.21.15.158:0/3078283703 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f3e6c03ad30 0x7f3e6c03d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:47.713 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.696+0000 7f3e8a7fc700 1 -- 172.21.15.158:0/3078283703 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f3e8408fe20 con 0x7f3e8c140700 2019-12-05T03:50:47.714 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.696+0000 7f3e911fa700 1 --2- 172.21.15.158:0/3078283703 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f3e6c03ad30 0x7f3e6c03d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:47.714 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.700+0000 7f3e911fa700 1 --2- 172.21.15.158:0/3078283703 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f3e6c03ad30 0x7f3e6c03d240 crc :-1 s=READY pgs=157 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:47.714 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.700+0000 7f3e9345e700 1 -- 172.21.15.158:0/3078283703 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e8c0554e0 con 0x7f3e8c140700 2019-12-05T03:50:47.715 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.708+0000 7f3e919fb700 1 --2- 172.21.15.158:0/3078283703 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3e8c140700 0x7f3e8c153f20 secure :-1 s=THROTTLE_DONE pgs=346 cs=0 l=1 rx=0x7f3e8c099a80 tx=0x7f3e84011e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.715 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.708+0000 7f3e8a7fc700 1 -- 172.21.15.158:0/3078283703 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f3e84076e80 con 0x7f3e8c140700 2019-12-05T03:50:47.875 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.868+0000 7f3e9345e700 1 -- 172.21.15.158:0/3078283703 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f3e8c066940 con 0x7f3e8c140700 2019-12-05T03:50:47.884 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.876+0000 7f3e919fb700 1 --2- 172.21.15.158:0/3078283703 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3e8c140700 0x7f3e8c153f20 secure :-1 s=THROTTLE_DONE pgs=346 cs=0 l=1 rx=0x7f3e8c099a80 tx=0x7f3e84011e00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:47.884 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.876+0000 7f3e8a7fc700 1 -- 172.21.15.158:0/3078283703 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v15) v1 ==== 184+0+0 (secure 0 0 0) 0x7f3e840770e0 con 0x7f3e8c140700 2019-12-05T03:50:47.890 INFO:teuthology.orchestra.run.smithi158.stderr:updated caps for client.2 2019-12-05T03:50:47.894 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.888+0000 7f3e9345e700 1 -- 172.21.15.158:0/3078283703 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f3e6c03ad30 msgr2=0x7f3e6c03d240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:47.894 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.888+0000 7f3e9345e700 1 --2- 172.21.15.158:0/3078283703 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f3e6c03ad30 0x7f3e6c03d240 crc :-1 s=READY pgs=157 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:47.894 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.888+0000 7f3e9345e700 1 -- 172.21.15.158:0/3078283703 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3e8c140700 msgr2=0x7f3e8c153f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:47.895 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.888+0000 7f3e9345e700 1 --2- 172.21.15.158:0/3078283703 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3e8c140700 0x7f3e8c153f20 secure :-1 s=READY pgs=346 cs=0 l=1 rx=0x7f3e8c099a80 tx=0x7f3e84011e00).stop 2019-12-05T03:50:47.895 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.888+0000 7f3e9345e700 1 -- 172.21.15.158:0/3078283703 shutdown_connections 2019-12-05T03:50:47.895 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.888+0000 7f3e9345e700 1 --2- 172.21.15.158:0/3078283703 >> v2:172.21.15.96:3300/0 conn(0x7f3e8c13c5e0 0x7f3e8c13ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:47.895 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.888+0000 7f3e9345e700 1 --2- 172.21.15.158:0/3078283703 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f3e8c140700 0x7f3e8c153f20 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:47.895 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.888+0000 7f3e9345e700 1 --2- 172.21.15.158:0/3078283703 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f3e6c03ad30 0x7f3e6c03d240 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:47.895 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.888+0000 7f3e9345e700 1 -- 172.21.15.158:0/3078283703 shutdown_connections 2019-12-05T03:50:47.895 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.888+0000 7f3e9345e700 1 -- 172.21.15.158:0/3078283703 wait complete. 2019-12-05T03:50:47.896 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.888+0000 7f3e9345e700 1 -- 172.21.15.158:0/3078283703 >> 172.21.15.158:0/3078283703 conn(0x7f3e8c0b5e30 msgr2=0x7f3e8c0b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:47.906 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.3 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2019-12-05T03:50:48.009 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.996+0000 7f6f4d579700 1 Processor -- start 2019-12-05T03:50:48.009 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.996+0000 7f6f4d579700 1 -- start start 2019-12-05T03:50:48.009 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.996+0000 7f6f4d579700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6f48099140 0x7f6f4809bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:48.010 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.996+0000 7f6f4d579700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f4809c180 0x7f6f4809c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:48.010 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.996+0000 7f6f4d579700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f480984f0 con 0x7f6f48096910 2019-12-05T03:50:48.010 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.996+0000 7f6f4d579700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f48097fb0 con 0x7f6f48099140 2019-12-05T03:50:48.010 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.996+0000 7f6f4d579700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f48098250 con 0x7f6f4809c180 2019-12-05T03:50:48.010 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.996+0000 7f6f46ffd700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6f48099140 0x7f6f4809bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:48.010 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.996+0000 7f6f47fff700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f4809c180 0x7f6f4809c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:48.010 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.996+0000 7f6f46ffd700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6f48099140 0x7f6f4809bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.158:41616/0 (socket says 172.21.15.158:41616) 2019-12-05T03:50:48.011 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.996+0000 7f6f46ffd700 1 -- 172.21.15.158:0/960460373 learned_addr learned my addr 172.21.15.158:0/960460373 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:48.011 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.996+0000 7f6f477fe700 1 --1- 172.21.15.158:0/960460373 >> v1:172.21.15.96:6789/0 conn(0x7f6f48096910 0x7f6f480b34a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.158:44940/0 (socket says 172.21.15.158:44940) 2019-12-05T03:50:48.011 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.996+0000 7f6f46ffd700 1 -- 172.21.15.158:0/960460373 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f4809c180 msgr2=0x7f6f4809c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:48.011 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.996+0000 7f6f46ffd700 1 --2- 172.21.15.158:0/960460373 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f4809c180 0x7f6f4809c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:48.011 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.996+0000 7f6f46ffd700 1 -- 172.21.15.158:0/960460373 >> v1:172.21.15.96:6789/0 conn(0x7f6f48096910 legacy=0x7f6f480b34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:48.011 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.996+0000 7f6f46ffd700 1 -- 172.21.15.158:0/960460373 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f4807e8c0 con 0x7f6f48099140 2019-12-05T03:50:48.011 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:47.996+0000 7f6f46ffd700 1 --2- 172.21.15.158:0/960460373 >> v2:172.21.15.96:3300/0 conn(0x7f6f48099140 0x7f6f4809bc30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6f48098170 tx=0x7f6f3000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.012 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.000+0000 7f6f46ffd700 1 --2- 172.21.15.158:0/960460373 >> v2:172.21.15.96:3300/0 conn(0x7f6f48099140 0x7f6f4809bc30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6f48098170 tx=0x7f6f3000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.012 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.000+0000 7f6f46ffd700 1 --2- 172.21.15.158:0/960460373 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f48099140 0x7f6f4809bc30 secure :-1 s=READY pgs=245 cs=0 l=1 rx=0x7f6f48098170 tx=0x7f6f3000fd30).ready entity=mon.0 client_cookie=c5207e949c2def1e server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:48.012 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.000+0000 7f6f46ffd700 1 --2- 172.21.15.158:0/960460373 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f48099140 0x7f6f4809bc30 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f6f48098170 tx=0x7f6f3000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.012 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.000+0000 7f6f467fc700 1 -- 172.21.15.158:0/960460373 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f300113b0 con 0x7f6f48099140 2019-12-05T03:50:48.013 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.000+0000 7f6f46ffd700 1 --2- 172.21.15.158:0/960460373 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f48099140 0x7f6f4809bc30 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f6f48098170 tx=0x7f6f3000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.013 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.000+0000 7f6f46ffd700 1 --2- 172.21.15.158:0/960460373 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f48099140 0x7f6f4809bc30 secure :-1 s=THROTTLE_DONE pgs=245 cs=0 l=1 rx=0x7f6f48098170 tx=0x7f6f3000fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.013 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.000+0000 7f6f467fc700 1 -- 172.21.15.158:0/960460373 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f30008bb0 con 0x7f6f48099140 2019-12-05T03:50:48.013 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.000+0000 7f6f467fc700 1 -- 172.21.15.158:0/960460373 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f30011990 con 0x7f6f48099140 2019-12-05T03:50:48.013 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.000+0000 7f6f4d579700 1 -- 172.21.15.158:0/960460373 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f48099140 msgr2=0x7f6f4809bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:48.013 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.000+0000 7f6f4d579700 1 --2- 172.21.15.158:0/960460373 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f48099140 0x7f6f4809bc30 secure :-1 s=READY pgs=245 cs=0 l=1 rx=0x7f6f48098170 tx=0x7f6f3000fd30).stop 2019-12-05T03:50:48.014 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.000+0000 7f6f4d579700 1 -- 172.21.15.158:0/960460373 shutdown_connections 2019-12-05T03:50:48.014 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.000+0000 7f6f4d579700 1 --2- 172.21.15.158:0/960460373 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f4809c180 0x7f6f4809c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:48.014 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.000+0000 7f6f4d579700 1 --2- 172.21.15.158:0/960460373 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f48099140 0x7f6f4809bc30 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:48.014 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.000+0000 7f6f4d579700 1 -- 172.21.15.158:0/960460373 shutdown_connections 2019-12-05T03:50:48.014 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.000+0000 7f6f4d579700 1 -- 172.21.15.158:0/960460373 wait complete. 2019-12-05T03:50:48.014 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.000+0000 7f6f4d579700 1 -- 172.21.15.158:0/960460373 >> 172.21.15.158:0/960460373 conn(0x7f6f4805d8a0 msgr2=0x7f6f4805dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:48.014 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.000+0000 7f6f4d579700 1 Processor -- start 2019-12-05T03:50:48.014 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.000+0000 7f6f4d579700 1 -- start start 2019-12-05T03:50:48.017 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.004+0000 7f6f4d579700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f480644b0 0x7f6f4805fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:48.018 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.004+0000 7f6f4d579700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6f481369f0 0x7f6f480b0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:48.018 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.004+0000 7f6f4d579700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f480b1d80 con 0x7f6f480b0b80 2019-12-05T03:50:48.018 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.004+0000 7f6f4d579700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f48060ed0 con 0x7f6f481369f0 2019-12-05T03:50:48.018 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.004+0000 7f6f4d579700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f48061170 con 0x7f6f480644b0 2019-12-05T03:50:48.018 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.004+0000 7f6f477fe700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f480644b0 0x7f6f4805fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:48.018 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.004+0000 7f6f477fe700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f480644b0 0x7f6f4805fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.158:37772/0 (socket says 172.21.15.158:37772) 2019-12-05T03:50:48.018 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.004+0000 7f6f46ffd700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6f481369f0 0x7f6f480b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:48.019 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.004+0000 7f6f477fe700 1 -- 172.21.15.158:0/707404366 learned_addr learned my addr 172.21.15.158:0/707404366 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:48.019 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.004+0000 7f6f477fe700 1 -- 172.21.15.158:0/707404366 >> v2:172.21.15.96:3300/0 conn(0x7f6f481369f0 msgr2=0x7f6f480b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:48.019 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.004+0000 7f6f477fe700 1 --2- 172.21.15.158:0/707404366 >> v2:172.21.15.96:3300/0 conn(0x7f6f481369f0 0x7f6f480b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:48.019 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.004+0000 7f6f477fe700 1 -- 172.21.15.158:0/707404366 >> v1:172.21.15.96:6789/0 conn(0x7f6f480b0b80 legacy=0x7f6f480b1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:48.019 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.004+0000 7f6f477fe700 1 -- 172.21.15.158:0/707404366 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f480616b0 con 0x7f6f480644b0 2019-12-05T03:50:48.019 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.004+0000 7f6f477fe700 1 --2- 172.21.15.158:0/707404366 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f480644b0 0x7f6f4805fa80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6f40000e90 tx=0x7f6f400109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.019 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.004+0000 7f6f477fe700 1 --2- 172.21.15.158:0/707404366 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f480644b0 0x7f6f4805fa80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6f40000e90 tx=0x7f6f400109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.019 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.004+0000 7f6f477fe700 1 --2- 172.21.15.158:0/707404366 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f480644b0 0x7f6f4805fa80 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f6f40000e90 tx=0x7f6f400109f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:48.020 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.004+0000 7f6f477fe700 1 --2- 172.21.15.158:0/707404366 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f480644b0 0x7f6f4805fa80 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f6f40000e90 tx=0x7f6f400109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.020 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.004+0000 7f6f3ffff700 1 -- 172.21.15.158:0/707404366 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f4000d860 con 0x7f6f480644b0 2019-12-05T03:50:48.020 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.004+0000 7f6f477fe700 1 --2- 172.21.15.158:0/707404366 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f480644b0 0x7f6f4805fa80 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f6f40000e90 tx=0x7f6f400109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.020 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.004+0000 7f6f3ffff700 1 -- 172.21.15.158:0/707404366 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4000d480 con 0x7f6f480644b0 2019-12-05T03:50:48.020 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.004+0000 7f6f477fe700 1 --2- 172.21.15.158:0/707404366 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f480644b0 0x7f6f4805fa80 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f6f40000e90 tx=0x7f6f400109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.020 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.004+0000 7f6f3ffff700 1 -- 172.21.15.158:0/707404366 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f4000c3e0 con 0x7f6f480644b0 2019-12-05T03:50:48.021 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.004+0000 7f6f4d579700 1 -- 172.21.15.158:0/707404366 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f48061920 con 0x7f6f480644b0 2019-12-05T03:50:48.021 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.004+0000 7f6f4d579700 1 -- 172.21.15.158:0/707404366 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f48061ed0 con 0x7f6f480644b0 2019-12-05T03:50:48.021 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.004+0000 7f6f477fe700 1 --2- 172.21.15.158:0/707404366 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f480644b0 0x7f6f4805fa80 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f6f40000e90 tx=0x7f6f400109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.021 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.004+0000 7f6f3ffff700 1 -- 172.21.15.158:0/707404366 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f6f4000c6c0 con 0x7f6f480644b0 2019-12-05T03:50:48.021 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.004+0000 7f6f477fe700 1 --2- 172.21.15.158:0/707404366 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f480644b0 0x7f6f4805fa80 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f6f40000e90 tx=0x7f6f400109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.021 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.008+0000 7f6f3ffff700 1 --2- 172.21.15.158:0/707404366 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f6f2003ada0 0x7f6f2003d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:48.021 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.008+0000 7f6f3ffff700 1 -- 172.21.15.158:0/707404366 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f6f4004b300 con 0x7f6f480644b0 2019-12-05T03:50:48.021 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.008+0000 7f6f46ffd700 1 --2- 172.21.15.158:0/707404366 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f6f2003ada0 0x7f6f2003d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:48.022 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.008+0000 7f6f46ffd700 1 --2- 172.21.15.158:0/707404366 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f6f2003ada0 0x7f6f2003d2b0 crc :-1 s=READY pgs=158 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:48.022 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.012+0000 7f6f4d579700 1 -- 172.21.15.158:0/707404366 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f480554e0 con 0x7f6f480644b0 2019-12-05T03:50:48.028 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.020+0000 7f6f477fe700 1 --2- 172.21.15.158:0/707404366 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f480644b0 0x7f6f4805fa80 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f6f40000e90 tx=0x7f6f400109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.029 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.020+0000 7f6f3ffff700 1 -- 172.21.15.158:0/707404366 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f6f400322c0 con 0x7f6f480644b0 2019-12-05T03:50:48.195 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.188+0000 7f6f4d579700 1 -- 172.21.15.158:0/707404366 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f6f48060cb0 con 0x7f6f480644b0 2019-12-05T03:50:48.204 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.196+0000 7f6f477fe700 1 --2- 172.21.15.158:0/707404366 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f480644b0 0x7f6f4805fa80 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7f6f40000e90 tx=0x7f6f400109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.204 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.196+0000 7f6f3ffff700 1 -- 172.21.15.158:0/707404366 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.3", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.3 v16) v1 ==== 184+0+0 (secure 0 0 0) 0x7f6f40010220 con 0x7f6f480644b0 2019-12-05T03:50:48.210 INFO:teuthology.orchestra.run.smithi158.stderr:updated caps for client.3 2019-12-05T03:50:48.214 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.208+0000 7f6f4d579700 1 -- 172.21.15.158:0/707404366 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f6f2003ada0 msgr2=0x7f6f2003d2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:48.214 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.208+0000 7f6f4d579700 1 --2- 172.21.15.158:0/707404366 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f6f2003ada0 0x7f6f2003d2b0 crc :-1 s=READY pgs=158 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:48.214 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.208+0000 7f6f4d579700 1 -- 172.21.15.158:0/707404366 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f480644b0 msgr2=0x7f6f4805fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:48.214 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.208+0000 7f6f4d579700 1 --2- 172.21.15.158:0/707404366 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f480644b0 0x7f6f4805fa80 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7f6f40000e90 tx=0x7f6f400109f0).stop 2019-12-05T03:50:48.214 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.208+0000 7f6f4d579700 1 -- 172.21.15.158:0/707404366 shutdown_connections 2019-12-05T03:50:48.214 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.208+0000 7f6f4d579700 1 --2- 172.21.15.158:0/707404366 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f6f2003ada0 0x7f6f2003d2b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:48.214 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.208+0000 7f6f4d579700 1 --2- 172.21.15.158:0/707404366 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6f480644b0 0x7f6f4805fa80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:48.215 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.208+0000 7f6f4d579700 1 --2- 172.21.15.158:0/707404366 >> v2:172.21.15.96:3300/0 conn(0x7f6f481369f0 0x7f6f480b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:48.215 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.208+0000 7f6f4d579700 1 -- 172.21.15.158:0/707404366 shutdown_connections 2019-12-05T03:50:48.215 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.208+0000 7f6f4d579700 1 -- 172.21.15.158:0/707404366 wait complete. 2019-12-05T03:50:48.215 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.208+0000 7f6f4d579700 1 -- 172.21.15.158:0/707404366 >> 172.21.15.158:0/707404366 conn(0x7f6f4805a180 msgr2=0x7f6f480593f0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:48.225 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-12-05T03:50:48.332 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.320+0000 7f685e577700 1 Processor -- start 2019-12-05T03:50:48.332 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.320+0000 7f685e577700 1 -- start start 2019-12-05T03:50:48.333 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.320+0000 7f685e577700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f685809a320 0x7f685805a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:48.333 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.320+0000 7f685e577700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f68581553b0 0x7f68581557e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:48.333 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.320+0000 7f685e577700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68580accb0 con 0x7f685809cf60 2019-12-05T03:50:48.333 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.320+0000 7f685e577700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f685809a750 con 0x7f68581553b0 2019-12-05T03:50:48.333 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.320+0000 7f685e577700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68580b1730 con 0x7f685809a320 2019-12-05T03:50:48.333 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.320+0000 7f6857fff700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f685809a320 0x7f685805a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:48.333 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.320+0000 7f685d315700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f68581553b0 0x7f68581557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:48.334 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.320+0000 7f6857fff700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f685809a320 0x7f685805a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.158:37782/0 (socket says 172.21.15.158:37782) 2019-12-05T03:50:48.334 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.320+0000 7f6857fff700 1 -- 172.21.15.158:0/1930641032 learned_addr learned my addr 172.21.15.158:0/1930641032 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:48.334 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.320+0000 7f6857fff700 1 -- 172.21.15.158:0/1930641032 >> v2:172.21.15.96:3300/0 conn(0x7f68581553b0 msgr2=0x7f68581557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:48.334 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.320+0000 7f6857fff700 1 --2- 172.21.15.158:0/1930641032 >> v2:172.21.15.96:3300/0 conn(0x7f68581553b0 0x7f68581557e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:48.334 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.320+0000 7f6857fff700 1 -- 172.21.15.158:0/1930641032 >> v1:172.21.15.96:6789/0 conn(0x7f685809cf60 legacy=0x7f6858151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:48.334 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.324+0000 7f6857fff700 1 -- 172.21.15.158:0/1930641032 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68580b6980 con 0x7f685809a320 2019-12-05T03:50:48.335 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.324+0000 7f6857fff700 1 --2- 172.21.15.158:0/1930641032 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f685809a320 0x7f685805a740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6848008790 tx=0x7f684800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.335 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.324+0000 7f6857fff700 1 --2- 172.21.15.158:0/1930641032 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f685809a320 0x7f685805a740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6848008790 tx=0x7f684800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.335 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.324+0000 7f6857fff700 1 --2- 172.21.15.158:0/1930641032 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f685809a320 0x7f685805a740 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f6848008790 tx=0x7f684800fd30).ready entity=mon.2 client_cookie=3611c2ffb7ec18c3 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:48.335 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.324+0000 7f6857fff700 1 --2- 172.21.15.158:0/1930641032 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f685809a320 0x7f685805a740 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f6848008790 tx=0x7f684800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.335 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.324+0000 7f68577fe700 1 -- 172.21.15.158:0/1930641032 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68480113b0 con 0x7f685809a320 2019-12-05T03:50:48.336 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.324+0000 7f6857fff700 1 --2- 172.21.15.158:0/1930641032 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f685809a320 0x7f685805a740 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f6848008790 tx=0x7f684800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.336 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.324+0000 7f68577fe700 1 -- 172.21.15.158:0/1930641032 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6848008bb0 con 0x7f685809a320 2019-12-05T03:50:48.336 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.324+0000 7f6857fff700 1 --2- 172.21.15.158:0/1930641032 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f685809a320 0x7f685805a740 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f6848008790 tx=0x7f684800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.336 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.324+0000 7f68577fe700 1 -- 172.21.15.158:0/1930641032 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6848011990 con 0x7f685809a320 2019-12-05T03:50:48.336 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.324+0000 7f685e577700 1 -- 172.21.15.158:0/1930641032 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f685809a320 msgr2=0x7f685805a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:48.336 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.324+0000 7f685e577700 1 --2- 172.21.15.158:0/1930641032 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f685809a320 0x7f685805a740 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f6848008790 tx=0x7f684800fd30).stop 2019-12-05T03:50:48.337 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.324+0000 7f685e577700 1 -- 172.21.15.158:0/1930641032 shutdown_connections 2019-12-05T03:50:48.337 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.324+0000 7f685e577700 1 --2- 172.21.15.158:0/1930641032 >> v2:172.21.15.96:3300/0 conn(0x7f68581553b0 0x7f68581557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:48.337 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.324+0000 7f685e577700 1 --2- 172.21.15.158:0/1930641032 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f685809a320 0x7f685805a740 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:48.337 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.324+0000 7f685e577700 1 -- 172.21.15.158:0/1930641032 shutdown_connections 2019-12-05T03:50:48.337 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.324+0000 7f685e577700 1 -- 172.21.15.158:0/1930641032 wait complete. 2019-12-05T03:50:48.337 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.324+0000 7f685e577700 1 -- 172.21.15.158:0/1930641032 >> 172.21.15.158:0/1930641032 conn(0x7f68580b7e60 msgr2=0x7f68580b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:48.341 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.324+0000 7f685e577700 1 Processor -- start 2019-12-05T03:50:48.341 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.328+0000 7f685e577700 1 -- start start 2019-12-05T03:50:48.341 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.328+0000 7f685e577700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6858152b60 0x7f6858130c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:48.341 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.328+0000 7f685e577700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f685813fc90 0x7f68581400c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:48.342 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.328+0000 7f685e577700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68580ad670 con 0x7f68580ad240 2019-12-05T03:50:48.342 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.328+0000 7f685e577700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6858130710 con 0x7f685813fc90 2019-12-05T03:50:48.342 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.328+0000 7f685e577700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68581309b0 con 0x7f6858152b60 2019-12-05T03:50:48.342 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.328+0000 7f685cb14700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6858152b60 0x7f6858130c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:48.342 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.328+0000 7f685cb14700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6858152b60 0x7f6858130c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.158:37792/0 (socket says 172.21.15.158:37792) 2019-12-05T03:50:48.342 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.328+0000 7f685cb14700 1 -- 172.21.15.158:0/1108318062 learned_addr learned my addr 172.21.15.158:0/1108318062 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:48.343 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.328+0000 7f685d315700 1 --2- 172.21.15.158:0/1108318062 >> v2:172.21.15.96:3300/0 conn(0x7f685813fc90 0x7f68581400c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:48.343 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.328+0000 7f685cb14700 1 -- 172.21.15.158:0/1108318062 >> v2:172.21.15.96:3300/0 conn(0x7f685813fc90 msgr2=0x7f68581400c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:48.343 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.328+0000 7f685cb14700 1 --2- 172.21.15.158:0/1108318062 >> v2:172.21.15.96:3300/0 conn(0x7f685813fc90 0x7f68581400c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:48.343 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.328+0000 7f685cb14700 1 -- 172.21.15.158:0/1108318062 >> v1:172.21.15.96:6789/0 conn(0x7f68580ad240 legacy=0x7f685809b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:48.343 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.328+0000 7f68557fa700 1 -- 172.21.15.158:0/1108318062 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2903047580 0 0) 0x7f6848008470 con 0x7f68580ad240 2019-12-05T03:50:48.343 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.328+0000 7f685cb14700 1 -- 172.21.15.158:0/1108318062 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68581303e0 con 0x7f6858152b60 2019-12-05T03:50:48.343 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.328+0000 7f685d315700 1 --2- 172.21.15.158:0/1108318062 >> v2:172.21.15.96:3300/0 conn(0x7f685813fc90 0x7f68581400c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:50:48.344 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.328+0000 7f685cb14700 1 --2- 172.21.15.158:0/1108318062 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6858152b60 0x7f6858130c50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f684c000e90 tx=0x7f684c0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.344 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.328+0000 7f685cb14700 1 --2- 172.21.15.158:0/1108318062 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6858152b60 0x7f6858130c50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f684c000e90 tx=0x7f684c0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.344 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.328+0000 7f685cb14700 1 --2- 172.21.15.158:0/1108318062 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6858152b60 0x7f6858130c50 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f684c000e90 tx=0x7f684c0109a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:48.344 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.328+0000 7f685cb14700 1 --2- 172.21.15.158:0/1108318062 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6858152b60 0x7f6858130c50 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f684c000e90 tx=0x7f684c0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.344 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.328+0000 7f68557fa700 1 -- 172.21.15.158:0/1108318062 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f684c00caa0 con 0x7f6858152b60 2019-12-05T03:50:48.344 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.328+0000 7f685e577700 1 -- 172.21.15.158:0/1108318062 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6858140610 con 0x7f6858152b60 2019-12-05T03:50:48.344 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.328+0000 7f685cb14700 1 --2- 172.21.15.158:0/1108318062 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6858152b60 0x7f6858130c50 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f684c000e90 tx=0x7f684c0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.345 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.328+0000 7f68557fa700 1 -- 172.21.15.158:0/1108318062 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684c00c6c0 con 0x7f6858152b60 2019-12-05T03:50:48.345 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.328+0000 7f685cb14700 1 --2- 172.21.15.158:0/1108318062 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6858152b60 0x7f6858130c50 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f684c000e90 tx=0x7f684c0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.345 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.328+0000 7f68557fa700 1 -- 172.21.15.158:0/1108318062 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f684c012210 con 0x7f6858152b60 2019-12-05T03:50:48.345 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.328+0000 7f685e577700 1 -- 172.21.15.158:0/1108318062 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6858073cf0 con 0x7f6858152b60 2019-12-05T03:50:48.345 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.332+0000 7f685cb14700 1 --2- 172.21.15.158:0/1108318062 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6858152b60 0x7f6858130c50 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f684c000e90 tx=0x7f684c0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.345 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.332+0000 7f685cb14700 1 --2- 172.21.15.158:0/1108318062 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6858152b60 0x7f6858130c50 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f684c000e90 tx=0x7f684c0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.345 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.332+0000 7f68557fa700 1 -- 172.21.15.158:0/1108318062 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f684c0124b0 con 0x7f6858152b60 2019-12-05T03:50:48.346 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.332+0000 7f68557fa700 1 --2- 172.21.15.158:0/1108318062 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f683803ac10 0x7f683803d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:48.346 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.332+0000 7f68557fa700 1 -- 172.21.15.158:0/1108318062 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f684c04b2f0 con 0x7f6858152b60 2019-12-05T03:50:48.346 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.332+0000 7f6857fff700 1 --2- 172.21.15.158:0/1108318062 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f683803ac10 0x7f683803d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:48.346 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.332+0000 7f6857fff700 1 --2- 172.21.15.158:0/1108318062 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f683803ac10 0x7f683803d120 crc :-1 s=READY pgs=160 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:48.347 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.336+0000 7f685e577700 1 -- 172.21.15.158:0/1108318062 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68580554e0 con 0x7f6858152b60 2019-12-05T03:50:48.352 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.344+0000 7f685cb14700 1 --2- 172.21.15.158:0/1108318062 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6858152b60 0x7f6858130c50 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f684c000e90 tx=0x7f684c0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.352 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.344+0000 7f68557fa700 1 -- 172.21.15.158:0/1108318062 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f684c0322b0 con 0x7f6858152b60 2019-12-05T03:50:48.521 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.508+0000 7f685e577700 1 -- 172.21.15.158:0/1108318062 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6858156200 con 0x7f6858152b60 2019-12-05T03:50:48.521 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.512+0000 7f685cb14700 1 --2- 172.21.15.158:0/1108318062 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6858152b60 0x7f6858130c50 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f684c000e90 tx=0x7f684c0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.521 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.512+0000 7f68557fa700 1 -- 172.21.15.158:0/1108318062 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+1773 (secure 0 0 0) 0x7f684c032510 con 0x7f6858152b60 2019-12-05T03:50:48.521 INFO:teuthology.orchestra.run.smithi158.stderr:dumped fsmap epoch 14 2019-12-05T03:50:48.522 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:48.522 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-12-05T03:50:44.549123+0000","modified":"2019-12-05T03:50:48.261168+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5095},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5095":{"gid":5095,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":2,"addr":"172.21.15.158:6833/2078196109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":2078196109},{"type":"v1","addr":"172.21.15.158:6833","nonce":2078196109}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2019-12-05T03:50:48.523 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.516+0000 7f685e577700 1 -- 172.21.15.158:0/1108318062 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f683803ac10 msgr2=0x7f683803d120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:48.523 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.516+0000 7f685e577700 1 --2- 172.21.15.158:0/1108318062 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f683803ac10 0x7f683803d120 crc :-1 s=READY pgs=160 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:48.524 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.516+0000 7f685e577700 1 -- 172.21.15.158:0/1108318062 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6858152b60 msgr2=0x7f6858130c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:48.524 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.516+0000 7f685e577700 1 --2- 172.21.15.158:0/1108318062 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6858152b60 0x7f6858130c50 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f684c000e90 tx=0x7f684c0109a0).stop 2019-12-05T03:50:48.524 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.516+0000 7f685e577700 1 -- 172.21.15.158:0/1108318062 shutdown_connections 2019-12-05T03:50:48.524 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.516+0000 7f685e577700 1 --2- 172.21.15.158:0/1108318062 >> v2:172.21.15.96:3300/0 conn(0x7f685813fc90 0x7f68581400c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:48.524 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.516+0000 7f685e577700 1 --2- 172.21.15.158:0/1108318062 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f6858152b60 0x7f6858130c50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:48.524 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.516+0000 7f685e577700 1 --2- 172.21.15.158:0/1108318062 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f683803ac10 0x7f683803d120 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:48.525 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.516+0000 7f685e577700 1 -- 172.21.15.158:0/1108318062 shutdown_connections 2019-12-05T03:50:48.525 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.516+0000 7f685e577700 1 -- 172.21.15.158:0/1108318062 wait complete. 2019-12-05T03:50:48.525 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.516+0000 7f685e577700 1 -- 172.21.15.158:0/1108318062 >> 172.21.15.158:0/1108318062 conn(0x7f6858068f30 msgr2=0x7f68580593f0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:48.734 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 5095}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 4, u'failed': [], u'epoch': 14, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [5], u'info': {u'gid_5095': {u'export_targets': [], u'name': u'a', u'incarnation': 13, u'state_seq': 2, u'state': u'up:active', u'gid': 5095, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 2078196109, u'type': u'v2', u'addr': u'172.21.15.158:6832'}, {u'nonce': 2078196109, u'type': u'v1', u'addr': u'172.21.15.158:6833'}]}, u'addr': u'172.21.15.158:6833/2078196109'}}, u'fs_name': u'cephfs', u'created': u'2019-12-05T03:50:44.549123+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-12-05T03:50:48.261168+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-12-05T03:50:48.735 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-12-05T03:50:48.735 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2019-12-05T03:50:48.827 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2019-12-05T03:50:48.828 INFO:teuthology.orchestra.run.smithi158.stdout: "cluster_fsid": "a91186ae-f496-4de1-918d-820c55ff1feb", 2019-12-05T03:50:48.828 INFO:teuthology.orchestra.run.smithi158.stdout: "whoami": 0, 2019-12-05T03:50:48.828 INFO:teuthology.orchestra.run.smithi158.stdout: "id": 5095, 2019-12-05T03:50:48.829 INFO:teuthology.orchestra.run.smithi158.stdout: "want_state": "up:active", 2019-12-05T03:50:48.829 INFO:teuthology.orchestra.run.smithi158.stdout: "state": "up:active", 2019-12-05T03:50:48.829 INFO:teuthology.orchestra.run.smithi158.stdout: "rank_uptime": 1.562617618, 2019-12-05T03:50:48.829 INFO:teuthology.orchestra.run.smithi158.stdout: "mdsmap_epoch": 14, 2019-12-05T03:50:48.829 INFO:teuthology.orchestra.run.smithi158.stdout: "osdmap_epoch": 32, 2019-12-05T03:50:48.830 INFO:teuthology.orchestra.run.smithi158.stdout: "osdmap_epoch_barrier": 32, 2019-12-05T03:50:48.830 INFO:teuthology.orchestra.run.smithi158.stdout: "uptime": 1.8461053489999999 2019-12-05T03:50:48.830 INFO:teuthology.orchestra.run.smithi158.stdout:} 2019-12-05T03:50:48.834 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "a91186ae-f496-4de1-918d-820c55ff1feb", "whoami": 0, "id": 5095, "want_state": "up:active", "state": "up:active", "rank_uptime": 1.562617618, "mdsmap_epoch": 14, "osdmap_epoch": 32, "osdmap_epoch_barrier": 32, "uptime": 1.8461053489999999 } 2019-12-05T03:50:48.835 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-05T03:50:48.938 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.928+0000 7f180893a700 1 Processor -- start 2019-12-05T03:50:48.939 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.928+0000 7f180893a700 1 -- start start 2019-12-05T03:50:48.939 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.928+0000 7f180893a700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f180409cf50 0x7f180409a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:48.939 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.928+0000 7f180893a700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18040acca0 con 0x7f180405a730 2019-12-05T03:50:48.939 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.928+0000 7f180893a700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18040b6970 con 0x7f18041553a0 2019-12-05T03:50:48.939 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.928+0000 7f180893a700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18040b1720 con 0x7f180409cf50 2019-12-05T03:50:48.939 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.928+0000 7f180359e700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f18041553a0 0x7f18041557d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49840/0 (socket says 172.21.15.158:49840) 2019-12-05T03:50:48.940 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.928+0000 7f180359e700 1 -- 172.21.15.158:0/2356004749 learned_addr learned my addr 172.21.15.158:0/2356004749 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:48.940 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.928+0000 7f1802d9d700 1 --2- 172.21.15.158:0/2356004749 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f180409cf50 0x7f180409a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:48.940 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.928+0000 7f1801d9b700 1 -- 172.21.15.158:0/2356004749 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 881341641 0 0) 0x7f18040b6970 con 0x7f18041553a0 2019-12-05T03:50:48.940 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.928+0000 7f1801d9b700 1 -- 172.21.15.158:0/2356004749 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17f00030b0 con 0x7f18041553a0 2019-12-05T03:50:48.940 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.928+0000 7f1801d9b700 1 -- 172.21.15.158:0/2356004749 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1802959016 0 0) 0x7f18040acca0 con 0x7f180405a730 2019-12-05T03:50:48.940 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.928+0000 7f1801d9b700 1 -- 172.21.15.158:0/2356004749 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18040b6970 con 0x7f180405a730 2019-12-05T03:50:48.940 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.928+0000 7f1802d9d700 1 -- 172.21.15.158:0/2356004749 >> v1:172.21.15.158:6789/0 conn(0x7f18041553a0 legacy=0x7f18041557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:48.941 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.928+0000 7f1802d9d700 1 -- 172.21.15.158:0/2356004749 >> v1:172.21.15.96:6789/0 conn(0x7f180405a730 legacy=0x7f1804151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:48.941 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.928+0000 7f1802d9d700 1 -- 172.21.15.158:0/2356004749 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180405ab60 con 0x7f180409cf50 2019-12-05T03:50:48.941 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.928+0000 7f1802d9d700 1 --2- 172.21.15.158:0/2356004749 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f180409cf50 0x7f180409a310 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f17f4002f30 tx=0x7f17f400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.941 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.928+0000 7f1802d9d700 1 --2- 172.21.15.158:0/2356004749 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f180409cf50 0x7f180409a310 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f17f4002f30 tx=0x7f17f400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.941 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.928+0000 7f1802d9d700 1 --2- 172.21.15.158:0/2356004749 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f180409cf50 0x7f180409a310 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7f17f4002f30 tx=0x7f17f400fbf0).ready entity=mon.2 client_cookie=62bf4390eade26cd server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:48.941 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.928+0000 7f1802d9d700 1 --2- 172.21.15.158:0/2356004749 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f180409cf50 0x7f180409a310 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f17f4002f30 tx=0x7f17f400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.941 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.928+0000 7f1801d9b700 1 -- 172.21.15.158:0/2356004749 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17f40112b0 con 0x7f180409cf50 2019-12-05T03:50:48.942 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.928+0000 7f1802d9d700 1 --2- 172.21.15.158:0/2356004749 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f180409cf50 0x7f180409a310 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f17f4002f30 tx=0x7f17f400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.942 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.928+0000 7f1801d9b700 1 -- 172.21.15.158:0/2356004749 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f4008bc0 con 0x7f180409cf50 2019-12-05T03:50:48.942 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.928+0000 7f1802d9d700 1 --2- 172.21.15.158:0/2356004749 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f180409cf50 0x7f180409a310 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7f17f4002f30 tx=0x7f17f400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.942 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.928+0000 7f180893a700 1 -- 172.21.15.158:0/2356004749 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f180409cf50 msgr2=0x7f180409a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:48.942 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.928+0000 7f1801d9b700 1 -- 172.21.15.158:0/2356004749 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17f4011890 con 0x7f180409cf50 2019-12-05T03:50:48.942 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.928+0000 7f180893a700 1 --2- 172.21.15.158:0/2356004749 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f180409cf50 0x7f180409a310 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7f17f4002f30 tx=0x7f17f400fbf0).stop 2019-12-05T03:50:48.942 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.932+0000 7f180893a700 1 -- 172.21.15.158:0/2356004749 shutdown_connections 2019-12-05T03:50:48.943 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.932+0000 7f180893a700 1 --2- 172.21.15.158:0/2356004749 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f180409cf50 0x7f180409a310 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:48.943 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.932+0000 7f180893a700 1 -- 172.21.15.158:0/2356004749 shutdown_connections 2019-12-05T03:50:48.943 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.932+0000 7f180893a700 1 -- 172.21.15.158:0/2356004749 wait complete. 2019-12-05T03:50:48.943 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.932+0000 7f180893a700 1 -- 172.21.15.158:0/2356004749 >> 172.21.15.158:0/2356004749 conn(0x7f18040b7e50 msgr2=0x7f18040b3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:48.946 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.932+0000 7f180893a700 1 Processor -- start 2019-12-05T03:50:48.946 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.932+0000 7f180893a700 1 -- start start 2019-12-05T03:50:48.946 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.936+0000 7f180893a700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f180407b730 0x7f18040b3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:48.946 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.936+0000 7f180893a700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f180413c0a0 0x7f180409ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:48.946 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.936+0000 7f180893a700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f180409a310 con 0x7f180409b1b0 2019-12-05T03:50:48.946 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.936+0000 7f180893a700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18040b2d50 con 0x7f180407b730 2019-12-05T03:50:48.946 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.936+0000 7f180893a700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18040b2ff0 con 0x7f180413c0a0 2019-12-05T03:50:48.947 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.936+0000 7f180259c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f180413c0a0 0x7f180409ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:48.947 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.936+0000 7f180259c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f180413c0a0 0x7f180409ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:55064/0 (socket says 172.21.15.158:55064) 2019-12-05T03:50:48.947 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.936+0000 7f1802d9d700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f180407b730 0x7f18040b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:48.947 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.936+0000 7f180259c700 1 -- 172.21.15.158:0/4187513114 learned_addr learned my addr 172.21.15.158:0/4187513114 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:48.947 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.936+0000 7f180259c700 1 -- 172.21.15.158:0/4187513114 >> v2:172.21.15.96:3300/0 conn(0x7f180407b730 msgr2=0x7f18040b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:48.947 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.936+0000 7f180259c700 1 --2- 172.21.15.158:0/4187513114 >> v2:172.21.15.96:3300/0 conn(0x7f180407b730 0x7f18040b3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:48.947 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.936+0000 7f180259c700 1 -- 172.21.15.158:0/4187513114 >> v1:172.21.15.96:6789/0 conn(0x7f180409b1b0 legacy=0x7f180413f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:48.948 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.936+0000 7f180259c700 1 -- 172.21.15.158:0/4187513114 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18040b2920 con 0x7f180413c0a0 2019-12-05T03:50:48.948 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.936+0000 7f180259c700 1 --2- 172.21.15.158:0/4187513114 >> v2:172.21.15.158:3300/0 conn(0x7f180413c0a0 0x7f180409ac60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1804000a80 tx=0x7f17ec010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.948 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.936+0000 7f180259c700 1 --2- 172.21.15.158:0/4187513114 >> v2:172.21.15.158:3300/0 conn(0x7f180413c0a0 0x7f180409ac60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1804000a80 tx=0x7f17ec010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.948 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.936+0000 7f180259c700 1 --2- 172.21.15.158:0/4187513114 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f180413c0a0 0x7f180409ac60 secure :-1 s=READY pgs=348 cs=0 l=1 rx=0x7f1804000a80 tx=0x7f17ec010d20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:48.948 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.936+0000 7f180259c700 1 --2- 172.21.15.158:0/4187513114 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f180413c0a0 0x7f180409ac60 secure :-1 s=THROTTLE_DONE pgs=348 cs=0 l=1 rx=0x7f1804000a80 tx=0x7f17ec010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.948 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.936+0000 7f17fb7fe700 1 -- 172.21.15.158:0/4187513114 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17ec012320 con 0x7f180413c0a0 2019-12-05T03:50:48.948 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.936+0000 7f180259c700 1 --2- 172.21.15.158:0/4187513114 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f180413c0a0 0x7f180409ac60 secure :-1 s=THROTTLE_DONE pgs=348 cs=0 l=1 rx=0x7f1804000a80 tx=0x7f17ec010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.949 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.936+0000 7f180259c700 1 --2- 172.21.15.158:0/4187513114 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f180413c0a0 0x7f180409ac60 secure :-1 s=THROTTLE_DONE pgs=348 cs=0 l=1 rx=0x7f1804000a80 tx=0x7f17ec010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.949 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.936+0000 7f17fb7fe700 1 -- 172.21.15.158:0/4187513114 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17ec00ca40 con 0x7f180413c0a0 2019-12-05T03:50:48.949 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.936+0000 7f180893a700 1 -- 172.21.15.158:0/4187513114 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f180413fe60 con 0x7f180413c0a0 2019-12-05T03:50:48.949 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.936+0000 7f17fb7fe700 1 -- 172.21.15.158:0/4187513114 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17ec012900 con 0x7f180413c0a0 2019-12-05T03:50:48.949 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.936+0000 7f180893a700 1 -- 172.21.15.158:0/4187513114 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1804140410 con 0x7f180413c0a0 2019-12-05T03:50:48.949 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.936+0000 7f180259c700 1 --2- 172.21.15.158:0/4187513114 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f180413c0a0 0x7f180409ac60 secure :-1 s=THROTTLE_DONE pgs=348 cs=0 l=1 rx=0x7f1804000a80 tx=0x7f17ec010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.949 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.940+0000 7f17fb7fe700 1 -- 172.21.15.158:0/4187513114 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f17ec012bd0 con 0x7f180413c0a0 2019-12-05T03:50:48.950 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.940+0000 7f180259c700 1 --2- 172.21.15.158:0/4187513114 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f180413c0a0 0x7f180409ac60 secure :-1 s=THROTTLE_DONE pgs=348 cs=0 l=1 rx=0x7f1804000a80 tx=0x7f17ec010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.950 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.940+0000 7f17fb7fe700 1 --2- 172.21.15.158:0/4187513114 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f17e803ad20 0x7f17e803d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:48.950 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.940+0000 7f17fb7fe700 1 -- 172.21.15.158:0/4187513114 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f17ec04b470 con 0x7f180413c0a0 2019-12-05T03:50:48.950 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.940+0000 7f1802d9d700 1 --2- 172.21.15.158:0/4187513114 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f17e803ad20 0x7f17e803d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:48.951 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.940+0000 7f1802d9d700 1 --2- 172.21.15.158:0/4187513114 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f17e803ad20 0x7f17e803d230 crc :-1 s=READY pgs=161 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:48.951 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.944+0000 7f180893a700 1 -- 172.21.15.158:0/4187513114 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18040554d0 con 0x7f180413c0a0 2019-12-05T03:50:48.962 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.956+0000 7f180259c700 1 --2- 172.21.15.158:0/4187513114 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f180413c0a0 0x7f180409ac60 secure :-1 s=THROTTLE_DONE pgs=348 cs=0 l=1 rx=0x7f1804000a80 tx=0x7f17ec010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:48.962 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:48.956+0000 7f17fb7fe700 1 -- 172.21.15.158:0/4187513114 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f17ec0324f0 con 0x7f180413c0a0 2019-12-05T03:50:49.126 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.120+0000 7f180893a700 1 -- 172.21.15.158:0/4187513114 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f180405a940 con 0x7f180413c0a0 2019-12-05T03:50:49.128 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.120+0000 7f180259c700 1 --2- 172.21.15.158:0/4187513114 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f180413c0a0 0x7f180409ac60 secure :-1 s=THROTTLE_DONE pgs=348 cs=0 l=1 rx=0x7f1804000a80 tx=0x7f17ec010d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.128 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.120+0000 7f17fb7fe700 1 -- 172.21.15.158:0/4187513114 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+14905 (secure 0 0 0) 0x7f17ec032750 con 0x7f180413c0a0 2019-12-05T03:50:49.129 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:49.130 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":32,"fsid":"a91186ae-f496-4de1-918d-820c55ff1feb","created":"2019-12-05T03:49:39.187523+0000","modified":"2019-12-05T03:50:45.552171+0000","last_up_change":"2019-12-05T03:49:48.551934+0000","last_in_change":"2019-12-05T03:49:48.551934+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-05T03:49:52.900870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2019-12-05T03:50:42.436744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2019-12-05T03:50:43.620710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"782c4258-e28c-4a11-9d54-3c9c7a36fba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":12192},{"type":"v1","addr":"172.21.15.158:6801","nonce":12192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":12192},{"type":"v1","addr":"172.21.15.158:6803","nonce":12192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":12192},{"type":"v1","addr":"172.21.15.158:6807","nonce":12192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":12192},{"type":"v1","addr":"172.21.15.158:6805","nonce":12192}]},"public_addr":"172.21.15.158:6801/12192","cluster_addr":"172.21.15.158:6803/12192","heartbeat_back_addr":"172.21.15.158:6807/12192","heartbeat_front_addr":"172.21.15.158:6805/12192","state":["exists","up"]},{"osd":1,"uuid":"d4426b21-b666-4158-bf34-a24b14572731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":12193},{"type":"v1","addr":"172.21.15.158:6809","nonce":12193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":12193},{"type":"v1","addr":"172.21.15.158:6811","nonce":12193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":12193},{"type":"v1","addr":"172.21.15.158:6815","nonce":12193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":12193},{"type":"v1","addr":"172.21.15.158:6813","nonce":12193}]},"public_addr":"172.21.15.158:6809/12193","cluster_addr":"172.21.15.158:6811/12193","heartbeat_back_addr":"172.21.15.158:6815/12193","heartbeat_front_addr":"172.21.15.158:6813/12193","state":["exists","up"]},{"osd":2,"uuid":"22680edd-6490-4ab0-bb15-0605830e4cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":12195},{"type":"v1","addr":"172.21.15.158:6825","nonce":12195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":12195},{"type":"v1","addr":"172.21.15.158:6827","nonce":12195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":12195},{"type":"v1","addr":"172.21.15.158:6831","nonce":12195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":12195},{"type":"v1","addr":"172.21.15.158:6829","nonce":12195}]},"public_addr":"172.21.15.158:6825/12195","cluster_addr":"172.21.15.158:6827/12195","heartbeat_back_addr":"172.21.15.158:6831/12195","heartbeat_front_addr":"172.21.15.158:6829/12195","state":["exists","up"]},{"osd":3,"uuid":"7ec999ee-ace8-4ccb-a4f9-6f5d313bbbd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":12194},{"type":"v1","addr":"172.21.15.158:6817","nonce":12194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":12194},{"type":"v1","addr":"172.21.15.158:6819","nonce":12194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":12194},{"type":"v1","addr":"172.21.15.158:6823","nonce":12194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":12194},{"type":"v1","addr":"172.21.15.158:6821","nonce":12194}]},"public_addr":"172.21.15.158:6817/12194","cluster_addr":"172.21.15.158:6819/12194","heartbeat_back_addr":"172.21.15.158:6823/12194","heartbeat_front_addr":"172.21.15.158:6821/12194","state":["exists","up"]},{"osd":4,"uuid":"186e69c4-b69f-4dd1-bb8f-faf759c60484","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":12460},{"type":"v1","addr":"172.21.15.96:6803","nonce":12460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":12460},{"type":"v1","addr":"172.21.15.96:6805","nonce":12460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":12460},{"type":"v1","addr":"172.21.15.96:6809","nonce":12460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":12460},{"type":"v1","addr":"172.21.15.96:6807","nonce":12460}]},"public_addr":"172.21.15.96:6803/12460","cluster_addr":"172.21.15.96:6805/12460","heartbeat_back_addr":"172.21.15.96:6809/12460","heartbeat_front_addr":"172.21.15.96:6807/12460","state":["exists","up"]},{"osd":5,"uuid":"86b658b2-8b40-4cea-8163-305a3982758b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":12461},{"type":"v1","addr":"172.21.15.96:6811","nonce":12461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":12461},{"type":"v1","addr":"172.21.15.96:6813","nonce":12461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":12461},{"type":"v1","addr":"172.21.15.96:6817","nonce":12461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":12461},{"type":"v1","addr":"172.21.15.96:6815","nonce":12461}]},"public_addr":"172.21.15.96:6811/12461","cluster_addr":"172.21.15.96:6813/12461","heartbeat_back_addr":"172.21.15.96:6817/12461","heartbeat_front_addr":"172.21.15.96:6815/12461","state":["exists","up"]},{"osd":6,"uuid":"bdadaea8-9296-4788-bc59-d9c9eb8defdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":12463},{"type":"v1","addr":"172.21.15.96:6827","nonce":12463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":12463},{"type":"v1","addr":"172.21.15.96:6829","nonce":12463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":12463},{"type":"v1","addr":"172.21.15.96:6833","nonce":12463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":12463},{"type":"v1","addr":"172.21.15.96:6831","nonce":12463}]},"public_addr":"172.21.15.96:6827/12463","cluster_addr":"172.21.15.96:6829/12463","heartbeat_back_addr":"172.21.15.96:6833/12463","heartbeat_front_addr":"172.21.15.96:6831/12463","state":["exists","up"]},{"osd":7,"uuid":"c6d71846-d68e-430f-ab72-0fb8ea4bf640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":12462},{"type":"v1","addr":"172.21.15.96:6819","nonce":12462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":12462},{"type":"v1","addr":"172.21.15.96:6821","nonce":12462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":12462},{"type":"v1","addr":"172.21.15.96:6825","nonce":12462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":12462},{"type":"v1","addr":"172.21.15.96:6823","nonce":12462}]},"public_addr":"172.21.15.96:6819/12462","cluster_addr":"172.21.15.96:6821/12462","heartbeat_back_addr":"172.21.15.96:6825/12462","heartbeat_front_addr":"172.21.15.96:6823/12462","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.875762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.900817+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.210347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.133973+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.864697+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.131015+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.237225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.154377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-05T03:50:49.132 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.124+0000 7f180893a700 1 -- 172.21.15.158:0/4187513114 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f17e803ad20 msgr2=0x7f17e803d230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:49.132 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.124+0000 7f180893a700 1 --2- 172.21.15.158:0/4187513114 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f17e803ad20 0x7f17e803d230 crc :-1 s=READY pgs=161 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:49.132 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.124+0000 7f180893a700 1 -- 172.21.15.158:0/4187513114 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f180413c0a0 msgr2=0x7f180409ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:49.133 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.124+0000 7f180893a700 1 --2- 172.21.15.158:0/4187513114 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f180413c0a0 0x7f180409ac60 secure :-1 s=READY pgs=348 cs=0 l=1 rx=0x7f1804000a80 tx=0x7f17ec010d20).stop 2019-12-05T03:50:49.133 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.124+0000 7f180893a700 1 -- 172.21.15.158:0/4187513114 shutdown_connections 2019-12-05T03:50:49.133 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.124+0000 7f180893a700 1 --2- 172.21.15.158:0/4187513114 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f17e803ad20 0x7f17e803d230 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:49.133 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.124+0000 7f180893a700 1 --2- 172.21.15.158:0/4187513114 >> v2:172.21.15.96:3300/0 conn(0x7f180407b730 0x7f18040b3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:49.133 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.124+0000 7f180893a700 1 --2- 172.21.15.158:0/4187513114 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f180413c0a0 0x7f180409ac60 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:49.133 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.124+0000 7f180893a700 1 -- 172.21.15.158:0/4187513114 shutdown_connections 2019-12-05T03:50:49.133 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.124+0000 7f180893a700 1 -- 172.21.15.158:0/4187513114 wait complete. 2019-12-05T03:50:49.134 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.124+0000 7f180893a700 1 -- 172.21.15.158:0/4187513114 >> 172.21.15.158:0/4187513114 conn(0x7f18040b49f0 msgr2=0x7f18040b5500 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:49.142 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:49:52.900870+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:50:42.436744+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 4, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'31', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:50:43.620710+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 5, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'32', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-12-05T03:50:49.143 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-12-05T03:50:49.251 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.236+0000 7f5de13ac700 1 Processor -- start 2019-12-05T03:50:49.251 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.240+0000 7f5de13ac700 1 -- start start 2019-12-05T03:50:49.251 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.240+0000 7f5de13ac700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5ddc0b6970 0x7f5ddc09add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:49.251 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.240+0000 7f5de13ac700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5ddc09ba40 0x7f5ddc05a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:49.251 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.240+0000 7f5de13ac700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ddc099e30 con 0x7f5ddc05a950 2019-12-05T03:50:49.252 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.240+0000 7f5de13ac700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ddc09d210 con 0x7f5ddc09ba40 2019-12-05T03:50:49.252 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.240+0000 7f5de13ac700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc099b90 con 0x7f5ddc0b6970 2019-12-05T03:50:49.252 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.240+0000 7f5ddaffd700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5ddc09ba40 0x7f5ddc05a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:49.252 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.240+0000 7f5ddb7fe700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5ddc0b6970 0x7f5ddc09add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:49.252 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.240+0000 7f5ddaffd700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5ddc09ba40 0x7f5ddc05a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.158:41660/0 (socket says 172.21.15.158:41660) 2019-12-05T03:50:49.252 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.240+0000 7f5ddaffd700 1 -- 172.21.15.158:0/3479954692 learned_addr learned my addr 172.21.15.158:0/3479954692 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:49.253 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.240+0000 7f5ddbfff700 1 --1- 172.21.15.158:0/3479954692 >> v1:172.21.15.96:6789/0 conn(0x7f5ddc05a950 0x7f5ddc155290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.158:44986/0 (socket says 172.21.15.158:44986) 2019-12-05T03:50:49.253 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.240+0000 7f5ddb7fe700 1 -- 172.21.15.158:0/3479954692 >> v2:172.21.15.96:3300/0 conn(0x7f5ddc09ba40 msgr2=0x7f5ddc05a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:49.253 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.240+0000 7f5ddb7fe700 1 --2- 172.21.15.158:0/3479954692 >> v2:172.21.15.96:3300/0 conn(0x7f5ddc09ba40 0x7f5ddc05a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:49.253 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.240+0000 7f5ddb7fe700 1 -- 172.21.15.158:0/3479954692 >> v1:172.21.15.96:6789/0 conn(0x7f5ddc05a950 legacy=0x7f5ddc155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:49.253 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.240+0000 7f5ddb7fe700 1 -- 172.21.15.158:0/3479954692 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ddc07e960 con 0x7f5ddc0b6970 2019-12-05T03:50:49.253 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.240+0000 7f5ddaffd700 1 --2- 172.21.15.158:0/3479954692 >> v2:172.21.15.96:3300/0 conn(0x7f5ddc09ba40 0x7f5ddc05a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:50:49.253 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.240+0000 7f5ddb7fe700 1 --2- 172.21.15.158:0/3479954692 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5ddc0b6970 0x7f5ddc09add0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5dcc008b10 tx=0x7f5dcc00fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.254 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.240+0000 7f5ddb7fe700 1 --2- 172.21.15.158:0/3479954692 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5ddc0b6970 0x7f5ddc09add0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5dcc008b10 tx=0x7f5dcc00fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.254 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.240+0000 7f5ddb7fe700 1 --2- 172.21.15.158:0/3479954692 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5ddc0b6970 0x7f5ddc09add0 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f5dcc008b10 tx=0x7f5dcc00fff0).ready entity=mon.2 client_cookie=e894be665870fc30 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:49.254 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.240+0000 7f5ddb7fe700 1 --2- 172.21.15.158:0/3479954692 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5ddc0b6970 0x7f5ddc09add0 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f5dcc008b10 tx=0x7f5dcc00fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.254 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.240+0000 7f5dda7fc700 1 -- 172.21.15.158:0/3479954692 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5dcc010900 con 0x7f5ddc0b6970 2019-12-05T03:50:49.254 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.240+0000 7f5ddb7fe700 1 --2- 172.21.15.158:0/3479954692 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5ddc0b6970 0x7f5ddc09add0 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f5dcc008b10 tx=0x7f5dcc00fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.254 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.240+0000 7f5ddb7fe700 1 --2- 172.21.15.158:0/3479954692 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5ddc0b6970 0x7f5ddc09add0 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7f5dcc008b10 tx=0x7f5dcc00fff0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.255 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.240+0000 7f5dda7fc700 1 -- 172.21.15.158:0/3479954692 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dcc008b50 con 0x7f5ddc0b6970 2019-12-05T03:50:49.255 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.240+0000 7f5dda7fc700 1 -- 172.21.15.158:0/3479954692 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5dcc0110c0 con 0x7f5ddc0b6970 2019-12-05T03:50:49.255 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.240+0000 7f5de13ac700 1 -- 172.21.15.158:0/3479954692 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5ddc0b6970 msgr2=0x7f5ddc09add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:49.255 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.240+0000 7f5de13ac700 1 --2- 172.21.15.158:0/3479954692 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5ddc0b6970 0x7f5ddc09add0 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7f5dcc008b10 tx=0x7f5dcc00fff0).stop 2019-12-05T03:50:49.255 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.244+0000 7f5de13ac700 1 -- 172.21.15.158:0/3479954692 shutdown_connections 2019-12-05T03:50:49.255 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.244+0000 7f5de13ac700 1 --2- 172.21.15.158:0/3479954692 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5ddc0b6970 0x7f5ddc09add0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:49.256 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.244+0000 7f5de13ac700 1 --2- 172.21.15.158:0/3479954692 >> v2:172.21.15.96:3300/0 conn(0x7f5ddc09ba40 0x7f5ddc05a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:49.256 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.244+0000 7f5de13ac700 1 -- 172.21.15.158:0/3479954692 shutdown_connections 2019-12-05T03:50:49.256 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.244+0000 7f5de13ac700 1 -- 172.21.15.158:0/3479954692 wait complete. 2019-12-05T03:50:49.256 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.244+0000 7f5de13ac700 1 -- 172.21.15.158:0/3479954692 >> 172.21.15.158:0/3479954692 conn(0x7f5ddc0b7ef0 msgr2=0x7f5ddc0b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:49.260 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.248+0000 7f5de13ac700 1 Processor -- start 2019-12-05T03:50:49.260 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.248+0000 7f5de13ac700 1 -- start start 2019-12-05T03:50:49.260 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.248+0000 7f5de13ac700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5ddc13e950 0x7f5ddc059730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:49.261 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.248+0000 7f5de13ac700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5ddc13bb90 0x7f5ddc1529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:49.261 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.248+0000 7f5de13ac700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ddc07bb20 con 0x7f5ddc151c80 2019-12-05T03:50:49.261 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.248+0000 7f5de13ac700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ddc152470 con 0x7f5ddc13e950 2019-12-05T03:50:49.261 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.248+0000 7f5de13ac700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc152710 con 0x7f5ddc13bb90 2019-12-05T03:50:49.261 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.248+0000 7f5ddaffd700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5ddc13e950 0x7f5ddc059730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:49.261 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.248+0000 7f5ddbfff700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5ddc13bb90 0x7f5ddc1529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:49.261 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.248+0000 7f5ddaffd700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5ddc13e950 0x7f5ddc059730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.158:41668/0 (socket says 172.21.15.158:41668) 2019-12-05T03:50:49.262 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.248+0000 7f5ddaffd700 1 -- 172.21.15.158:0/2015838158 learned_addr learned my addr 172.21.15.158:0/2015838158 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:49.262 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.248+0000 7f5ddaffd700 1 -- 172.21.15.158:0/2015838158 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5ddc13bb90 msgr2=0x7f5ddc1529b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:49.262 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.248+0000 7f5ddaffd700 1 --2- 172.21.15.158:0/2015838158 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5ddc13bb90 0x7f5ddc1529b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:49.264 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.248+0000 7f5ddaffd700 1 -- 172.21.15.158:0/2015838158 >> v1:172.21.15.96:6789/0 conn(0x7f5ddc151c80 legacy=0x7f5ddc07b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:49.264 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.248+0000 7f5ddaffd700 1 -- 172.21.15.158:0/2015838158 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ddc13bfc0 con 0x7f5ddc13e950 2019-12-05T03:50:49.266 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.248+0000 7f5ddaffd700 1 --2- 172.21.15.158:0/2015838158 >> v2:172.21.15.96:3300/0 conn(0x7f5ddc13e950 0x7f5ddc059730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5ddc059fa0 tx=0x7f5dd0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.266 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.248+0000 7f5ddaffd700 1 --2- 172.21.15.158:0/2015838158 >> v2:172.21.15.96:3300/0 conn(0x7f5ddc13e950 0x7f5ddc059730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5ddc059fa0 tx=0x7f5dd0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.266 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.248+0000 7f5ddaffd700 1 --2- 172.21.15.158:0/2015838158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ddc13e950 0x7f5ddc059730 secure :-1 s=READY pgs=253 cs=0 l=1 rx=0x7f5ddc059fa0 tx=0x7f5dd0010d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:49.267 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.248+0000 7f5ddaffd700 1 --2- 172.21.15.158:0/2015838158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ddc13e950 0x7f5ddc059730 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7f5ddc059fa0 tx=0x7f5dd0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.267 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.248+0000 7f5dc3fff700 1 -- 172.21.15.158:0/2015838158 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5dd00088b0 con 0x7f5ddc13e950 2019-12-05T03:50:49.267 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.248+0000 7f5ddaffd700 1 --2- 172.21.15.158:0/2015838158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ddc13e950 0x7f5ddc059730 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7f5ddc059fa0 tx=0x7f5dd0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.267 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.248+0000 7f5ddaffd700 1 --2- 172.21.15.158:0/2015838158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ddc13e950 0x7f5ddc059730 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7f5ddc059fa0 tx=0x7f5dd0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.267 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.248+0000 7f5dc3fff700 1 -- 172.21.15.158:0/2015838158 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd0007160 con 0x7f5ddc13e950 2019-12-05T03:50:49.267 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.248+0000 7f5dc3fff700 1 -- 172.21.15.158:0/2015838158 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5dd0005750 con 0x7f5ddc13e950 2019-12-05T03:50:49.268 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.248+0000 7f5de13ac700 1 -- 172.21.15.158:0/2015838158 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ddc152f00 con 0x7f5ddc13e950 2019-12-05T03:50:49.268 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.248+0000 7f5de13ac700 1 -- 172.21.15.158:0/2015838158 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ddc153400 con 0x7f5ddc13e950 2019-12-05T03:50:49.268 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.252+0000 7f5ddaffd700 1 --2- 172.21.15.158:0/2015838158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ddc13e950 0x7f5ddc059730 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7f5ddc059fa0 tx=0x7f5dd0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.268 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.252+0000 7f5dc3fff700 1 -- 172.21.15.158:0/2015838158 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f5dd0005a70 con 0x7f5ddc13e950 2019-12-05T03:50:49.268 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.252+0000 7f5ddaffd700 1 --2- 172.21.15.158:0/2015838158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ddc13e950 0x7f5ddc059730 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7f5ddc059fa0 tx=0x7f5dd0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.268 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.252+0000 7f5dc3fff700 1 --2- 172.21.15.158:0/2015838158 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f5dbc03ac50 0x7f5dbc03d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:49.268 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.252+0000 7f5dc3fff700 1 -- 172.21.15.158:0/2015838158 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f5dd004b5b0 con 0x7f5ddc13e950 2019-12-05T03:50:49.269 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.252+0000 7f5ddb7fe700 1 --2- 172.21.15.158:0/2015838158 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f5dbc03ac50 0x7f5dbc03d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:49.269 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.252+0000 7f5ddb7fe700 1 --2- 172.21.15.158:0/2015838158 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f5dbc03ac50 0x7f5dbc03d160 crc :-1 s=READY pgs=162 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:49.269 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.252+0000 7f5de13ac700 1 -- 172.21.15.158:0/2015838158 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ddc13ed80 con 0x7f5ddc13e950 2019-12-05T03:50:49.270 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.264+0000 7f5ddaffd700 1 --2- 172.21.15.158:0/2015838158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ddc13e950 0x7f5ddc059730 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7f5ddc059fa0 tx=0x7f5dd0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.270 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.264+0000 7f5dc3fff700 1 -- 172.21.15.158:0/2015838158 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f5dd0032570 con 0x7f5ddc13e950 2019-12-05T03:50:49.435 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.428+0000 7f5de13ac700 1 -- 172.21.15.158:0/2015838158 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f5ddc0554e0 con 0x7f5ddc13e950 2019-12-05T03:50:49.436 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.428+0000 7f5ddaffd700 1 --2- 172.21.15.158:0/2015838158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ddc13e950 0x7f5ddc059730 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7f5ddc059fa0 tx=0x7f5dd0010d60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.436 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.428+0000 7f5dc3fff700 1 -- 172.21.15.158:0/2015838158 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v32) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5dd00327d0 con 0x7f5ddc13e950 2019-12-05T03:50:49.437 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:50:49.439 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.432+0000 7f5de13ac700 1 -- 172.21.15.158:0/2015838158 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f5dbc03ac50 msgr2=0x7f5dbc03d160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:49.439 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.432+0000 7f5de13ac700 1 --2- 172.21.15.158:0/2015838158 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f5dbc03ac50 0x7f5dbc03d160 crc :-1 s=READY pgs=162 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:49.439 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.432+0000 7f5de13ac700 1 -- 172.21.15.158:0/2015838158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ddc13e950 msgr2=0x7f5ddc059730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:49.439 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.432+0000 7f5de13ac700 1 --2- 172.21.15.158:0/2015838158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ddc13e950 0x7f5ddc059730 secure :-1 s=READY pgs=253 cs=0 l=1 rx=0x7f5ddc059fa0 tx=0x7f5dd0010d60).stop 2019-12-05T03:50:49.439 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.432+0000 7f5de13ac700 1 -- 172.21.15.158:0/2015838158 shutdown_connections 2019-12-05T03:50:49.439 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.432+0000 7f5de13ac700 1 --2- 172.21.15.158:0/2015838158 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5ddc13bb90 0x7f5ddc1529b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:49.440 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.432+0000 7f5de13ac700 1 --2- 172.21.15.158:0/2015838158 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f5dbc03ac50 0x7f5dbc03d160 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:49.440 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.432+0000 7f5de13ac700 1 --2- 172.21.15.158:0/2015838158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ddc13e950 0x7f5ddc059730 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:49.440 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.432+0000 7f5de13ac700 1 -- 172.21.15.158:0/2015838158 shutdown_connections 2019-12-05T03:50:49.440 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.432+0000 7f5de13ac700 1 -- 172.21.15.158:0/2015838158 wait complete. 2019-12-05T03:50:49.440 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.432+0000 7f5de13ac700 1 -- 172.21.15.158:0/2015838158 >> 172.21.15.158:0/2015838158 conn(0x7f5ddc0b3a80 msgr2=0x7f5ddc09a320 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:49.448 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-12-05T03:50:49.549 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.536+0000 7f98cf3c4700 1 Processor -- start 2019-12-05T03:50:49.549 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.536+0000 7f98cf3c4700 1 -- start start 2019-12-05T03:50:49.549 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.536+0000 7f98cf3c4700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f98c809ba40 0x7f98c809add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:49.550 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.536+0000 7f98cf3c4700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f98c80b5370 0x7f98c80b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:49.550 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.536+0000 7f98cf3c4700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c8099e30 con 0x7f98c80b6970 2019-12-05T03:50:49.550 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.536+0000 7f98cf3c4700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98c809d210 con 0x7f98c809ba40 2019-12-05T03:50:49.550 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.536+0000 7f98cf3c4700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98c8099b90 con 0x7f98c80b5370 2019-12-05T03:50:49.551 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.536+0000 7f98ce162700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f98c80b5370 0x7f98c80b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:49.551 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.540+0000 7f98ce162700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f98c80b5370 0x7f98c80b57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:55088/0 (socket says 172.21.15.158:55088) 2019-12-05T03:50:49.551 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.540+0000 7f98ce162700 1 -- 172.21.15.158:0/414785349 learned_addr learned my addr 172.21.15.158:0/414785349 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:49.551 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.540+0000 7f98cd160700 1 --2- 172.21.15.158:0/414785349 >> v2:172.21.15.96:3300/0 conn(0x7f98c809ba40 0x7f98c809add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:49.552 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.540+0000 7f98ce162700 1 -- 172.21.15.158:0/414785349 >> v2:172.21.15.96:3300/0 conn(0x7f98c809ba40 msgr2=0x7f98c809add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:49.552 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.540+0000 7f98ce162700 1 --2- 172.21.15.158:0/414785349 >> v2:172.21.15.96:3300/0 conn(0x7f98c809ba40 0x7f98c809add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:49.552 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.540+0000 7f98ce162700 1 -- 172.21.15.158:0/414785349 >> v1:172.21.15.96:6789/0 conn(0x7f98c80b6970 legacy=0x7f98c805a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:49.552 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.540+0000 7f98ce162700 1 -- 172.21.15.158:0/414785349 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c807e960 con 0x7f98c80b5370 2019-12-05T03:50:49.552 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.540+0000 7f98ce162700 1 --2- 172.21.15.158:0/414785349 >> v2:172.21.15.158:3300/0 conn(0x7f98c80b5370 0x7f98c80b57a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f98c00032b0 tx=0x7f98c00100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.553 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.540+0000 7f98ce162700 1 --2- 172.21.15.158:0/414785349 >> v2:172.21.15.158:3300/0 conn(0x7f98c80b5370 0x7f98c80b57a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f98c00032b0 tx=0x7f98c00100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.553 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.540+0000 7f98ce162700 1 --2- 172.21.15.158:0/414785349 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98c80b5370 0x7f98c80b57a0 secure :-1 s=READY pgs=349 cs=0 l=1 rx=0x7f98c00032b0 tx=0x7f98c00100b0).ready entity=mon.1 client_cookie=8e5be4892c84882b server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:49.553 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.540+0000 7f98ce162700 1 --2- 172.21.15.158:0/414785349 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98c80b5370 0x7f98c80b57a0 secure :-1 s=THROTTLE_DONE pgs=349 cs=0 l=1 rx=0x7f98c00032b0 tx=0x7f98c00100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.553 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.540+0000 7f98cc95f700 1 -- 172.21.15.158:0/414785349 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98c0010d60 con 0x7f98c80b5370 2019-12-05T03:50:49.554 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.540+0000 7f98ce162700 1 --2- 172.21.15.158:0/414785349 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98c80b5370 0x7f98c80b57a0 secure :-1 s=THROTTLE_DONE pgs=349 cs=0 l=1 rx=0x7f98c00032b0 tx=0x7f98c00100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.554 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.540+0000 7f98ce162700 1 --2- 172.21.15.158:0/414785349 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98c80b5370 0x7f98c80b57a0 secure :-1 s=THROTTLE_DONE pgs=349 cs=0 l=1 rx=0x7f98c00032b0 tx=0x7f98c00100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.554 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.540+0000 7f98cc95f700 1 -- 172.21.15.158:0/414785349 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c0010980 con 0x7f98c80b5370 2019-12-05T03:50:49.554 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.540+0000 7f98cc95f700 1 -- 172.21.15.158:0/414785349 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98c00114a0 con 0x7f98c80b5370 2019-12-05T03:50:49.555 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.540+0000 7f98cf3c4700 1 -- 172.21.15.158:0/414785349 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98c80b5370 msgr2=0x7f98c80b57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:49.555 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.540+0000 7f98cf3c4700 1 --2- 172.21.15.158:0/414785349 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98c80b5370 0x7f98c80b57a0 secure :-1 s=READY pgs=349 cs=0 l=1 rx=0x7f98c00032b0 tx=0x7f98c00100b0).stop 2019-12-05T03:50:49.555 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.540+0000 7f98cf3c4700 1 -- 172.21.15.158:0/414785349 shutdown_connections 2019-12-05T03:50:49.555 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.540+0000 7f98cf3c4700 1 --2- 172.21.15.158:0/414785349 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98c80b5370 0x7f98c80b57a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:49.555 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.540+0000 7f98cf3c4700 1 --2- 172.21.15.158:0/414785349 >> v2:172.21.15.96:3300/0 conn(0x7f98c809ba40 0x7f98c809add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:49.556 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.540+0000 7f98cf3c4700 1 -- 172.21.15.158:0/414785349 shutdown_connections 2019-12-05T03:50:49.556 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.540+0000 7f98cf3c4700 1 -- 172.21.15.158:0/414785349 wait complete. 2019-12-05T03:50:49.556 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.540+0000 7f98cf3c4700 1 -- 172.21.15.158:0/414785349 >> 172.21.15.158:0/414785349 conn(0x7f98c80b7ef0 msgr2=0x7f98c80b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:49.562 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.544+0000 7f98cf3c4700 1 Processor -- start 2019-12-05T03:50:49.562 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.544+0000 7f98cf3c4700 1 -- start start 2019-12-05T03:50:49.563 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.544+0000 7f98cf3c4700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f98c8137b40 0x7f98c8129810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:49.563 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.544+0000 7f98cf3c4700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f98c8099220 0x7f98c80add10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:49.563 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.544+0000 7f98cf3c4700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c8137f70 con 0x7f98c8134590 2019-12-05T03:50:49.563 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.544+0000 7f98cf3c4700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98c8129d60 con 0x7f98c8137b40 2019-12-05T03:50:49.563 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.544+0000 7f98cf3c4700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c8133db0 con 0x7f98c8099220 2019-12-05T03:50:49.564 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.544+0000 7f98cd961700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f98c8137b40 0x7f98c8129810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:49.564 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.544+0000 7f98cd961700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f98c8137b40 0x7f98c8129810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:55090/0 (socket says 172.21.15.158:55090) 2019-12-05T03:50:49.564 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.544+0000 7f98cd961700 1 -- 172.21.15.158:0/3210268359 learned_addr learned my addr 172.21.15.158:0/3210268359 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:49.564 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.544+0000 7f98ce162700 1 --2- 172.21.15.158:0/3210268359 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f98c8099220 0x7f98c80add10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:49.565 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.544+0000 7f98be7fc700 1 -- 172.21.15.158:0/3210268359 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3596887479 0 0) 0x7f98c8137f70 con 0x7f98c8134590 2019-12-05T03:50:49.565 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.548+0000 7f98be7fc700 1 -- 172.21.15.158:0/3210268359 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98b00030b0 con 0x7f98c8134590 2019-12-05T03:50:49.565 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.548+0000 7f98cd961700 1 -- 172.21.15.158:0/3210268359 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f98c8099220 msgr2=0x7f98c80add10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:49.565 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.548+0000 7f98cd961700 1 --2- 172.21.15.158:0/3210268359 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f98c8099220 0x7f98c80add10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:49.566 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.548+0000 7f98cd961700 1 -- 172.21.15.158:0/3210268359 >> v1:172.21.15.96:6789/0 conn(0x7f98c8134590 legacy=0x7f98c8098a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:49.566 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.548+0000 7f98cd961700 1 -- 172.21.15.158:0/3210268359 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c80acd00 con 0x7f98c8137b40 2019-12-05T03:50:49.566 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.548+0000 7f98cd961700 1 --2- 172.21.15.158:0/3210268359 >> v2:172.21.15.158:3300/0 conn(0x7f98c8137b40 0x7f98c8129810 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f98c812a0f0 tx=0x7f98c40109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.566 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.548+0000 7f98cd961700 1 --2- 172.21.15.158:0/3210268359 >> v2:172.21.15.158:3300/0 conn(0x7f98c8137b40 0x7f98c8129810 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f98c812a0f0 tx=0x7f98c40109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.566 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.548+0000 7f98cd961700 1 --2- 172.21.15.158:0/3210268359 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98c8137b40 0x7f98c8129810 secure :-1 s=READY pgs=350 cs=0 l=1 rx=0x7f98c812a0f0 tx=0x7f98c40109a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:49.567 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.548+0000 7f98cd961700 1 --2- 172.21.15.158:0/3210268359 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98c8137b40 0x7f98c8129810 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f98c812a0f0 tx=0x7f98c40109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.567 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.548+0000 7f98be7fc700 1 -- 172.21.15.158:0/3210268359 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98c400caa0 con 0x7f98c8137b40 2019-12-05T03:50:49.567 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.548+0000 7f98cd961700 1 --2- 172.21.15.158:0/3210268359 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98c8137b40 0x7f98c8129810 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f98c812a0f0 tx=0x7f98c40109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.567 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.548+0000 7f98be7fc700 1 -- 172.21.15.158:0/3210268359 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c400c6c0 con 0x7f98c8137b40 2019-12-05T03:50:49.567 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.548+0000 7f98cd961700 1 --2- 172.21.15.158:0/3210268359 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98c8137b40 0x7f98c8129810 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f98c812a0f0 tx=0x7f98c40109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.568 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.548+0000 7f98cf3c4700 1 -- 172.21.15.158:0/3210268359 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98c81349c0 con 0x7f98c8137b40 2019-12-05T03:50:49.568 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.548+0000 7f98be7fc700 1 -- 172.21.15.158:0/3210268359 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98c4011160 con 0x7f98c8137b40 2019-12-05T03:50:49.568 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.548+0000 7f98cf3c4700 1 -- 172.21.15.158:0/3210268359 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98c80ae260 con 0x7f98c8137b40 2019-12-05T03:50:49.572 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.548+0000 7f98cd961700 1 --2- 172.21.15.158:0/3210268359 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98c8137b40 0x7f98c8129810 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f98c812a0f0 tx=0x7f98c40109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.572 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.548+0000 7f98be7fc700 1 -- 172.21.15.158:0/3210268359 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f98c4011480 con 0x7f98c8137b40 2019-12-05T03:50:49.573 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.548+0000 7f98cd961700 1 --2- 172.21.15.158:0/3210268359 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98c8137b40 0x7f98c8129810 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f98c812a0f0 tx=0x7f98c40109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.573 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.548+0000 7f98be7fc700 1 --2- 172.21.15.158:0/3210268359 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f98b003b280 0x7f98b003d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:49.573 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.548+0000 7f98be7fc700 1 -- 172.21.15.158:0/3210268359 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6020+0+0 (secure 0 0 0) 0x7f98c404b1b0 con 0x7f98c8137b40 2019-12-05T03:50:49.573 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.548+0000 7f98cd160700 1 --2- 172.21.15.158:0/3210268359 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f98b003b280 0x7f98b003d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:49.573 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.548+0000 7f98cd160700 1 --2- 172.21.15.158:0/3210268359 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f98b003b280 0x7f98b003d790 crc :-1 s=READY pgs=163 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:49.573 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.552+0000 7f98cf3c4700 1 -- 172.21.15.158:0/3210268359 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98c80554e0 con 0x7f98c8137b40 2019-12-05T03:50:49.574 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.556+0000 7f98cd961700 1 --2- 172.21.15.158:0/3210268359 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98c8137b40 0x7f98c8129810 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f98c812a0f0 tx=0x7f98c40109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.574 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.556+0000 7f98be7fc700 1 -- 172.21.15.158:0/3210268359 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f98c4032210 con 0x7f98c8137b40 2019-12-05T03:50:49.717 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.708+0000 7f98cf3c4700 1 -- 172.21.15.158:0/3210268359 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f98c812a2e0 con 0x7f98c8137b40 2019-12-05T03:50:49.717 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.712+0000 7f98cd961700 1 --2- 172.21.15.158:0/3210268359 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98c8137b40 0x7f98c8129810 secure :-1 s=THROTTLE_DONE pgs=350 cs=0 l=1 rx=0x7f98c812a0f0 tx=0x7f98c40109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.717 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.712+0000 7f98be7fc700 1 -- 172.21.15.158:0/3210268359 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v32) v1 ==== 104+0+10 (secure 0 0 0) 0x7f98c4032470 con 0x7f98c8137b40 2019-12-05T03:50:49.718 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:50:49.720 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.712+0000 7f98cf3c4700 1 -- 172.21.15.158:0/3210268359 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f98b003b280 msgr2=0x7f98b003d790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:49.720 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.712+0000 7f98cf3c4700 1 --2- 172.21.15.158:0/3210268359 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f98b003b280 0x7f98b003d790 crc :-1 s=READY pgs=163 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:49.720 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.712+0000 7f98cf3c4700 1 -- 172.21.15.158:0/3210268359 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98c8137b40 msgr2=0x7f98c8129810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:49.721 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.712+0000 7f98cf3c4700 1 --2- 172.21.15.158:0/3210268359 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98c8137b40 0x7f98c8129810 secure :-1 s=READY pgs=350 cs=0 l=1 rx=0x7f98c812a0f0 tx=0x7f98c40109a0).stop 2019-12-05T03:50:49.721 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.712+0000 7f98cf3c4700 1 -- 172.21.15.158:0/3210268359 shutdown_connections 2019-12-05T03:50:49.721 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.712+0000 7f98cf3c4700 1 --2- 172.21.15.158:0/3210268359 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f98c8099220 0x7f98c80add10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:49.721 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.712+0000 7f98cf3c4700 1 --2- 172.21.15.158:0/3210268359 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98c8137b40 0x7f98c8129810 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:49.721 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.712+0000 7f98cf3c4700 1 --2- 172.21.15.158:0/3210268359 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f98b003b280 0x7f98b003d790 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:49.721 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.712+0000 7f98cf3c4700 1 -- 172.21.15.158:0/3210268359 shutdown_connections 2019-12-05T03:50:49.721 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.712+0000 7f98cf3c4700 1 -- 172.21.15.158:0/3210268359 wait complete. 2019-12-05T03:50:49.722 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.712+0000 7f98cf3c4700 1 -- 172.21.15.158:0/3210268359 >> 172.21.15.158:0/3210268359 conn(0x7f98c809b490 msgr2=0x7f98c807b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:49.730 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-12-05T03:50:49.833 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.820+0000 7fd390f92700 1 Processor -- start 2019-12-05T03:50:49.833 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.820+0000 7fd390f92700 1 -- start start 2019-12-05T03:50:49.833 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.820+0000 7fd390f92700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd38c0b6970 0x7fd38c09add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:49.834 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.820+0000 7fd390f92700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd38c09ba40 0x7fd38c05a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:49.834 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.820+0000 7fd390f92700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd38c099e30 con 0x7fd38c05a950 2019-12-05T03:50:49.834 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.820+0000 7fd390f92700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd38c09d210 con 0x7fd38c09ba40 2019-12-05T03:50:49.834 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.820+0000 7fd390f92700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd38c099b90 con 0x7fd38c0b6970 2019-12-05T03:50:49.834 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.820+0000 7fd38a59c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd38c09ba40 0x7fd38c05a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:49.834 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.820+0000 7fd38a59c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd38c09ba40 0x7fd38c05a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:55098/0 (socket says 172.21.15.158:55098) 2019-12-05T03:50:49.835 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.820+0000 7fd38b59e700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fd38c05a950 0x7fd38c155290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49882/0 (socket says 172.21.15.158:49882) 2019-12-05T03:50:49.835 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.820+0000 7fd38a59c700 1 -- 172.21.15.158:0/2971460238 learned_addr learned my addr 172.21.15.158:0/2971460238 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:49.835 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.820+0000 7fd38ad9d700 1 --2- 172.21.15.158:0/2971460238 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd38c0b6970 0x7fd38c09add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:49.835 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.820+0000 7fd38a59c700 1 -- 172.21.15.158:0/2971460238 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd38c0b6970 msgr2=0x7fd38c09add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:49.835 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.820+0000 7fd38a59c700 1 --2- 172.21.15.158:0/2971460238 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd38c0b6970 0x7fd38c09add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:49.835 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.820+0000 7fd38a59c700 1 -- 172.21.15.158:0/2971460238 >> v1:172.21.15.158:6789/0 conn(0x7fd38c05a950 legacy=0x7fd38c155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:49.835 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.820+0000 7fd38a59c700 1 -- 172.21.15.158:0/2971460238 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd38c07e960 con 0x7fd38c09ba40 2019-12-05T03:50:49.836 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.824+0000 7fd38a59c700 1 --2- 172.21.15.158:0/2971460238 >> v2:172.21.15.158:3300/0 conn(0x7fd38c09ba40 0x7fd38c05a400 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd374008790 tx=0x7fd37400fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.836 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.824+0000 7fd38a59c700 1 --2- 172.21.15.158:0/2971460238 >> v2:172.21.15.158:3300/0 conn(0x7fd38c09ba40 0x7fd38c05a400 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd374008790 tx=0x7fd37400fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.836 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.824+0000 7fd38a59c700 1 --2- 172.21.15.158:0/2971460238 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd38c09ba40 0x7fd38c05a400 secure :-1 s=READY pgs=352 cs=0 l=1 rx=0x7fd374008790 tx=0x7fd37400fd30).ready entity=mon.1 client_cookie=a4ddca9726ca8af3 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:49.836 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.824+0000 7fd38a59c700 1 --2- 172.21.15.158:0/2971460238 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd38c09ba40 0x7fd38c05a400 secure :-1 s=THROTTLE_DONE pgs=352 cs=0 l=1 rx=0x7fd374008790 tx=0x7fd37400fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.836 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.824+0000 7fd389d9b700 1 -- 172.21.15.158:0/2971460238 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd374008c90 con 0x7fd38c09ba40 2019-12-05T03:50:49.836 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.824+0000 7fd38a59c700 1 --2- 172.21.15.158:0/2971460238 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd38c09ba40 0x7fd38c05a400 secure :-1 s=THROTTLE_DONE pgs=352 cs=0 l=1 rx=0x7fd374008790 tx=0x7fd37400fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.836 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.824+0000 7fd389d9b700 1 -- 172.21.15.158:0/2971460238 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3740088b0 con 0x7fd38c09ba40 2019-12-05T03:50:49.837 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.824+0000 7fd38a59c700 1 --2- 172.21.15.158:0/2971460238 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd38c09ba40 0x7fd38c05a400 secure :-1 s=THROTTLE_DONE pgs=352 cs=0 l=1 rx=0x7fd374008790 tx=0x7fd37400fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.837 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.824+0000 7fd389d9b700 1 -- 172.21.15.158:0/2971460238 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd374011b10 con 0x7fd38c09ba40 2019-12-05T03:50:49.837 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.824+0000 7fd390f92700 1 -- 172.21.15.158:0/2971460238 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd38c09ba40 msgr2=0x7fd38c05a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:49.837 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.824+0000 7fd390f92700 1 --2- 172.21.15.158:0/2971460238 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd38c09ba40 0x7fd38c05a400 secure :-1 s=READY pgs=352 cs=0 l=1 rx=0x7fd374008790 tx=0x7fd37400fd30).stop 2019-12-05T03:50:49.837 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.824+0000 7fd390f92700 1 -- 172.21.15.158:0/2971460238 shutdown_connections 2019-12-05T03:50:49.837 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.824+0000 7fd390f92700 1 --2- 172.21.15.158:0/2971460238 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd38c0b6970 0x7fd38c09add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:49.837 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.824+0000 7fd390f92700 1 --2- 172.21.15.158:0/2971460238 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd38c09ba40 0x7fd38c05a400 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:49.838 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.824+0000 7fd390f92700 1 -- 172.21.15.158:0/2971460238 shutdown_connections 2019-12-05T03:50:49.838 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.824+0000 7fd390f92700 1 -- 172.21.15.158:0/2971460238 wait complete. 2019-12-05T03:50:49.838 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.824+0000 7fd390f92700 1 -- 172.21.15.158:0/2971460238 >> 172.21.15.158:0/2971460238 conn(0x7fd38c0b7ef0 msgr2=0x7fd38c0b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:49.838 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.824+0000 7fd390f92700 1 Processor -- start 2019-12-05T03:50:49.838 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.824+0000 7fd390f92700 1 -- start start 2019-12-05T03:50:49.841 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.828+0000 7fd390f92700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd38c15bc40 0x7fd38c07b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:49.842 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.828+0000 7fd390f92700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd38c13ab40 0x7fd38c12ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:49.842 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.828+0000 7fd390f92700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd38c12b0c0 0x7fd38c1372e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:49.842 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.828+0000 7fd390f92700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd38c127500 con 0x7fd38c15bc40 2019-12-05T03:50:49.842 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.828+0000 7fd390f92700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd38c136da0 con 0x7fd38c13ab40 2019-12-05T03:50:49.842 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.828+0000 7fd390f92700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd38c137040 con 0x7fd38c12b0c0 2019-12-05T03:50:49.842 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.828+0000 7fd38a59c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd38c13ab40 0x7fd38c12ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:49.843 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.828+0000 7fd38a59c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd38c13ab40 0x7fd38c12ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:55106/0 (socket says 172.21.15.158:55106) 2019-12-05T03:50:49.843 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.828+0000 7fd38a59c700 1 -- 172.21.15.158:0/2126198196 learned_addr learned my addr 172.21.15.158:0/2126198196 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:49.843 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.828+0000 7fd38ad9d700 1 --2- 172.21.15.158:0/2126198196 >> v2:172.21.15.96:3300/0 conn(0x7fd38c15bc40 0x7fd38c07b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:49.843 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.828+0000 7fd38b59e700 1 --2- 172.21.15.158:0/2126198196 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd38c12b0c0 0x7fd38c1372e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:49.843 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.828+0000 7fd38a59c700 1 -- 172.21.15.158:0/2126198196 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd38c12b0c0 msgr2=0x7fd38c1372e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:49.843 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.828+0000 7fd38a59c700 1 --2- 172.21.15.158:0/2126198196 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd38c12b0c0 0x7fd38c1372e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:49.843 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.828+0000 7fd38a59c700 1 -- 172.21.15.158:0/2126198196 >> v2:172.21.15.96:3300/0 conn(0x7fd38c15bc40 msgr2=0x7fd38c07b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:49.844 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.828+0000 7fd38a59c700 1 --2- 172.21.15.158:0/2126198196 >> v2:172.21.15.96:3300/0 conn(0x7fd38c15bc40 0x7fd38c07b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:49.844 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.828+0000 7fd38a59c700 1 -- 172.21.15.158:0/2126198196 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd38c13af70 con 0x7fd38c13ab40 2019-12-05T03:50:49.844 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.828+0000 7fd38a59c700 1 --2- 172.21.15.158:0/2126198196 >> v2:172.21.15.158:3300/0 conn(0x7fd38c13ab40 0x7fd38c12ab70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd38c137200 tx=0x7fd374008eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.844 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.828+0000 7fd38a59c700 1 --2- 172.21.15.158:0/2126198196 >> v2:172.21.15.158:3300/0 conn(0x7fd38c13ab40 0x7fd38c12ab70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd38c137200 tx=0x7fd374008eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.844 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.828+0000 7fd38a59c700 1 --2- 172.21.15.158:0/2126198196 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd38c13ab40 0x7fd38c12ab70 secure :-1 s=READY pgs=353 cs=0 l=1 rx=0x7fd38c137200 tx=0x7fd374008eb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:49.844 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.828+0000 7fd38a59c700 1 --2- 172.21.15.158:0/2126198196 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd38c13ab40 0x7fd38c12ab70 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7fd38c137200 tx=0x7fd374008eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.844 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.828+0000 7fd38a59c700 1 --2- 172.21.15.158:0/2126198196 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd38c13ab40 0x7fd38c12ab70 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7fd38c137200 tx=0x7fd374008eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.845 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.828+0000 7fd3837fe700 1 -- 172.21.15.158:0/2126198196 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd37400f680 con 0x7fd38c13ab40 2019-12-05T03:50:49.845 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.828+0000 7fd38a59c700 1 --2- 172.21.15.158:0/2126198196 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd38c13ab40 0x7fd38c12ab70 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7fd38c137200 tx=0x7fd374008eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.845 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.828+0000 7fd3837fe700 1 -- 172.21.15.158:0/2126198196 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd374011730 con 0x7fd38c13ab40 2019-12-05T03:50:49.845 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.828+0000 7fd390f92700 1 -- 172.21.15.158:0/2126198196 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd38c07c070 con 0x7fd38c13ab40 2019-12-05T03:50:49.845 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.828+0000 7fd3837fe700 1 -- 172.21.15.158:0/2126198196 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd374005920 con 0x7fd38c13ab40 2019-12-05T03:50:49.845 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.828+0000 7fd390f92700 1 -- 172.21.15.158:0/2126198196 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd38c137a50 con 0x7fd38c13ab40 2019-12-05T03:50:49.845 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.828+0000 7fd38a59c700 1 --2- 172.21.15.158:0/2126198196 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd38c13ab40 0x7fd38c12ab70 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7fd38c137200 tx=0x7fd374008eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.846 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.828+0000 7fd3837fe700 1 -- 172.21.15.158:0/2126198196 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fd374005c30 con 0x7fd38c13ab40 2019-12-05T03:50:49.846 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.832+0000 7fd38a59c700 1 --2- 172.21.15.158:0/2126198196 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd38c13ab40 0x7fd38c12ab70 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7fd38c137200 tx=0x7fd374008eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.846 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.832+0000 7fd3837fe700 1 --2- 172.21.15.158:0/2126198196 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd36403ad20 0x7fd36403d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:49.846 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.832+0000 7fd3837fe700 1 -- 172.21.15.158:0/2126198196 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fd37404b940 con 0x7fd38c13ab40 2019-12-05T03:50:49.846 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.832+0000 7fd38ad9d700 1 --2- 172.21.15.158:0/2126198196 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd36403ad20 0x7fd36403d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:49.846 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.832+0000 7fd38ad9d700 1 --2- 172.21.15.158:0/2126198196 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd36403ad20 0x7fd36403d230 crc :-1 s=READY pgs=164 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:49.847 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.836+0000 7fd390f92700 1 -- 172.21.15.158:0/2126198196 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd38c0554e0 con 0x7fd38c13ab40 2019-12-05T03:50:49.849 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.844+0000 7fd38a59c700 1 --2- 172.21.15.158:0/2126198196 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd38c13ab40 0x7fd38c12ab70 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7fd38c137200 tx=0x7fd374008eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:49.849 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.844+0000 7fd3837fe700 1 -- 172.21.15.158:0/2126198196 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fd3740329c0 con 0x7fd38c13ab40 2019-12-05T03:50:50.002 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.996+0000 7fd390f92700 1 -- 172.21.15.158:0/2126198196 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7fd38c066940 con 0x7fd38c13ab40 2019-12-05T03:50:50.003 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.996+0000 7fd38a59c700 1 --2- 172.21.15.158:0/2126198196 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd38c13ab40 0x7fd38c12ab70 secure :-1 s=THROTTLE_DONE pgs=353 cs=0 l=1 rx=0x7fd38c137200 tx=0x7fd374008eb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:50.003 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:49.996+0000 7fd3837fe700 1 -- 172.21.15.158:0/2126198196 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v32) v1 ==== 100+0+10 (secure 0 0 0) 0x7fd374032c20 con 0x7fd38c13ab40 2019-12-05T03:50:50.003 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:50:50.007 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.000+0000 7fd390f92700 1 -- 172.21.15.158:0/2126198196 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd36403ad20 msgr2=0x7fd36403d230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:50.007 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.000+0000 7fd390f92700 1 --2- 172.21.15.158:0/2126198196 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd36403ad20 0x7fd36403d230 crc :-1 s=READY pgs=164 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:50.007 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.000+0000 7fd390f92700 1 -- 172.21.15.158:0/2126198196 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd38c13ab40 msgr2=0x7fd38c12ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:50.007 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.000+0000 7fd390f92700 1 --2- 172.21.15.158:0/2126198196 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd38c13ab40 0x7fd38c12ab70 secure :-1 s=READY pgs=353 cs=0 l=1 rx=0x7fd38c137200 tx=0x7fd374008eb0).stop 2019-12-05T03:50:50.008 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.000+0000 7fd390f92700 1 -- 172.21.15.158:0/2126198196 shutdown_connections 2019-12-05T03:50:50.008 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.000+0000 7fd390f92700 1 --2- 172.21.15.158:0/2126198196 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd36403ad20 0x7fd36403d230 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:50.008 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.000+0000 7fd390f92700 1 --2- 172.21.15.158:0/2126198196 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd38c12b0c0 0x7fd38c1372e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:50.008 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.000+0000 7fd390f92700 1 --2- 172.21.15.158:0/2126198196 >> v2:172.21.15.96:3300/0 conn(0x7fd38c15bc40 0x7fd38c07b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:50.008 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.000+0000 7fd390f92700 1 --2- 172.21.15.158:0/2126198196 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd38c13ab40 0x7fd38c12ab70 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:50.008 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.000+0000 7fd390f92700 1 -- 172.21.15.158:0/2126198196 shutdown_connections 2019-12-05T03:50:50.009 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.000+0000 7fd390f92700 1 -- 172.21.15.158:0/2126198196 wait complete. 2019-12-05T03:50:50.009 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.000+0000 7fd390f92700 1 -- 172.21.15.158:0/2126198196 >> 172.21.15.158:0/2126198196 conn(0x7fd38c0b66b0 msgr2=0x7fd38c1279a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:50.020 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-12-05T03:50:50.021 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-12-05T03:50:50.119 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.108+0000 7fba8dfb3700 1 Processor -- start 2019-12-05T03:50:50.119 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.108+0000 7fba8dfb3700 1 -- start start 2019-12-05T03:50:50.119 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.108+0000 7fba8dfb3700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fba8809cf60 0x7fba8809a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:50.119 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.108+0000 7fba8dfb3700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fba8805a740 0x7fba88151460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:50.119 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.108+0000 7fba8dfb3700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fba881519b0 0x7fba880b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:50.120 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.108+0000 7fba8dfb3700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba880b1730 con 0x7fba8809cf60 2019-12-05T03:50:50.120 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.108+0000 7fba8dfb3700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba880b19d0 con 0x7fba8805a740 2019-12-05T03:50:50.120 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.108+0000 7fba8dfb3700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba8805ab70 con 0x7fba881519b0 2019-12-05T03:50:50.120 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.108+0000 7fba877fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fba8805a740 0x7fba88151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:50.120 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.108+0000 7fba877fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fba8805a740 0x7fba88151460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:55112/0 (socket says 172.21.15.158:55112) 2019-12-05T03:50:50.120 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.108+0000 7fba877fe700 1 -- 172.21.15.158:0/3939834959 learned_addr learned my addr 172.21.15.158:0/3939834959 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:50.120 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.108+0000 7fba87fff700 1 --2- 172.21.15.158:0/3939834959 >> v2:172.21.15.96:3300/0 conn(0x7fba8809cf60 0x7fba8809a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:50.121 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.108+0000 7fba8cd51700 1 --2- 172.21.15.158:0/3939834959 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fba881519b0 0x7fba880b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:50.121 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.108+0000 7fba877fe700 1 -- 172.21.15.158:0/3939834959 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fba881519b0 msgr2=0x7fba880b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:50.121 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.108+0000 7fba877fe700 1 --2- 172.21.15.158:0/3939834959 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fba881519b0 0x7fba880b52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:50.121 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.108+0000 7fba877fe700 1 -- 172.21.15.158:0/3939834959 >> v2:172.21.15.96:3300/0 conn(0x7fba8809cf60 msgr2=0x7fba8809a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:50.121 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.108+0000 7fba877fe700 1 --2- 172.21.15.158:0/3939834959 >> v2:172.21.15.96:3300/0 conn(0x7fba8809cf60 0x7fba8809a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:50.121 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.108+0000 7fba877fe700 1 -- 172.21.15.158:0/3939834959 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba880accb0 con 0x7fba8805a740 2019-12-05T03:50:50.121 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.108+0000 7fba877fe700 1 --2- 172.21.15.158:0/3939834959 >> v2:172.21.15.158:3300/0 conn(0x7fba8805a740 0x7fba88151460 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fba880b18f0 tx=0x7fba7000fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:50.122 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.108+0000 7fba877fe700 1 --2- 172.21.15.158:0/3939834959 >> v2:172.21.15.158:3300/0 conn(0x7fba8805a740 0x7fba88151460 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fba880b18f0 tx=0x7fba7000fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:50.122 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.108+0000 7fba877fe700 1 --2- 172.21.15.158:0/3939834959 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fba8805a740 0x7fba88151460 secure :-1 s=READY pgs=354 cs=0 l=1 rx=0x7fba880b18f0 tx=0x7fba7000fdb0).ready entity=mon.1 client_cookie=64ee2f4f0f10c99c server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:50.122 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.108+0000 7fba877fe700 1 --2- 172.21.15.158:0/3939834959 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fba8805a740 0x7fba88151460 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7fba880b18f0 tx=0x7fba7000fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:50.122 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.108+0000 7fba877fe700 1 --2- 172.21.15.158:0/3939834959 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fba8805a740 0x7fba88151460 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7fba880b18f0 tx=0x7fba7000fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:50.122 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.108+0000 7fba86ffd700 1 -- 172.21.15.158:0/3939834959 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba700113f0 con 0x7fba8805a740 2019-12-05T03:50:50.122 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.108+0000 7fba877fe700 1 --2- 172.21.15.158:0/3939834959 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fba8805a740 0x7fba88151460 secure :-1 s=THROTTLE_DONE pgs=354 cs=0 l=1 rx=0x7fba880b18f0 tx=0x7fba7000fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:50.122 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.108+0000 7fba86ffd700 1 -- 172.21.15.158:0/3939834959 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba70008bb0 con 0x7fba8805a740 2019-12-05T03:50:50.123 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.108+0000 7fba86ffd700 1 -- 172.21.15.158:0/3939834959 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba700119d0 con 0x7fba8805a740 2019-12-05T03:50:50.123 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.108+0000 7fba8dfb3700 1 -- 172.21.15.158:0/3939834959 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fba8805a740 msgr2=0x7fba88151460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:50.123 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.108+0000 7fba8dfb3700 1 --2- 172.21.15.158:0/3939834959 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fba8805a740 0x7fba88151460 secure :-1 s=READY pgs=354 cs=0 l=1 rx=0x7fba880b18f0 tx=0x7fba7000fdb0).stop 2019-12-05T03:50:50.123 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.112+0000 7fba8dfb3700 1 -- 172.21.15.158:0/3939834959 shutdown_connections 2019-12-05T03:50:50.123 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.112+0000 7fba8dfb3700 1 --2- 172.21.15.158:0/3939834959 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fba881519b0 0x7fba880b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:50.123 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.112+0000 7fba8dfb3700 1 --2- 172.21.15.158:0/3939834959 >> v2:172.21.15.96:3300/0 conn(0x7fba8809cf60 0x7fba8809a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:50.123 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.112+0000 7fba8dfb3700 1 --2- 172.21.15.158:0/3939834959 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fba8805a740 0x7fba88151460 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:50.124 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.112+0000 7fba8dfb3700 1 -- 172.21.15.158:0/3939834959 shutdown_connections 2019-12-05T03:50:50.124 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.112+0000 7fba8dfb3700 1 -- 172.21.15.158:0/3939834959 wait complete. 2019-12-05T03:50:50.124 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.112+0000 7fba8dfb3700 1 -- 172.21.15.158:0/3939834959 >> 172.21.15.158:0/3939834959 conn(0x7fba880b7e60 msgr2=0x7fba880b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:50.128 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.112+0000 7fba8dfb3700 1 Processor -- start 2019-12-05T03:50:50.128 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.112+0000 7fba8dfb3700 1 -- start start 2019-12-05T03:50:50.128 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.112+0000 7fba8dfb3700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fba880b0960 0x7fba880af520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:50.128 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.112+0000 7fba8dfb3700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fba880afa70 0x7fba8813c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:50.128 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.112+0000 7fba8dfb3700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba880ad1d0 con 0x7fba8813fd70 2019-12-05T03:50:50.129 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.112+0000 7fba8dfb3700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba8813be80 con 0x7fba880afa70 2019-12-05T03:50:50.129 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.112+0000 7fba8dfb3700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba8813c120 con 0x7fba880b0960 2019-12-05T03:50:50.129 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.112+0000 7fba877fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fba880b0960 0x7fba880af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:50.129 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.112+0000 7fba877fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fba880b0960 0x7fba880af520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:55118/0 (socket says 172.21.15.158:55118) 2019-12-05T03:50:50.129 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.112+0000 7fba877fe700 1 -- 172.21.15.158:0/2842483580 learned_addr learned my addr 172.21.15.158:0/2842483580 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:50.129 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.112+0000 7fba8cd51700 1 --2- 172.21.15.158:0/2842483580 >> v2:172.21.15.96:3300/0 conn(0x7fba880afa70 0x7fba8813c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:50.129 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.116+0000 7fba877fe700 1 -- 172.21.15.158:0/2842483580 >> v2:172.21.15.96:3300/0 conn(0x7fba880afa70 msgr2=0x7fba8813c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:50.130 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.116+0000 7fba877fe700 1 --2- 172.21.15.158:0/2842483580 >> v2:172.21.15.96:3300/0 conn(0x7fba880afa70 0x7fba8813c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:50.130 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.116+0000 7fba877fe700 1 -- 172.21.15.158:0/2842483580 >> v1:172.21.15.158:6789/0 conn(0x7fba8813fd70 legacy=0x7fba8809b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:50.130 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.116+0000 7fba877fe700 1 -- 172.21.15.158:0/2842483580 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba8807b750 con 0x7fba880b0960 2019-12-05T03:50:50.130 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.116+0000 7fba8cd51700 1 --2- 172.21.15.158:0/2842483580 >> v2:172.21.15.96:3300/0 conn(0x7fba880afa70 0x7fba8813c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:50:50.130 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.116+0000 7fba877fe700 1 --2- 172.21.15.158:0/2842483580 >> v2:172.21.15.158:3300/0 conn(0x7fba880b0960 0x7fba880af520 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fba880add40 tx=0x7fba70011470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:50.130 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.116+0000 7fba877fe700 1 --2- 172.21.15.158:0/2842483580 >> v2:172.21.15.158:3300/0 conn(0x7fba880b0960 0x7fba880af520 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fba880add40 tx=0x7fba70011470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:50.131 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.116+0000 7fba877fe700 1 --2- 172.21.15.158:0/2842483580 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fba880b0960 0x7fba880af520 secure :-1 s=READY pgs=356 cs=0 l=1 rx=0x7fba880add40 tx=0x7fba70011470).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:50.131 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.116+0000 7fba877fe700 1 --2- 172.21.15.158:0/2842483580 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fba880b0960 0x7fba880af520 secure :-1 s=THROTTLE_DONE pgs=356 cs=0 l=1 rx=0x7fba880add40 tx=0x7fba70011470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:50.131 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.116+0000 7fba84ff9700 1 -- 172.21.15.158:0/2842483580 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba70007340 con 0x7fba880b0960 2019-12-05T03:50:50.131 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.116+0000 7fba877fe700 1 --2- 172.21.15.158:0/2842483580 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fba880b0960 0x7fba880af520 secure :-1 s=THROTTLE_DONE pgs=356 cs=0 l=1 rx=0x7fba880add40 tx=0x7fba70011470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:50.131 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.116+0000 7fba877fe700 1 --2- 172.21.15.158:0/2842483580 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fba880b0960 0x7fba880af520 secure :-1 s=THROTTLE_DONE pgs=356 cs=0 l=1 rx=0x7fba880add40 tx=0x7fba70011470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:50.131 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.116+0000 7fba84ff9700 1 -- 172.21.15.158:0/2842483580 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba700115f0 con 0x7fba880b0960 2019-12-05T03:50:50.131 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.116+0000 7fba8dfb3700 1 -- 172.21.15.158:0/2842483580 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba8813c910 con 0x7fba880b0960 2019-12-05T03:50:50.131 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.116+0000 7fba84ff9700 1 -- 172.21.15.158:0/2842483580 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba70005540 con 0x7fba880b0960 2019-12-05T03:50:50.132 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.116+0000 7fba8dfb3700 1 -- 172.21.15.158:0/2842483580 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba8813cc40 con 0x7fba880b0960 2019-12-05T03:50:50.132 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.116+0000 7fba877fe700 1 --2- 172.21.15.158:0/2842483580 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fba880b0960 0x7fba880af520 secure :-1 s=THROTTLE_DONE pgs=356 cs=0 l=1 rx=0x7fba880add40 tx=0x7fba70011470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:50.132 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.116+0000 7fba84ff9700 1 -- 172.21.15.158:0/2842483580 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fba70005850 con 0x7fba880b0960 2019-12-05T03:50:50.132 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.116+0000 7fba877fe700 1 --2- 172.21.15.158:0/2842483580 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fba880b0960 0x7fba880af520 secure :-1 s=THROTTLE_DONE pgs=356 cs=0 l=1 rx=0x7fba880add40 tx=0x7fba70011470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:50.132 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.116+0000 7fba84ff9700 1 --2- 172.21.15.158:0/2842483580 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fba6c03ace0 0x7fba6c03d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:50.132 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.116+0000 7fba84ff9700 1 -- 172.21.15.158:0/2842483580 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fba7008f560 con 0x7fba880b0960 2019-12-05T03:50:50.133 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.116+0000 7fba87fff700 1 --2- 172.21.15.158:0/2842483580 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fba6c03ace0 0x7fba6c03d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:50.133 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.120+0000 7fba87fff700 1 --2- 172.21.15.158:0/2842483580 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fba6c03ace0 0x7fba6c03d1f0 crc :-1 s=READY pgs=165 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:50.133 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.124+0000 7fba8dfb3700 1 -- 172.21.15.158:0/2842483580 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba8807dc80 con 0x7fba880b0960 2019-12-05T03:50:50.140 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.132+0000 7fba877fe700 1 --2- 172.21.15.158:0/2842483580 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fba880b0960 0x7fba880af520 secure :-1 s=THROTTLE_DONE pgs=356 cs=0 l=1 rx=0x7fba880add40 tx=0x7fba70011470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:50.140 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.132+0000 7fba84ff9700 1 -- 172.21.15.158:0/2842483580 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fba70076840 con 0x7fba880b0960 2019-12-05T03:50:50.304 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.296+0000 7fba8dfb3700 1 -- 172.21.15.158:0/2842483580 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba880554e0 con 0x7fba880b0960 2019-12-05T03:50:50.305 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.296+0000 7fba877fe700 1 --2- 172.21.15.158:0/2842483580 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fba880b0960 0x7fba880af520 secure :-1 s=THROTTLE_DONE pgs=356 cs=0 l=1 rx=0x7fba880add40 tx=0x7fba70011470).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:50.305 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.296+0000 7fba84ff9700 1 -- 172.21.15.158:0/2842483580 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+1773 (secure 0 0 0) 0x7fba700773f0 con 0x7fba880b0960 2019-12-05T03:50:50.305 INFO:teuthology.orchestra.run.smithi158.stderr:dumped fsmap epoch 14 2019-12-05T03:50:50.305 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:50.306 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-12-05T03:50:44.549123+0000","modified":"2019-12-05T03:50:48.261168+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5095},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5095":{"gid":5095,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":2,"addr":"172.21.15.158:6833/2078196109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":2078196109},{"type":"v1","addr":"172.21.15.158:6833","nonce":2078196109}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2019-12-05T03:50:50.308 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.300+0000 7fba8dfb3700 1 -- 172.21.15.158:0/2842483580 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fba6c03ace0 msgr2=0x7fba6c03d1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:50.309 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.300+0000 7fba8dfb3700 1 --2- 172.21.15.158:0/2842483580 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fba6c03ace0 0x7fba6c03d1f0 crc :-1 s=READY pgs=165 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:50.309 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.300+0000 7fba8dfb3700 1 -- 172.21.15.158:0/2842483580 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fba880b0960 msgr2=0x7fba880af520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:50.309 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.300+0000 7fba8dfb3700 1 --2- 172.21.15.158:0/2842483580 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fba880b0960 0x7fba880af520 secure :-1 s=READY pgs=356 cs=0 l=1 rx=0x7fba880add40 tx=0x7fba70011470).stop 2019-12-05T03:50:50.309 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.300+0000 7fba8dfb3700 1 -- 172.21.15.158:0/2842483580 shutdown_connections 2019-12-05T03:50:50.309 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.300+0000 7fba8dfb3700 1 --2- 172.21.15.158:0/2842483580 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fba6c03ace0 0x7fba6c03d1f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:50.309 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.300+0000 7fba8dfb3700 1 --2- 172.21.15.158:0/2842483580 >> v2:172.21.15.96:3300/0 conn(0x7fba880afa70 0x7fba8813c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:50.309 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.300+0000 7fba8dfb3700 1 --2- 172.21.15.158:0/2842483580 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fba880b0960 0x7fba880af520 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:50.310 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.300+0000 7fba8dfb3700 1 -- 172.21.15.158:0/2842483580 shutdown_connections 2019-12-05T03:50:50.310 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.300+0000 7fba8dfb3700 1 -- 172.21.15.158:0/2842483580 wait complete. 2019-12-05T03:50:50.310 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:50.300+0000 7fba8dfb3700 1 -- 172.21.15.158:0/2842483580 >> 172.21.15.158:0/2842483580 conn(0x7fba8807e320 msgr2=0x7fba88155320 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:50.519 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 5095}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 4, u'failed': [], u'epoch': 14, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [5], u'info': {u'gid_5095': {u'export_targets': [], u'name': u'a', u'incarnation': 13, u'state_seq': 2, u'state': u'up:active', u'gid': 5095, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 2078196109, u'type': u'v2', u'addr': u'172.21.15.158:6832'}, {u'nonce': 2078196109, u'type': u'v1', u'addr': u'172.21.15.158:6833'}]}, u'addr': u'172.21.15.158:6833/2078196109'}}, u'fs_name': u'cephfs', u'created': u'2019-12-05T03:50:44.549123+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-12-05T03:50:48.261168+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-12-05T03:50:50.519 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-12-05T03:50:50.520 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2019-12-05T03:50:50.612 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2019-12-05T03:50:50.613 INFO:teuthology.orchestra.run.smithi158.stdout: "cluster_fsid": "a91186ae-f496-4de1-918d-820c55ff1feb", 2019-12-05T03:50:50.613 INFO:teuthology.orchestra.run.smithi158.stdout: "whoami": 0, 2019-12-05T03:50:50.613 INFO:teuthology.orchestra.run.smithi158.stdout: "id": 5095, 2019-12-05T03:50:50.613 INFO:teuthology.orchestra.run.smithi158.stdout: "want_state": "up:active", 2019-12-05T03:50:50.613 INFO:teuthology.orchestra.run.smithi158.stdout: "state": "up:active", 2019-12-05T03:50:50.613 INFO:teuthology.orchestra.run.smithi158.stdout: "rank_uptime": 3.3476702189999998, 2019-12-05T03:50:50.614 INFO:teuthology.orchestra.run.smithi158.stdout: "mdsmap_epoch": 14, 2019-12-05T03:50:50.614 INFO:teuthology.orchestra.run.smithi158.stdout: "osdmap_epoch": 32, 2019-12-05T03:50:50.614 INFO:teuthology.orchestra.run.smithi158.stdout: "osdmap_epoch_barrier": 32, 2019-12-05T03:50:50.614 INFO:teuthology.orchestra.run.smithi158.stdout: "uptime": 3.6311572239999999 2019-12-05T03:50:50.614 INFO:teuthology.orchestra.run.smithi158.stdout:} 2019-12-05T03:50:50.619 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "a91186ae-f496-4de1-918d-820c55ff1feb", "whoami": 0, "id": 5095, "want_state": "up:active", "state": "up:active", "rank_uptime": 3.3476702189999998, "mdsmap_epoch": 14, "osdmap_epoch": 32, "osdmap_epoch_barrier": 32, "uptime": 3.6311572239999999 } 2019-12-05T03:50:50.619 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2019-12-05T03:50:50.619 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2019-12-05T03:50:50.620 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi158.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2019-12-05T03:50:50.620 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:50.620 INFO:teuthology.orchestra.run.smithi158:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-12-05T03:50:50.632 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:50.632 INFO:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2019-12-05T03:50:50.714 DEBUG:teuthology.orchestra.run:got remote process result: 32 2019-12-05T03:50:50.716 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2019-12-05T03:50:50.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:50.717 INFO:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2019-12-05T03:50:50.791 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2019-12-05T03:50:50.791 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0 2019-12-05T03:50:50.858 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:50.858 INFO:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2019-12-05T03:50:50.874 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2019-12-05T03:50:50.875 DEBUG:teuthology.orchestra.run:got remote process result: 32 2019-12-05T03:50:50.883 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:50.884 INFO:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2019-12-05T03:50:50.917 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi158.stderr:2019-12-05T03:50:50.912+0000 7fb51e70af40 -1 init, newargv = 0x559ee21c3fa0 newargc=7 2019-12-05T03:50:50.918 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi158.stderr:ceph-fuse[16506]: starting ceph client 2019-12-05T03:50:50.925 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi158.stderr:ceph-fuse[16506]: starting fuse 2019-12-05T03:50:50.956 INFO:teuthology.orchestra.run.smithi158.stdout:49 2019-12-05T03:50:50.956 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2019-12-05T03:50:50.956 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:50.956 INFO:teuthology.orchestra.run.smithi158:> sudo python2 -c ' 2019-12-05T03:50:50.957 INFO:teuthology.orchestra.run.smithi158:> import glob 2019-12-05T03:50:50.957 INFO:teuthology.orchestra.run.smithi158:> import re 2019-12-05T03:50:50.957 INFO:teuthology.orchestra.run.smithi158:> import os 2019-12-05T03:50:50.957 INFO:teuthology.orchestra.run.smithi158:> import subprocess 2019-12-05T03:50:50.957 INFO:teuthology.orchestra.run.smithi158:> 2019-12-05T03:50:50.957 INFO:teuthology.orchestra.run.smithi158:> def find_socket(client_name): 2019-12-05T03:50:50.957 INFO:teuthology.orchestra.run.smithi158:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2019-12-05T03:50:50.958 INFO:teuthology.orchestra.run.smithi158:> files = glob.glob(asok_path) 2019-12-05T03:50:50.958 INFO:teuthology.orchestra.run.smithi158:> 2019-12-05T03:50:50.958 INFO:teuthology.orchestra.run.smithi158:> # Given a non-glob path, it better be there 2019-12-05T03:50:50.958 INFO:teuthology.orchestra.run.smithi158:> if "*" not in asok_path: 2019-12-05T03:50:50.958 INFO:teuthology.orchestra.run.smithi158:> assert(len(files) == 1) 2019-12-05T03:50:50.958 INFO:teuthology.orchestra.run.smithi158:> return files[0] 2019-12-05T03:50:50.958 INFO:teuthology.orchestra.run.smithi158:> 2019-12-05T03:50:50.958 INFO:teuthology.orchestra.run.smithi158:> for f in files: 2019-12-05T03:50:50.959 INFO:teuthology.orchestra.run.smithi158:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2019-12-05T03:50:50.959 INFO:teuthology.orchestra.run.smithi158:> if os.path.exists("/proc/{0}".format(pid)): 2019-12-05T03:50:50.959 INFO:teuthology.orchestra.run.smithi158:> return f 2019-12-05T03:50:50.959 INFO:teuthology.orchestra.run.smithi158:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2019-12-05T03:50:50.959 INFO:teuthology.orchestra.run.smithi158:> 2019-12-05T03:50:50.959 INFO:teuthology.orchestra.run.smithi158:> print(find_socket("client.0")) 2019-12-05T03:50:50.959 INFO:teuthology.orchestra.run.smithi158:> ' 2019-12-05T03:50:51.060 INFO:teuthology.orchestra.run.smithi158.stdout:/var/run/ceph/ceph-client.0.16506.asok 2019-12-05T03:50:51.060 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.16506.asok 2019-12-05T03:50:51.061 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:51.061 INFO:teuthology.orchestra.run.smithi158:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.16506.asok status 2019-12-05T03:50:51.243 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2019-12-05T03:50:51.243 INFO:teuthology.orchestra.run.smithi158.stdout: "metadata": { 2019-12-05T03:50:51.243 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_sha1": "c5290805033483ba0cec165c06bde07dae5f19ec", 2019-12-05T03:50:51.243 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_version": "ceph version 15.0.0-8014-gc529080 (c5290805033483ba0cec165c06bde07dae5f19ec) octopus (dev)", 2019-12-05T03:50:51.243 INFO:teuthology.orchestra.run.smithi158.stdout: "entity_id": "0", 2019-12-05T03:50:51.243 INFO:teuthology.orchestra.run.smithi158.stdout: "hostname": "smithi158", 2019-12-05T03:50:51.244 INFO:teuthology.orchestra.run.smithi158.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2019-12-05T03:50:51.244 INFO:teuthology.orchestra.run.smithi158.stdout: "pid": "16506", 2019-12-05T03:50:51.244 INFO:teuthology.orchestra.run.smithi158.stdout: "root": "/" 2019-12-05T03:50:51.244 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:51.244 INFO:teuthology.orchestra.run.smithi158.stdout: "dentry_count": 0, 2019-12-05T03:50:51.244 INFO:teuthology.orchestra.run.smithi158.stdout: "dentry_pinned_count": 0, 2019-12-05T03:50:51.245 INFO:teuthology.orchestra.run.smithi158.stdout: "id": 5155, 2019-12-05T03:50:51.245 INFO:teuthology.orchestra.run.smithi158.stdout: "inst": { 2019-12-05T03:50:51.245 INFO:teuthology.orchestra.run.smithi158.stdout: "name": { 2019-12-05T03:50:51.245 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "client", 2019-12-05T03:50:51.245 INFO:teuthology.orchestra.run.smithi158.stdout: "num": 5155 2019-12-05T03:50:51.245 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:51.245 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": { 2019-12-05T03:50:51.246 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:50:51.246 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:0", 2019-12-05T03:50:51.246 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 2252685475 2019-12-05T03:50:51.246 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:50:51.246 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:51.246 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": { 2019-12-05T03:50:51.246 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:50:51.246 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:0", 2019-12-05T03:50:51.247 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 2252685475 2019-12-05T03:50:51.247 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:50:51.247 INFO:teuthology.orchestra.run.smithi158.stdout: "inst_str": "client.5155 172.21.15.158:0/2252685475", 2019-12-05T03:50:51.247 INFO:teuthology.orchestra.run.smithi158.stdout: "addr_str": "172.21.15.158:0/2252685475", 2019-12-05T03:50:51.247 INFO:teuthology.orchestra.run.smithi158.stdout: "inode_count": 1, 2019-12-05T03:50:51.247 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_epoch": 14, 2019-12-05T03:50:51.247 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_epoch": 32, 2019-12-05T03:50:51.248 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_epoch_barrier": 0, 2019-12-05T03:50:51.248 INFO:teuthology.orchestra.run.smithi158.stdout: "blacklisted": false 2019-12-05T03:50:51.248 INFO:teuthology.orchestra.run.smithi158.stdout:} 2019-12-05T03:50:51.248 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:51.248 INFO:teuthology.orchestra.run.smithi158:> stat --file-system '--printf=%T 2019-12-05T03:50:51.249 INFO:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.0 2019-12-05T03:50:51.262 INFO:teuthology.orchestra.run.smithi158.stdout:fuseblk 2019-12-05T03:50:51.262 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2019-12-05T03:50:51.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:51.263 INFO:teuthology.orchestra.run.smithi158:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2019-12-05T03:50:51.346 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create data_new 8 2019-12-05T03:50:51.523 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.512+0000 7fd2c73d5700 1 Processor -- start 2019-12-05T03:50:51.523 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.512+0000 7fd2c73d5700 1 -- start start 2019-12-05T03:50:51.523 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.512+0000 7fd2c73d5700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd2c00b6970 0x7fd2c009add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:51.523 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.512+0000 7fd2c73d5700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd2c009ba40 0x7fd2c005a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:51.523 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.512+0000 7fd2c73d5700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2c0099e30 con 0x7fd2c005a950 2019-12-05T03:50:51.523 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.512+0000 7fd2c73d5700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2c009d210 con 0x7fd2c00b6970 2019-12-05T03:50:51.524 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.512+0000 7fd2c73d5700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c0099b90 con 0x7fd2c009ba40 2019-12-05T03:50:51.524 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.512+0000 7fd2c6173700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fd2c005a950 0x7fd2c0155290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49924/0 (socket says 172.21.15.158:49924) 2019-12-05T03:50:51.524 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.512+0000 7fd2c6173700 1 -- 172.21.15.158:0/1579071651 learned_addr learned my addr 172.21.15.158:0/1579071651 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:51.524 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.512+0000 7fd2c5171700 1 --2- 172.21.15.158:0/1579071651 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd2c009ba40 0x7fd2c005a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:51.524 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.512+0000 7fd2c5972700 1 --2- 172.21.15.158:0/1579071651 >> v2:172.21.15.96:3300/0 conn(0x7fd2c00b6970 0x7fd2c009add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:51.524 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.512+0000 7fd2c4970700 1 -- 172.21.15.158:0/1579071651 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2534333448 0 0) 0x7fd2c0099e30 con 0x7fd2c005a950 2019-12-05T03:50:51.524 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.512+0000 7fd2c4970700 1 -- 172.21.15.158:0/1579071651 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2a80030b0 con 0x7fd2c005a950 2019-12-05T03:50:51.525 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.512+0000 7fd2c5972700 1 -- 172.21.15.158:0/1579071651 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd2c009ba40 msgr2=0x7fd2c005a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:51.525 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.512+0000 7fd2c5972700 1 --2- 172.21.15.158:0/1579071651 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd2c009ba40 0x7fd2c005a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:51.525 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.512+0000 7fd2c5972700 1 -- 172.21.15.158:0/1579071651 >> v1:172.21.15.158:6789/0 conn(0x7fd2c005a950 legacy=0x7fd2c0155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:51.525 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.512+0000 7fd2c4970700 1 -- 172.21.15.158:0/1579071651 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1587114658 0 0) 0x7fd2a80030b0 con 0x7fd2c005a950 2019-12-05T03:50:51.525 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.512+0000 7fd2c5972700 1 -- 172.21.15.158:0/1579071651 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c007e960 con 0x7fd2c00b6970 2019-12-05T03:50:51.525 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.512+0000 7fd2c5171700 1 --2- 172.21.15.158:0/1579071651 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd2c009ba40 0x7fd2c005a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:50:51.526 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.512+0000 7fd2c5972700 1 --2- 172.21.15.158:0/1579071651 >> v2:172.21.15.96:3300/0 conn(0x7fd2c00b6970 0x7fd2c009add0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd2bc008b10 tx=0x7fd2b80019d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:51.526 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.512+0000 7fd2c5972700 1 --2- 172.21.15.158:0/1579071651 >> v2:172.21.15.96:3300/0 conn(0x7fd2c00b6970 0x7fd2c009add0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd2bc008b10 tx=0x7fd2b80019d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:51.526 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.512+0000 7fd2c5972700 1 --2- 172.21.15.158:0/1579071651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2c00b6970 0x7fd2c009add0 secure :-1 s=READY pgs=257 cs=0 l=1 rx=0x7fd2bc008b10 tx=0x7fd2b80019d0).ready entity=mon.0 client_cookie=2ec99da5b1f3f5a1 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:51.526 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.512+0000 7fd2c5972700 1 --2- 172.21.15.158:0/1579071651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2c00b6970 0x7fd2c009add0 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7fd2bc008b10 tx=0x7fd2b80019d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:51.526 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.512+0000 7fd2c4970700 1 -- 172.21.15.158:0/1579071651 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2b8001750 con 0x7fd2c00b6970 2019-12-05T03:50:51.526 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.512+0000 7fd2c5972700 1 --2- 172.21.15.158:0/1579071651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2c00b6970 0x7fd2c009add0 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7fd2bc008b10 tx=0x7fd2b80019d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:51.526 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.512+0000 7fd2c5972700 1 --2- 172.21.15.158:0/1579071651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2c00b6970 0x7fd2c009add0 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7fd2bc008b10 tx=0x7fd2b80019d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:51.526 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.512+0000 7fd2c4970700 1 -- 172.21.15.158:0/1579071651 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b8001560 con 0x7fd2c00b6970 2019-12-05T03:50:51.527 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.512+0000 7fd2c4970700 1 -- 172.21.15.158:0/1579071651 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2bc0109f0 con 0x7fd2c00b6970 2019-12-05T03:50:51.527 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.512+0000 7fd2c73d5700 1 -- 172.21.15.158:0/1579071651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2c00b6970 msgr2=0x7fd2c009add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:51.527 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.512+0000 7fd2c73d5700 1 --2- 172.21.15.158:0/1579071651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2c00b6970 0x7fd2c009add0 secure :-1 s=READY pgs=257 cs=0 l=1 rx=0x7fd2bc008b10 tx=0x7fd2b80019d0).stop 2019-12-05T03:50:51.527 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.516+0000 7fd2c73d5700 1 -- 172.21.15.158:0/1579071651 shutdown_connections 2019-12-05T03:50:51.527 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.516+0000 7fd2c73d5700 1 --2- 172.21.15.158:0/1579071651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2c00b6970 0x7fd2c009add0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:51.527 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.516+0000 7fd2c73d5700 1 --2- 172.21.15.158:0/1579071651 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd2c009ba40 0x7fd2c005a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:51.527 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.516+0000 7fd2c73d5700 1 -- 172.21.15.158:0/1579071651 shutdown_connections 2019-12-05T03:50:51.528 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.516+0000 7fd2c73d5700 1 -- 172.21.15.158:0/1579071651 wait complete. 2019-12-05T03:50:51.528 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.516+0000 7fd2c73d5700 1 -- 172.21.15.158:0/1579071651 >> 172.21.15.158:0/1579071651 conn(0x7fd2c00b7ef0 msgr2=0x7fd2c00b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:51.531 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.516+0000 7fd2c73d5700 1 Processor -- start 2019-12-05T03:50:51.531 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.516+0000 7fd2c73d5700 1 -- start start 2019-12-05T03:50:51.531 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.520+0000 7fd2c73d5700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd2c0141e60 0x7fd2c01442a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:51.531 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.520+0000 7fd2c73d5700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2c0152a20 con 0x7fd2c0151df0 2019-12-05T03:50:51.532 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.520+0000 7fd2c73d5700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2c00b1960 con 0x7fd2c007b7c0 2019-12-05T03:50:51.532 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.520+0000 7fd2c73d5700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2c00ad5f0 con 0x7fd2c0141e60 2019-12-05T03:50:51.532 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.520+0000 7fd2c5972700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fd2c007b7c0 0x7fd2c00ad870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49926/0 (socket says 172.21.15.158:49926) 2019-12-05T03:50:51.532 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.520+0000 7fd2c6173700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd2c0141e60 0x7fd2c01442a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:51.532 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.520+0000 7fd2c5972700 1 -- 172.21.15.158:0/2864014776 learned_addr learned my addr 172.21.15.158:0/2864014776 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:51.532 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.520+0000 7fd2c6173700 1 -- 172.21.15.158:0/2864014776 >> v1:172.21.15.158:6789/0 conn(0x7fd2c007b7c0 legacy=0x7fd2c00ad870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:51.532 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.520+0000 7fd2c6173700 1 -- 172.21.15.158:0/2864014776 >> v1:172.21.15.96:6789/0 conn(0x7fd2c0151df0 legacy=0x7fd2c0152220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:51.533 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.520+0000 7fd2b67fc700 1 -- 172.21.15.158:0/2864014776 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 169977187 0 0) 0x7fd2c00b1960 con 0x7fd2c007b7c0 2019-12-05T03:50:51.533 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.520+0000 7fd2c6173700 1 -- 172.21.15.158:0/2864014776 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c0146810 con 0x7fd2c0141e60 2019-12-05T03:50:51.533 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.520+0000 7fd2c6173700 1 --2- 172.21.15.158:0/2864014776 >> v2:172.21.15.158:3300/0 conn(0x7fd2c0141e60 0x7fd2c01442a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd2c009c170 tx=0x7fd2b0007ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:51.533 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.520+0000 7fd2c6173700 1 --2- 172.21.15.158:0/2864014776 >> v2:172.21.15.158:3300/0 conn(0x7fd2c0141e60 0x7fd2c01442a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd2c009c170 tx=0x7fd2b0007ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:51.534 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.520+0000 7fd2c6173700 1 --2- 172.21.15.158:0/2864014776 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2c0141e60 0x7fd2c01442a0 secure :-1 s=READY pgs=362 cs=0 l=1 rx=0x7fd2c009c170 tx=0x7fd2b0007ad0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:51.534 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.520+0000 7fd2c6173700 1 --2- 172.21.15.158:0/2864014776 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2c0141e60 0x7fd2c01442a0 secure :-1 s=THROTTLE_DONE pgs=362 cs=0 l=1 rx=0x7fd2c009c170 tx=0x7fd2b0007ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:51.534 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.520+0000 7fd2c6173700 1 --2- 172.21.15.158:0/2864014776 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2c0141e60 0x7fd2c01442a0 secure :-1 s=THROTTLE_DONE pgs=362 cs=0 l=1 rx=0x7fd2c009c170 tx=0x7fd2b0007ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:51.534 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.520+0000 7fd2c6173700 1 --2- 172.21.15.158:0/2864014776 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2c0141e60 0x7fd2c01442a0 secure :-1 s=THROTTLE_DONE pgs=362 cs=0 l=1 rx=0x7fd2c009c170 tx=0x7fd2b0007ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:51.534 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.520+0000 7fd2b67fc700 1 -- 172.21.15.158:0/2864014776 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2b8013710 con 0x7fd2c0141e60 2019-12-05T03:50:51.534 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.520+0000 7fd2b67fc700 1 -- 172.21.15.158:0/2864014776 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b8013330 con 0x7fd2c0141e60 2019-12-05T03:50:51.534 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.520+0000 7fd2c73d5700 1 -- 172.21.15.158:0/2864014776 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2c00593f0 con 0x7fd2c0141e60 2019-12-05T03:50:51.535 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.520+0000 7fd2b67fc700 1 -- 172.21.15.158:0/2864014776 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2b8013cf0 con 0x7fd2c0141e60 2019-12-05T03:50:51.535 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.520+0000 7fd2c73d5700 1 -- 172.21.15.158:0/2864014776 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2c0059970 con 0x7fd2c0141e60 2019-12-05T03:50:51.535 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.520+0000 7fd2c6173700 1 --2- 172.21.15.158:0/2864014776 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2c0141e60 0x7fd2c01442a0 secure :-1 s=THROTTLE_DONE pgs=362 cs=0 l=1 rx=0x7fd2c009c170 tx=0x7fd2b0007ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:51.535 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.524+0000 7fd2b67fc700 1 -- 172.21.15.158:0/2864014776 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fd2b800b330 con 0x7fd2c0141e60 2019-12-05T03:50:51.535 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.524+0000 7fd2c6173700 1 --2- 172.21.15.158:0/2864014776 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2c0141e60 0x7fd2c01442a0 secure :-1 s=THROTTLE_DONE pgs=362 cs=0 l=1 rx=0x7fd2c009c170 tx=0x7fd2b0007ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:51.535 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.524+0000 7fd2b67fc700 1 --2- 172.21.15.158:0/2864014776 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd2a003ac30 0x7fd2a003d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:51.535 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.524+0000 7fd2b67fc700 1 -- 172.21.15.158:0/2864014776 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6020+0+0 (secure 0 0 0) 0x7fd2b804d070 con 0x7fd2c0141e60 2019-12-05T03:50:51.536 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.524+0000 7fd2c5972700 1 --2- 172.21.15.158:0/2864014776 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd2a003ac30 0x7fd2a003d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:51.536 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.524+0000 7fd2c5972700 1 --2- 172.21.15.158:0/2864014776 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd2a003ac30 0x7fd2a003d140 crc :-1 s=READY pgs=167 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:51.536 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.528+0000 7fd2c73d5700 1 -- 172.21.15.158:0/2864014776 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2c00554e0 con 0x7fd2c0141e60 2019-12-05T03:50:51.542 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.536+0000 7fd2c6173700 1 --2- 172.21.15.158:0/2864014776 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2c0141e60 0x7fd2c01442a0 secure :-1 s=THROTTLE_DONE pgs=362 cs=0 l=1 rx=0x7fd2c009c170 tx=0x7fd2b0007ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:51.542 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.536+0000 7fd2b67fc700 1 -- 172.21.15.158:0/2864014776 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fd2b802f460 con 0x7fd2c0141e60 2019-12-05T03:50:51.706 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:51.700+0000 7fd2c73d5700 1 -- 172.21.15.158:0/2864014776 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd pool create", "pg_num": 8, "pool": "data_new"} v 0) v1 -- 0x7fd2c007bc00 con 0x7fd2c0141e60 2019-12-05T03:50:52.320 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.312+0000 7fd2c6173700 1 --2- 172.21.15.158:0/2864014776 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2c0141e60 0x7fd2c01442a0 secure :-1 s=THROTTLE_DONE pgs=362 cs=0 l=1 rx=0x7fd2c009c170 tx=0x7fd2b0007ad0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:52.321 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.312+0000 7fd2b67fc700 1 -- 172.21.15.158:0/2864014776 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pg_num": 8, "pool": "data_new"}]=0 pool 'data_new' created v33) v1 ==== 119+0+0 (secure 0 0 0) 0x7fd2b80340f0 con 0x7fd2c0141e60 2019-12-05T03:50:52.321 INFO:teuthology.orchestra.run.smithi158.stderr:pool 'data_new' created 2019-12-05T03:50:52.326 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.320+0000 7fd2c73d5700 1 -- 172.21.15.158:0/2864014776 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd2a003ac30 msgr2=0x7fd2a003d140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:52.326 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.320+0000 7fd2c73d5700 1 --2- 172.21.15.158:0/2864014776 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd2a003ac30 0x7fd2a003d140 crc :-1 s=READY pgs=167 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:52.326 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.320+0000 7fd2c73d5700 1 -- 172.21.15.158:0/2864014776 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2c0141e60 msgr2=0x7fd2c01442a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:52.326 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.320+0000 7fd2c73d5700 1 --2- 172.21.15.158:0/2864014776 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2c0141e60 0x7fd2c01442a0 secure :-1 s=READY pgs=362 cs=0 l=1 rx=0x7fd2c009c170 tx=0x7fd2b0007ad0).stop 2019-12-05T03:50:52.327 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.320+0000 7fd2c73d5700 1 -- 172.21.15.158:0/2864014776 shutdown_connections 2019-12-05T03:50:52.327 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.320+0000 7fd2c73d5700 1 --2- 172.21.15.158:0/2864014776 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd2c0141e60 0x7fd2c01442a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:52.327 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.320+0000 7fd2c73d5700 1 --2- 172.21.15.158:0/2864014776 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd2a003ac30 0x7fd2a003d140 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:52.327 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.320+0000 7fd2c73d5700 1 -- 172.21.15.158:0/2864014776 shutdown_connections 2019-12-05T03:50:52.328 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.320+0000 7fd2c73d5700 1 -- 172.21.15.158:0/2864014776 wait complete. 2019-12-05T03:50:52.328 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.320+0000 7fd2c73d5700 1 -- 172.21.15.158:0/2864014776 >> 172.21.15.158:0/2864014776 conn(0x7fd2c01554a0 msgr2=0x7fd2c012b420 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:52.338 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs data_new 2019-12-05T03:50:52.440 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.428+0000 7f2124471700 1 Processor -- start 2019-12-05T03:50:52.441 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.428+0000 7f2124471700 1 -- start start 2019-12-05T03:50:52.441 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.428+0000 7f2124471700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f211c0b6f20 0x7f211c0988e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:52.441 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.428+0000 7f2124471700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f211c0993b0 con 0x7f211c098e30 2019-12-05T03:50:52.441 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.428+0000 7f2124471700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f211c097eb0 con 0x7f211c0969c0 2019-12-05T03:50:52.441 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.428+0000 7f2124471700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f211c098230 con 0x7f211c0b6f20 2019-12-05T03:50:52.442 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.432+0000 7f212320f700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f211c0969c0 0x7f211c1558d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49938/0 (socket says 172.21.15.158:49938) 2019-12-05T03:50:52.442 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.432+0000 7f212320f700 1 -- 172.21.15.158:0/2381803814 learned_addr learned my addr 172.21.15.158:0/2381803814 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:52.442 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.432+0000 7f2122a0e700 1 --2- 172.21.15.158:0/2381803814 >> v2:172.21.15.96:3300/0 conn(0x7f211c0b6f20 0x7f211c0988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:52.442 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.432+0000 7f2121a0c700 1 -- 172.21.15.158:0/2381803814 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4214454264 0 0) 0x7f211c097eb0 con 0x7f211c0969c0 2019-12-05T03:50:52.443 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.432+0000 7f2121a0c700 1 -- 172.21.15.158:0/2381803814 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21080030b0 con 0x7f211c0969c0 2019-12-05T03:50:52.443 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.432+0000 7f2121a0c700 1 -- 172.21.15.158:0/2381803814 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4172084531 0 0) 0x7f21080030b0 con 0x7f211c0969c0 2019-12-05T03:50:52.443 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.432+0000 7f2122a0e700 1 -- 172.21.15.158:0/2381803814 >> v1:172.21.15.158:6789/0 conn(0x7f211c0969c0 legacy=0x7f211c1558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:52.444 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.432+0000 7f2122a0e700 1 -- 172.21.15.158:0/2381803814 >> v1:172.21.15.96:6789/0 conn(0x7f211c098e30 legacy=0x7f211c1550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:52.444 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.432+0000 7f2122a0e700 1 -- 172.21.15.158:0/2381803814 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211c07e8c0 con 0x7f211c0b6f20 2019-12-05T03:50:52.444 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.432+0000 7f2122a0e700 1 --2- 172.21.15.158:0/2381803814 >> v2:172.21.15.96:3300/0 conn(0x7f211c0b6f20 0x7f211c0988e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2110001450 tx=0x7f2114001990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:52.444 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.432+0000 7f2122a0e700 1 --2- 172.21.15.158:0/2381803814 >> v2:172.21.15.96:3300/0 conn(0x7f211c0b6f20 0x7f211c0988e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2110001450 tx=0x7f2114001990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:52.444 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.432+0000 7f2122a0e700 1 --2- 172.21.15.158:0/2381803814 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f211c0b6f20 0x7f211c0988e0 secure :-1 s=READY pgs=260 cs=0 l=1 rx=0x7f2110001450 tx=0x7f2114001990).ready entity=mon.0 client_cookie=8a2fceb6689e916 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:52.444 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.432+0000 7f2122a0e700 1 --2- 172.21.15.158:0/2381803814 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f211c0b6f20 0x7f211c0988e0 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7f2110001450 tx=0x7f2114001990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:52.445 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.432+0000 7f2121a0c700 1 -- 172.21.15.158:0/2381803814 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2114001750 con 0x7f211c0b6f20 2019-12-05T03:50:52.445 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.432+0000 7f2122a0e700 1 --2- 172.21.15.158:0/2381803814 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f211c0b6f20 0x7f211c0988e0 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7f2110001450 tx=0x7f2114001990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:52.445 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.432+0000 7f2122a0e700 1 --2- 172.21.15.158:0/2381803814 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f211c0b6f20 0x7f211c0988e0 secure :-1 s=THROTTLE_DONE pgs=260 cs=0 l=1 rx=0x7f2110001450 tx=0x7f2114001990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:52.445 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.432+0000 7f2121a0c700 1 -- 172.21.15.158:0/2381803814 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2114001560 con 0x7f211c0b6f20 2019-12-05T03:50:52.445 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.432+0000 7f2121a0c700 1 -- 172.21.15.158:0/2381803814 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2118008d60 con 0x7f211c0b6f20 2019-12-05T03:50:52.445 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.432+0000 7f2124471700 1 -- 172.21.15.158:0/2381803814 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f211c0b6f20 msgr2=0x7f211c0988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:52.445 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.432+0000 7f2124471700 1 --2- 172.21.15.158:0/2381803814 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f211c0b6f20 0x7f211c0988e0 secure :-1 s=READY pgs=260 cs=0 l=1 rx=0x7f2110001450 tx=0x7f2114001990).stop 2019-12-05T03:50:52.446 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.432+0000 7f2124471700 1 -- 172.21.15.158:0/2381803814 shutdown_connections 2019-12-05T03:50:52.446 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.432+0000 7f2124471700 1 --2- 172.21.15.158:0/2381803814 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f211c0b6f20 0x7f211c0988e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:52.446 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.432+0000 7f2124471700 1 -- 172.21.15.158:0/2381803814 shutdown_connections 2019-12-05T03:50:52.446 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.432+0000 7f2124471700 1 -- 172.21.15.158:0/2381803814 wait complete. 2019-12-05T03:50:52.446 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.432+0000 7f2124471700 1 -- 172.21.15.158:0/2381803814 >> 172.21.15.158:0/2381803814 conn(0x7f211c05e370 msgr2=0x7f211c0b7370 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:52.450 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.436+0000 7f2124471700 1 Processor -- start 2019-12-05T03:50:52.450 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.436+0000 7f2124471700 1 -- start start 2019-12-05T03:50:52.450 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.436+0000 7f2124471700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f211c13d890 0x7f211c1545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:52.450 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.436+0000 7f2124471700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f211c152030 con 0x7f211c13d050 2019-12-05T03:50:52.450 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.436+0000 7f2124471700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f211c152470 con 0x7f211c09a320 2019-12-05T03:50:52.450 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.436+0000 7f2124471700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f211c1528a0 con 0x7f211c13d890 2019-12-05T03:50:52.451 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.436+0000 7f212320f700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f211c09a320 0x7f211c09a750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49940/0 (socket says 172.21.15.158:49940) 2019-12-05T03:50:52.451 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.436+0000 7f212320f700 1 -- 172.21.15.158:0/1336078554 learned_addr learned my addr 172.21.15.158:0/1336078554 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:52.451 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.436+0000 7f2122a0e700 1 --2- 172.21.15.158:0/1336078554 >> v2:172.21.15.96:3300/0 conn(0x7f211c13d890 0x7f211c1545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:52.451 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.436+0000 7f210f7fe700 1 -- 172.21.15.158:0/1336078554 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 618376686 0 0) 0x7f211c152470 con 0x7f211c09a320 2019-12-05T03:50:52.451 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.436+0000 7f210f7fe700 1 -- 172.21.15.158:0/1336078554 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21040030b0 con 0x7f211c09a320 2019-12-05T03:50:52.451 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.436+0000 7f2122a0e700 1 -- 172.21.15.158:0/1336078554 >> v1:172.21.15.158:6789/0 conn(0x7f211c09a320 legacy=0x7f211c09a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:52.452 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.436+0000 7f2122a0e700 1 -- 172.21.15.158:0/1336078554 >> v1:172.21.15.96:6789/0 conn(0x7f211c13d050 legacy=0x7f211c138ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:52.452 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.436+0000 7f210f7fe700 1 -- 172.21.15.158:0/1336078554 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1708164957 0 0) 0x7f21040030b0 con 0x7f211c09a320 2019-12-05T03:50:52.452 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.436+0000 7f2122a0e700 1 -- 172.21.15.158:0/1336078554 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211c13d480 con 0x7f211c13d890 2019-12-05T03:50:52.452 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.436+0000 7f2122a0e700 1 --2- 172.21.15.158:0/1336078554 >> v2:172.21.15.96:3300/0 conn(0x7f211c13d890 0x7f211c1545d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2110001520 tx=0x7f21100015a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:52.452 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.436+0000 7f2122a0e700 1 --2- 172.21.15.158:0/1336078554 >> v2:172.21.15.96:3300/0 conn(0x7f211c13d890 0x7f211c1545d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2110001520 tx=0x7f21100015a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:52.452 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.436+0000 7f2122a0e700 1 --2- 172.21.15.158:0/1336078554 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f211c13d890 0x7f211c1545d0 secure :-1 s=READY pgs=262 cs=0 l=1 rx=0x7f2110001520 tx=0x7f21100015a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:52.453 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.436+0000 7f2122a0e700 1 --2- 172.21.15.158:0/1336078554 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f211c13d890 0x7f211c1545d0 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7f2110001520 tx=0x7f21100015a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:52.453 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.436+0000 7f210f7fe700 1 -- 172.21.15.158:0/1336078554 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2118016060 con 0x7f211c13d890 2019-12-05T03:50:52.453 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.436+0000 7f2122a0e700 1 --2- 172.21.15.158:0/1336078554 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f211c13d890 0x7f211c1545d0 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7f2110001520 tx=0x7f21100015a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:52.453 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.436+0000 7f2122a0e700 1 --2- 172.21.15.158:0/1336078554 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f211c13d890 0x7f211c1545d0 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7f2110001520 tx=0x7f21100015a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:52.453 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.436+0000 7f210f7fe700 1 -- 172.21.15.158:0/1336078554 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21140011e0 con 0x7f211c13d890 2019-12-05T03:50:52.453 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.436+0000 7f2124471700 1 -- 172.21.15.158:0/1336078554 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f211c1392d0 con 0x7f211c13d890 2019-12-05T03:50:52.454 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.436+0000 7f210f7fe700 1 -- 172.21.15.158:0/1336078554 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21140013d0 con 0x7f211c13d890 2019-12-05T03:50:52.454 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.436+0000 7f2124471700 1 -- 172.21.15.158:0/1336078554 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f211c09af50 con 0x7f211c13d890 2019-12-05T03:50:52.454 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.440+0000 7f2122a0e700 1 --2- 172.21.15.158:0/1336078554 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f211c13d890 0x7f211c1545d0 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7f2110001520 tx=0x7f21100015a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:52.454 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.440+0000 7f210f7fe700 1 -- 172.21.15.158:0/1336078554 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f21180115e0 con 0x7f211c13d890 2019-12-05T03:50:52.454 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.440+0000 7f2122a0e700 1 --2- 172.21.15.158:0/1336078554 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f211c13d890 0x7f211c1545d0 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7f2110001520 tx=0x7f21100015a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:52.454 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.440+0000 7f210f7fe700 1 --2- 172.21.15.158:0/1336078554 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f210403b270 0x7f210403d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:52.454 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.440+0000 7f210f7fe700 1 -- 172.21.15.158:0/1336078554 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6367+0+0 (secure 0 0 0) 0x7f211804a8d0 con 0x7f211c13d890 2019-12-05T03:50:52.455 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.440+0000 7f212220d700 1 --2- 172.21.15.158:0/1336078554 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f210403b270 0x7f210403d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:52.455 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.440+0000 7f212220d700 1 --2- 172.21.15.158:0/1336078554 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f210403b270 0x7f210403d780 crc :-1 s=READY pgs=168 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:52.455 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.444+0000 7f2124471700 1 -- 172.21.15.158:0/1336078554 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f211c1526a0 con 0x7f211c13d890 2019-12-05T03:50:52.464 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.456+0000 7f2122a0e700 1 --2- 172.21.15.158:0/1336078554 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f211c13d890 0x7f211c1545d0 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7f2110001520 tx=0x7f21100015a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:52.464 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.456+0000 7f210f7fe700 1 -- 172.21.15.158:0/1336078554 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f2118007780 con 0x7f211c13d890 2019-12-05T03:50:52.632 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.624+0000 7f2124471700 1 -- 172.21.15.158:0/1336078554 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"} v 0) v1 -- 0x7f211c0554e0 con 0x7f211c13d890 2019-12-05T03:50:52.642 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.636+0000 7f2122a0e700 1 --2- 172.21.15.158:0/1336078554 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f211c13d890 0x7f211c1545d0 secure :-1 s=THROTTLE_DONE pgs=262 cs=0 l=1 rx=0x7f2110001520 tx=0x7f21100015a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:52.644 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.636+0000 7f210f7fe700 1 -- 172.21.15.158:0/1336078554 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"}]=0 added data pool 6 to fsmap v16) v1 ==== 131+0+0 (secure 0 0 0) 0x7f2118031910 con 0x7f211c13d890 2019-12-05T03:50:52.647 INFO:teuthology.orchestra.run.smithi158.stderr:added data pool 6 to fsmap 2019-12-05T03:50:52.650 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.644+0000 7f2124471700 1 -- 172.21.15.158:0/1336078554 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f210403b270 msgr2=0x7f210403d780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:52.650 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.644+0000 7f2124471700 1 --2- 172.21.15.158:0/1336078554 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f210403b270 0x7f210403d780 crc :-1 s=READY pgs=168 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:52.651 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.644+0000 7f2124471700 1 -- 172.21.15.158:0/1336078554 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f211c13d890 msgr2=0x7f211c1545d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:52.651 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.644+0000 7f2124471700 1 --2- 172.21.15.158:0/1336078554 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f211c13d890 0x7f211c1545d0 secure :-1 s=READY pgs=262 cs=0 l=1 rx=0x7f2110001520 tx=0x7f21100015a0).stop 2019-12-05T03:50:52.651 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.644+0000 7f2124471700 1 -- 172.21.15.158:0/1336078554 shutdown_connections 2019-12-05T03:50:52.651 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.644+0000 7f2124471700 1 --2- 172.21.15.158:0/1336078554 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f211c13d890 0x7f211c1545d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:52.651 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.644+0000 7f2124471700 1 --2- 172.21.15.158:0/1336078554 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f210403b270 0x7f210403d780 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:52.651 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.644+0000 7f2124471700 1 -- 172.21.15.158:0/1336078554 shutdown_connections 2019-12-05T03:50:52.652 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.644+0000 7f2124471700 1 -- 172.21.15.158:0/1336078554 wait complete. 2019-12-05T03:50:52.652 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.644+0000 7f2124471700 1 -- 172.21.15.158:0/1336078554 >> 172.21.15.158:0/1336078554 conn(0x7f211c0b34a0 msgr2=0x7f211c07d800 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:52.660 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-12-05T03:50:52.755 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.744+0000 7f5a8927b700 1 Processor -- start 2019-12-05T03:50:52.755 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.744+0000 7f5a8927b700 1 -- start start 2019-12-05T03:50:52.755 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.744+0000 7f5a8927b700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5a8409cf60 0x7f5a8409a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:52.755 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.744+0000 7f5a8927b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5a8405a740 0x7f5a84151460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:52.755 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.744+0000 7f5a8927b700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a840accb0 con 0x7f5a841519b0 2019-12-05T03:50:52.755 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.744+0000 7f5a8927b700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a840b1730 con 0x7f5a8405a740 2019-12-05T03:50:52.756 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.744+0000 7f5a8927b700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a840b19d0 con 0x7f5a8409cf60 2019-12-05T03:50:52.756 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.744+0000 7f5a82ffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5a8405a740 0x7f5a84151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:52.756 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.744+0000 7f5a82ffd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f5a8405a740 0x7f5a84151460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:55170/0 (socket says 172.21.15.158:55170) 2019-12-05T03:50:52.756 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.744+0000 7f5a82ffd700 1 -- 172.21.15.158:0/7900785 learned_addr learned my addr 172.21.15.158:0/7900785 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:52.756 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.744+0000 7f5a837fe700 1 --2- 172.21.15.158:0/7900785 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5a8409cf60 0x7f5a8409a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:52.756 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.744+0000 7f5a827fc700 1 -- 172.21.15.158:0/7900785 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3960287734 0 0) 0x7f5a840accb0 con 0x7f5a841519b0 2019-12-05T03:50:52.756 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.744+0000 7f5a82ffd700 1 -- 172.21.15.158:0/7900785 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5a8409cf60 msgr2=0x7f5a8409a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:52.757 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.744+0000 7f5a82ffd700 1 --2- 172.21.15.158:0/7900785 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5a8409cf60 0x7f5a8409a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:52.757 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.744+0000 7f5a82ffd700 1 -- 172.21.15.158:0/7900785 >> v1:172.21.15.96:6789/0 conn(0x7f5a841519b0 legacy=0x7f5a840b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:52.757 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.744+0000 7f5a82ffd700 1 -- 172.21.15.158:0/7900785 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a8405ab70 con 0x7f5a8405a740 2019-12-05T03:50:52.757 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.744+0000 7f5a82ffd700 1 --2- 172.21.15.158:0/7900785 >> v2:172.21.15.158:3300/0 conn(0x7f5a8405a740 0x7f5a84151460 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5a840b18f0 tx=0x7f5a7c00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:52.757 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.744+0000 7f5a82ffd700 1 --2- 172.21.15.158:0/7900785 >> v2:172.21.15.158:3300/0 conn(0x7f5a8405a740 0x7f5a84151460 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5a840b18f0 tx=0x7f5a7c00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:52.757 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.744+0000 7f5a82ffd700 1 --2- 172.21.15.158:0/7900785 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a8405a740 0x7f5a84151460 secure :-1 s=READY pgs=365 cs=0 l=1 rx=0x7f5a840b18f0 tx=0x7f5a7c00fd30).ready entity=mon.1 client_cookie=64bb990e1d8e179e server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:52.757 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.744+0000 7f5a82ffd700 1 --2- 172.21.15.158:0/7900785 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a8405a740 0x7f5a84151460 secure :-1 s=THROTTLE_DONE pgs=365 cs=0 l=1 rx=0x7f5a840b18f0 tx=0x7f5a7c00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:52.758 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.744+0000 7f5a827fc700 1 -- 172.21.15.158:0/7900785 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a7c0113b0 con 0x7f5a8405a740 2019-12-05T03:50:52.758 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.744+0000 7f5a82ffd700 1 --2- 172.21.15.158:0/7900785 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a8405a740 0x7f5a84151460 secure :-1 s=THROTTLE_DONE pgs=365 cs=0 l=1 rx=0x7f5a840b18f0 tx=0x7f5a7c00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:52.758 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.744+0000 7f5a82ffd700 1 --2- 172.21.15.158:0/7900785 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a8405a740 0x7f5a84151460 secure :-1 s=THROTTLE_DONE pgs=365 cs=0 l=1 rx=0x7f5a840b18f0 tx=0x7f5a7c00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:52.758 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.744+0000 7f5a827fc700 1 -- 172.21.15.158:0/7900785 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7c008bb0 con 0x7f5a8405a740 2019-12-05T03:50:52.758 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.744+0000 7f5a827fc700 1 -- 172.21.15.158:0/7900785 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a7c011990 con 0x7f5a8405a740 2019-12-05T03:50:52.758 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.744+0000 7f5a8927b700 1 -- 172.21.15.158:0/7900785 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a8405a740 msgr2=0x7f5a84151460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:52.758 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.744+0000 7f5a8927b700 1 --2- 172.21.15.158:0/7900785 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a8405a740 0x7f5a84151460 secure :-1 s=READY pgs=365 cs=0 l=1 rx=0x7f5a840b18f0 tx=0x7f5a7c00fd30).stop 2019-12-05T03:50:52.759 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.748+0000 7f5a8927b700 1 -- 172.21.15.158:0/7900785 shutdown_connections 2019-12-05T03:50:52.759 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.748+0000 7f5a8927b700 1 --2- 172.21.15.158:0/7900785 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5a8409cf60 0x7f5a8409a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:52.759 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.748+0000 7f5a8927b700 1 --2- 172.21.15.158:0/7900785 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f5a8405a740 0x7f5a84151460 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:52.759 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.748+0000 7f5a8927b700 1 -- 172.21.15.158:0/7900785 shutdown_connections 2019-12-05T03:50:52.759 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.748+0000 7f5a8927b700 1 -- 172.21.15.158:0/7900785 wait complete. 2019-12-05T03:50:52.759 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.748+0000 7f5a8927b700 1 -- 172.21.15.158:0/7900785 >> 172.21.15.158:0/7900785 conn(0x7f5a840b7e60 msgr2=0x7f5a840b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:52.762 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.748+0000 7f5a8927b700 1 Processor -- start 2019-12-05T03:50:52.762 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.752+0000 7f5a8927b700 1 -- start start 2019-12-05T03:50:52.762 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.752+0000 7f5a8927b700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5a840b0b50 0x7f5a8407b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:52.762 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.752+0000 7f5a8927b700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5a84153280 0x7f5a8413ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:52.762 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.752+0000 7f5a8927b700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a84138a50 con 0x7f5a840b5810 2019-12-05T03:50:52.763 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.752+0000 7f5a8927b700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a84138c80 con 0x7f5a840b0b50 2019-12-05T03:50:52.763 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.752+0000 7f5a8927b700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a840b1020 con 0x7f5a84153280 2019-12-05T03:50:52.763 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.752+0000 7f5a82ffd700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5a84153280 0x7f5a8413ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:52.763 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.752+0000 7f5a837fe700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5a840b0b50 0x7f5a8407b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:52.763 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.752+0000 7f5a82ffd700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5a84153280 0x7f5a8413ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.158:37918/0 (socket says 172.21.15.158:37918) 2019-12-05T03:50:52.763 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.752+0000 7f5a82ffd700 1 -- 172.21.15.158:0/944706760 learned_addr learned my addr 172.21.15.158:0/944706760 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:50:52.763 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.752+0000 7f5a82ffd700 1 -- 172.21.15.158:0/944706760 >> v2:172.21.15.96:3300/0 conn(0x7f5a840b0b50 msgr2=0x7f5a8407b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:52.764 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.752+0000 7f5a82ffd700 1 --2- 172.21.15.158:0/944706760 >> v2:172.21.15.96:3300/0 conn(0x7f5a840b0b50 0x7f5a8407b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:52.764 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.752+0000 7f5a82ffd700 1 -- 172.21.15.158:0/944706760 >> v1:172.21.15.96:6789/0 conn(0x7f5a840b5810 legacy=0x7f5a8412c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:52.764 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.752+0000 7f5a82ffd700 1 -- 172.21.15.158:0/944706760 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a840b5c40 con 0x7f5a84153280 2019-12-05T03:50:52.764 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.752+0000 7f5a82ffd700 1 --2- 172.21.15.158:0/944706760 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5a84153280 0x7f5a8413ca20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5a840b18f0 tx=0x7f5a7c008bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:52.764 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.752+0000 7f5a82ffd700 1 --2- 172.21.15.158:0/944706760 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5a84153280 0x7f5a8413ca20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5a840b18f0 tx=0x7f5a7c008bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:52.764 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.752+0000 7f5a82ffd700 1 --2- 172.21.15.158:0/944706760 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5a84153280 0x7f5a8413ca20 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f5a840b18f0 tx=0x7f5a7c008bb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:52.764 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.752+0000 7f5a82ffd700 1 --2- 172.21.15.158:0/944706760 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5a84153280 0x7f5a8413ca20 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f5a840b18f0 tx=0x7f5a7c008bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:52.765 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.752+0000 7f5a7bfff700 1 -- 172.21.15.158:0/944706760 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a7c007150 con 0x7f5a84153280 2019-12-05T03:50:52.765 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.752+0000 7f5a82ffd700 1 --2- 172.21.15.158:0/944706760 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5a84153280 0x7f5a8413ca20 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f5a840b18f0 tx=0x7f5a7c008bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:52.765 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.752+0000 7f5a82ffd700 1 --2- 172.21.15.158:0/944706760 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5a84153280 0x7f5a8413ca20 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f5a840b18f0 tx=0x7f5a7c008bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:52.765 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.752+0000 7f5a7bfff700 1 -- 172.21.15.158:0/944706760 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7c0115b0 con 0x7f5a84153280 2019-12-05T03:50:52.765 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.752+0000 7f5a8927b700 1 -- 172.21.15.158:0/944706760 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a840b5eb0 con 0x7f5a84153280 2019-12-05T03:50:52.765 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.752+0000 7f5a7bfff700 1 -- 172.21.15.158:0/944706760 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a7c005730 con 0x7f5a84153280 2019-12-05T03:50:52.769 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.752+0000 7f5a8927b700 1 -- 172.21.15.158:0/944706760 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a8412cc40 con 0x7f5a84153280 2019-12-05T03:50:52.769 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.756+0000 7f5a82ffd700 1 --2- 172.21.15.158:0/944706760 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5a84153280 0x7f5a8413ca20 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f5a840b18f0 tx=0x7f5a7c008bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:52.772 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.756+0000 7f5a7bfff700 1 -- 172.21.15.158:0/944706760 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f5a7c005a40 con 0x7f5a84153280 2019-12-05T03:50:52.772 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.756+0000 7f5a82ffd700 1 --2- 172.21.15.158:0/944706760 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5a84153280 0x7f5a8413ca20 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f5a840b18f0 tx=0x7f5a7c008bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:52.772 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.756+0000 7f5a7bfff700 1 --2- 172.21.15.158:0/944706760 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f5a6803ad40 0x7f5a6803d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:52.772 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.756+0000 7f5a7bfff700 1 -- 172.21.15.158:0/944706760 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6399+0+0 (secure 0 0 0) 0x7f5a7c08f4b0 con 0x7f5a84153280 2019-12-05T03:50:52.773 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.756+0000 7f5a837fe700 1 --2- 172.21.15.158:0/944706760 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f5a6803ad40 0x7f5a6803d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:52.773 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.756+0000 7f5a837fe700 1 --2- 172.21.15.158:0/944706760 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f5a6803ad40 0x7f5a6803d250 crc :-1 s=READY pgs=169 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:52.773 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.760+0000 7f5a8927b700 1 -- 172.21.15.158:0/944706760 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a840554e0 con 0x7f5a84153280 2019-12-05T03:50:52.773 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.768+0000 7f5a82ffd700 1 --2- 172.21.15.158:0/944706760 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5a84153280 0x7f5a8413ca20 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f5a840b18f0 tx=0x7f5a7c008bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:52.773 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.768+0000 7f5a7bfff700 1 -- 172.21.15.158:0/944706760 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f5a7c076530 con 0x7f5a84153280 2019-12-05T03:50:52.941 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.936+0000 7f5a8927b700 1 -- 172.21.15.158:0/944706760 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a84066940 con 0x7f5a84153280 2019-12-05T03:50:52.942 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.936+0000 7f5a82ffd700 1 --2- 172.21.15.158:0/944706760 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5a84153280 0x7f5a8413ca20 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7f5a840b18f0 tx=0x7f5a7c008bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:52.942 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.936+0000 7f5a7bfff700 1 -- 172.21.15.158:0/944706760 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2111 (secure 0 0 0) 0x7f5a7c076790 con 0x7f5a84153280 2019-12-05T03:50:52.945 INFO:teuthology.orchestra.run.smithi158.stderr:dumped fsmap epoch 16 2019-12-05T03:50:52.945 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:52.945 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4604,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.96:6835/4291398037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":4291398037},{"type":"v1","addr":"172.21.15.96:6835","nonce":4291398037}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":15}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-12-05T03:50:44.549123+0000","modified":"2019-12-05T03:50:52.631965+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5095},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5095":{"gid":5095,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":2,"addr":"172.21.15.158:6833/2078196109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":2078196109},{"type":"v1","addr":"172.21.15.158:6833","nonce":2078196109}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2019-12-05T03:50:52.949 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.940+0000 7f5a8927b700 1 -- 172.21.15.158:0/944706760 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f5a6803ad40 msgr2=0x7f5a6803d250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:52.949 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.940+0000 7f5a8927b700 1 --2- 172.21.15.158:0/944706760 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f5a6803ad40 0x7f5a6803d250 crc :-1 s=READY pgs=169 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:52.949 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.940+0000 7f5a8927b700 1 -- 172.21.15.158:0/944706760 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5a84153280 msgr2=0x7f5a8413ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:52.950 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.940+0000 7f5a8927b700 1 --2- 172.21.15.158:0/944706760 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5a84153280 0x7f5a8413ca20 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7f5a840b18f0 tx=0x7f5a7c008bb0).stop 2019-12-05T03:50:52.950 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.940+0000 7f5a8927b700 1 -- 172.21.15.158:0/944706760 shutdown_connections 2019-12-05T03:50:52.950 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.940+0000 7f5a8927b700 1 --2- 172.21.15.158:0/944706760 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f5a6803ad40 0x7f5a6803d250 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:52.950 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.940+0000 7f5a8927b700 1 --2- 172.21.15.158:0/944706760 >> v2:172.21.15.96:3300/0 conn(0x7f5a840b0b50 0x7f5a8407b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:52.950 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.940+0000 7f5a8927b700 1 --2- 172.21.15.158:0/944706760 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f5a84153280 0x7f5a8413ca20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:52.951 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.940+0000 7f5a8927b700 1 -- 172.21.15.158:0/944706760 shutdown_connections 2019-12-05T03:50:52.951 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.940+0000 7f5a8927b700 1 -- 172.21.15.158:0/944706760 wait complete. 2019-12-05T03:50:52.951 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:52.940+0000 7f5a8927b700 1 -- 172.21.15.158:0/944706760 >> 172.21.15.158:0/944706760 conn(0x7f5a84155ec0 msgr2=0x7f5a8412e650 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:52.962 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-05T03:50:53.068 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.056+0000 7fd43322f700 1 Processor -- start 2019-12-05T03:50:53.068 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.056+0000 7fd43322f700 1 -- start start 2019-12-05T03:50:53.068 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.056+0000 7fd43322f700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd42c09cf60 0x7fd42c09a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:53.069 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.056+0000 7fd43322f700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd42c05a740 0x7fd42c151460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:53.069 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.056+0000 7fd43322f700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd42c0accb0 con 0x7fd42c1519b0 2019-12-05T03:50:53.069 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.056+0000 7fd43322f700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd42c0b1730 con 0x7fd42c09cf60 2019-12-05T03:50:53.069 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.056+0000 7fd43322f700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c0b19d0 con 0x7fd42c05a740 2019-12-05T03:50:53.069 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.056+0000 7fd431fcd700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fd42c1519b0 0x7fd42c0b52e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49966/0 (socket says 172.21.15.158:49966) 2019-12-05T03:50:53.069 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.056+0000 7fd431fcd700 1 -- 172.21.15.158:0/4158126172 learned_addr learned my addr 172.21.15.158:0/4158126172 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:53.069 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.056+0000 7fd4317cc700 1 --2- 172.21.15.158:0/4158126172 >> v2:172.21.15.96:3300/0 conn(0x7fd42c09cf60 0x7fd42c09a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:53.070 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.056+0000 7fd430fcb700 1 --2- 172.21.15.158:0/4158126172 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd42c05a740 0x7fd42c151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:53.070 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.056+0000 7fd42bfff700 1 -- 172.21.15.158:0/4158126172 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 949368048 0 0) 0x7fd42c0accb0 con 0x7fd42c1519b0 2019-12-05T03:50:53.070 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.056+0000 7fd42bfff700 1 -- 172.21.15.158:0/4158126172 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4140030b0 con 0x7fd42c1519b0 2019-12-05T03:50:53.070 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.056+0000 7fd4317cc700 1 -- 172.21.15.158:0/4158126172 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd42c05a740 msgr2=0x7fd42c151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:53.070 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.056+0000 7fd4317cc700 1 --2- 172.21.15.158:0/4158126172 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd42c05a740 0x7fd42c151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:53.070 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.056+0000 7fd4317cc700 1 -- 172.21.15.158:0/4158126172 >> v1:172.21.15.158:6789/0 conn(0x7fd42c1519b0 legacy=0x7fd42c0b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:53.070 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.056+0000 7fd4317cc700 1 -- 172.21.15.158:0/4158126172 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42c05ab70 con 0x7fd42c09cf60 2019-12-05T03:50:53.071 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.056+0000 7fd4317cc700 1 --2- 172.21.15.158:0/4158126172 >> v2:172.21.15.96:3300/0 conn(0x7fd42c09cf60 0x7fd42c09a320 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd42c0b18f0 tx=0x7fd42000fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:53.071 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.056+0000 7fd4317cc700 1 --2- 172.21.15.158:0/4158126172 >> v2:172.21.15.96:3300/0 conn(0x7fd42c09cf60 0x7fd42c09a320 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd42c0b18f0 tx=0x7fd42000fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:53.071 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.056+0000 7fd4317cc700 1 --2- 172.21.15.158:0/4158126172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd42c09cf60 0x7fd42c09a320 secure :-1 s=READY pgs=265 cs=0 l=1 rx=0x7fd42c0b18f0 tx=0x7fd42000fc70).ready entity=mon.0 client_cookie=8f30184a005741cf server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:53.071 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.060+0000 7fd4317cc700 1 --2- 172.21.15.158:0/4158126172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd42c09cf60 0x7fd42c09a320 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7fd42c0b18f0 tx=0x7fd42000fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:53.071 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.060+0000 7fd42bfff700 1 -- 172.21.15.158:0/4158126172 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4200112f0 con 0x7fd42c09cf60 2019-12-05T03:50:53.071 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.060+0000 7fd4317cc700 1 --2- 172.21.15.158:0/4158126172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd42c09cf60 0x7fd42c09a320 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7fd42c0b18f0 tx=0x7fd42000fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:53.071 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.060+0000 7fd42bfff700 1 -- 172.21.15.158:0/4158126172 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd420008ad0 con 0x7fd42c09cf60 2019-12-05T03:50:53.072 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.060+0000 7fd4317cc700 1 --2- 172.21.15.158:0/4158126172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd42c09cf60 0x7fd42c09a320 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7fd42c0b18f0 tx=0x7fd42000fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:53.072 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.060+0000 7fd42bfff700 1 -- 172.21.15.158:0/4158126172 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4200118d0 con 0x7fd42c09cf60 2019-12-05T03:50:53.072 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.060+0000 7fd43322f700 1 -- 172.21.15.158:0/4158126172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd42c09cf60 msgr2=0x7fd42c09a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:53.072 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.060+0000 7fd43322f700 1 --2- 172.21.15.158:0/4158126172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd42c09cf60 0x7fd42c09a320 secure :-1 s=READY pgs=265 cs=0 l=1 rx=0x7fd42c0b18f0 tx=0x7fd42000fc70).stop 2019-12-05T03:50:53.072 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.060+0000 7fd43322f700 1 -- 172.21.15.158:0/4158126172 shutdown_connections 2019-12-05T03:50:53.072 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.060+0000 7fd43322f700 1 --2- 172.21.15.158:0/4158126172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd42c09cf60 0x7fd42c09a320 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:53.072 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.060+0000 7fd43322f700 1 --2- 172.21.15.158:0/4158126172 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd42c05a740 0x7fd42c151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:53.073 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.060+0000 7fd43322f700 1 -- 172.21.15.158:0/4158126172 shutdown_connections 2019-12-05T03:50:53.073 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.060+0000 7fd43322f700 1 -- 172.21.15.158:0/4158126172 wait complete. 2019-12-05T03:50:53.073 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.060+0000 7fd43322f700 1 -- 172.21.15.158:0/4158126172 >> 172.21.15.158:0/4158126172 conn(0x7fd42c0b7e60 msgr2=0x7fd42c0b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:53.073 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.060+0000 7fd43322f700 1 Processor -- start 2019-12-05T03:50:53.073 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.060+0000 7fd43322f700 1 -- start start 2019-12-05T03:50:53.077 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.060+0000 7fd43322f700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fd42c140e40 0x7fd42c154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:53.077 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.060+0000 7fd43322f700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd42c140160 0x7fd42c128d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:53.077 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.060+0000 7fd43322f700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd42c1278d0 con 0x7fd42c09bbd0 2019-12-05T03:50:53.077 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.064+0000 7fd4317cc700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fd42c09bbd0 0x7fd42c12c640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49968/0 (socket says 172.21.15.158:49968) 2019-12-05T03:50:53.078 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.064+0000 7fd4317cc700 1 -- 172.21.15.158:0/1406267178 learned_addr learned my addr 172.21.15.158:0/1406267178 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:53.078 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.064+0000 7fd43322f700 1 -- 172.21.15.158:0/1406267178 --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd42c1440e0 con 0x7fd42c140e40 2019-12-05T03:50:53.078 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.064+0000 7fd43322f700 1 -- 172.21.15.158:0/1406267178 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c144600 con 0x7fd42c140160 2019-12-05T03:50:53.078 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.064+0000 7fd430fcb700 1 --2- 172.21.15.158:0/1406267178 >> v2:172.21.15.158:3300/0 conn(0x7fd42c140e40 0x7fd42c154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:53.078 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.064+0000 7fd431fcd700 1 --2- 172.21.15.158:0/1406267178 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd42c140160 0x7fd42c128d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:53.078 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.064+0000 7fd429ffb700 1 -- 172.21.15.158:0/1406267178 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1187420262 0 0) 0x7fd42c1278d0 con 0x7fd42c09bbd0 2019-12-05T03:50:53.078 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.064+0000 7fd429ffb700 1 -- 172.21.15.158:0/1406267178 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd40c0030b0 con 0x7fd42c09bbd0 2019-12-05T03:50:53.079 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.064+0000 7fd430fcb700 1 -- 172.21.15.158:0/1406267178 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd42c140160 msgr2=0x7fd42c128d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:53.079 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.064+0000 7fd430fcb700 1 --2- 172.21.15.158:0/1406267178 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd42c140160 0x7fd42c128d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:53.079 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.064+0000 7fd430fcb700 1 -- 172.21.15.158:0/1406267178 >> v1:172.21.15.158:6789/0 conn(0x7fd42c09bbd0 legacy=0x7fd42c12c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:53.079 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.064+0000 7fd430fcb700 1 -- 172.21.15.158:0/1406267178 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42c1292d0 con 0x7fd42c140e40 2019-12-05T03:50:53.079 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.064+0000 7fd430fcb700 1 --2- 172.21.15.158:0/1406267178 >> v2:172.21.15.158:3300/0 conn(0x7fd42c140e40 0x7fd42c154cb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd4240032b0 tx=0x7fd424010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:53.079 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.064+0000 7fd430fcb700 1 --2- 172.21.15.158:0/1406267178 >> v2:172.21.15.158:3300/0 conn(0x7fd42c140e40 0x7fd42c154cb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd4240032b0 tx=0x7fd424010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:53.080 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.064+0000 7fd430fcb700 1 --2- 172.21.15.158:0/1406267178 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd42c140e40 0x7fd42c154cb0 secure :-1 s=READY pgs=368 cs=0 l=1 rx=0x7fd4240032b0 tx=0x7fd424010ee0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:53.080 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.064+0000 7fd430fcb700 1 --2- 172.21.15.158:0/1406267178 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd42c140e40 0x7fd42c154cb0 secure :-1 s=THROTTLE_DONE pgs=368 cs=0 l=1 rx=0x7fd4240032b0 tx=0x7fd424010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:53.080 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.064+0000 7fd429ffb700 1 -- 172.21.15.158:0/1406267178 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd424012b80 con 0x7fd42c140e40 2019-12-05T03:50:53.080 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.064+0000 7fd430fcb700 1 --2- 172.21.15.158:0/1406267178 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd42c140e40 0x7fd42c154cb0 secure :-1 s=THROTTLE_DONE pgs=368 cs=0 l=1 rx=0x7fd4240032b0 tx=0x7fd424010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:53.080 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.064+0000 7fd43322f700 1 -- 172.21.15.158:0/1406267178 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd42c1295a0 con 0x7fd42c140e40 2019-12-05T03:50:53.080 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.064+0000 7fd429ffb700 1 -- 172.21.15.158:0/1406267178 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42400e160 con 0x7fd42c140e40 2019-12-05T03:50:53.081 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.064+0000 7fd430fcb700 1 --2- 172.21.15.158:0/1406267178 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd42c140e40 0x7fd42c154cb0 secure :-1 s=THROTTLE_DONE pgs=368 cs=0 l=1 rx=0x7fd4240032b0 tx=0x7fd424010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:53.081 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.064+0000 7fd429ffb700 1 -- 172.21.15.158:0/1406267178 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd424005ab0 con 0x7fd42c140e40 2019-12-05T03:50:53.081 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.064+0000 7fd43322f700 1 -- 172.21.15.158:0/1406267178 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd42c129b20 con 0x7fd42c140e40 2019-12-05T03:50:53.081 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.064+0000 7fd430fcb700 1 --2- 172.21.15.158:0/1406267178 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd42c140e40 0x7fd42c154cb0 secure :-1 s=THROTTLE_DONE pgs=368 cs=0 l=1 rx=0x7fd4240032b0 tx=0x7fd424010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:53.081 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.064+0000 7fd429ffb700 1 -- 172.21.15.158:0/1406267178 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fd424007180 con 0x7fd42c140e40 2019-12-05T03:50:53.081 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.064+0000 7fd430fcb700 1 --2- 172.21.15.158:0/1406267178 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd42c140e40 0x7fd42c154cb0 secure :-1 s=THROTTLE_DONE pgs=368 cs=0 l=1 rx=0x7fd4240032b0 tx=0x7fd424010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:53.082 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.064+0000 7fd429ffb700 1 --2- 172.21.15.158:0/1406267178 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd40c03b250 0x7fd40c03d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:53.082 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.064+0000 7fd429ffb700 1 -- 172.21.15.158:0/1406267178 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6399+0+0 (secure 0 0 0) 0x7fd42404aff0 con 0x7fd42c140e40 2019-12-05T03:50:53.082 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.064+0000 7fd4317cc700 1 --2- 172.21.15.158:0/1406267178 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd40c03b250 0x7fd40c03d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:53.082 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.068+0000 7fd4317cc700 1 --2- 172.21.15.158:0/1406267178 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd40c03b250 0x7fd40c03d760 crc :-1 s=READY pgs=170 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:53.082 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.072+0000 7fd43322f700 1 -- 172.21.15.158:0/1406267178 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd42c07ce40 con 0x7fd42c140e40 2019-12-05T03:50:53.084 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.076+0000 7fd430fcb700 1 --2- 172.21.15.158:0/1406267178 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd42c140e40 0x7fd42c154cb0 secure :-1 s=THROTTLE_DONE pgs=368 cs=0 l=1 rx=0x7fd4240032b0 tx=0x7fd424010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:53.084 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.076+0000 7fd429ffb700 1 -- 172.21.15.158:0/1406267178 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fd424032050 con 0x7fd42c140e40 2019-12-05T03:50:53.247 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.240+0000 7fd43322f700 1 -- 172.21.15.158:0/1406267178 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd42c0554e0 con 0x7fd42c140e40 2019-12-05T03:50:53.247 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.240+0000 7fd430fcb700 1 --2- 172.21.15.158:0/1406267178 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd42c140e40 0x7fd42c154cb0 secure :-1 s=THROTTLE_DONE pgs=368 cs=0 l=1 rx=0x7fd4240032b0 tx=0x7fd424010ee0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:53.248 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.240+0000 7fd429ffb700 1 -- 172.21.15.158:0/1406267178 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16310 (secure 0 0 0) 0x7fd4240322b0 con 0x7fd42c140e40 2019-12-05T03:50:53.250 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:50:53.251 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":34,"fsid":"a91186ae-f496-4de1-918d-820c55ff1feb","created":"2019-12-05T03:49:39.187523+0000","modified":"2019-12-05T03:50:52.631414+0000","last_up_change":"2019-12-05T03:49:48.551934+0000","last_in_change":"2019-12-05T03:49:48.551934+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-05T03:49:52.900870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2019-12-05T03:50:42.436744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2019-12-05T03:50:43.620710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"data_new","create_time":"2019-12-05T03:50:51.740163+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"782c4258-e28c-4a11-9d54-3c9c7a36fba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":12192},{"type":"v1","addr":"172.21.15.158:6801","nonce":12192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":12192},{"type":"v1","addr":"172.21.15.158:6803","nonce":12192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":12192},{"type":"v1","addr":"172.21.15.158:6807","nonce":12192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":12192},{"type":"v1","addr":"172.21.15.158:6805","nonce":12192}]},"public_addr":"172.21.15.158:6801/12192","cluster_addr":"172.21.15.158:6803/12192","heartbeat_back_addr":"172.21.15.158:6807/12192","heartbeat_front_addr":"172.21.15.158:6805/12192","state":["exists","up"]},{"osd":1,"uuid":"d4426b21-b666-4158-bf34-a24b14572731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":12193},{"type":"v1","addr":"172.21.15.158:6809","nonce":12193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":12193},{"type":"v1","addr":"172.21.15.158:6811","nonce":12193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":12193},{"type":"v1","addr":"172.21.15.158:6815","nonce":12193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":12193},{"type":"v1","addr":"172.21.15.158:6813","nonce":12193}]},"public_addr":"172.21.15.158:6809/12193","cluster_addr":"172.21.15.158:6811/12193","heartbeat_back_addr":"172.21.15.158:6815/12193","heartbeat_front_addr":"172.21.15.158:6813/12193","state":["exists","up"]},{"osd":2,"uuid":"22680edd-6490-4ab0-bb15-0605830e4cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":12195},{"type":"v1","addr":"172.21.15.158:6825","nonce":12195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":12195},{"type":"v1","addr":"172.21.15.158:6827","nonce":12195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":12195},{"type":"v1","addr":"172.21.15.158:6831","nonce":12195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":12195},{"type":"v1","addr":"172.21.15.158:6829","nonce":12195}]},"public_addr":"172.21.15.158:6825/12195","cluster_addr":"172.21.15.158:6827/12195","heartbeat_back_addr":"172.21.15.158:6831/12195","heartbeat_front_addr":"172.21.15.158:6829/12195","state":["exists","up"]},{"osd":3,"uuid":"7ec999ee-ace8-4ccb-a4f9-6f5d313bbbd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":12194},{"type":"v1","addr":"172.21.15.158:6817","nonce":12194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":12194},{"type":"v1","addr":"172.21.15.158:6819","nonce":12194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":12194},{"type":"v1","addr":"172.21.15.158:6823","nonce":12194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":12194},{"type":"v1","addr":"172.21.15.158:6821","nonce":12194}]},"public_addr":"172.21.15.158:6817/12194","cluster_addr":"172.21.15.158:6819/12194","heartbeat_back_addr":"172.21.15.158:6823/12194","heartbeat_front_addr":"172.21.15.158:6821/12194","state":["exists","up"]},{"osd":4,"uuid":"186e69c4-b69f-4dd1-bb8f-faf759c60484","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":12460},{"type":"v1","addr":"172.21.15.96:6803","nonce":12460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":12460},{"type":"v1","addr":"172.21.15.96:6805","nonce":12460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":12460},{"type":"v1","addr":"172.21.15.96:6809","nonce":12460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":12460},{"type":"v1","addr":"172.21.15.96:6807","nonce":12460}]},"public_addr":"172.21.15.96:6803/12460","cluster_addr":"172.21.15.96:6805/12460","heartbeat_back_addr":"172.21.15.96:6809/12460","heartbeat_front_addr":"172.21.15.96:6807/12460","state":["exists","up"]},{"osd":5,"uuid":"86b658b2-8b40-4cea-8163-305a3982758b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":12461},{"type":"v1","addr":"172.21.15.96:6811","nonce":12461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":12461},{"type":"v1","addr":"172.21.15.96:6813","nonce":12461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":12461},{"type":"v1","addr":"172.21.15.96:6817","nonce":12461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":12461},{"type":"v1","addr":"172.21.15.96:6815","nonce":12461}]},"public_addr":"172.21.15.96:6811/12461","cluster_addr":"172.21.15.96:6813/12461","heartbeat_back_addr":"172.21.15.96:6817/12461","heartbeat_front_addr":"172.21.15.96:6815/12461","state":["exists","up"]},{"osd":6,"uuid":"bdadaea8-9296-4788-bc59-d9c9eb8defdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":12463},{"type":"v1","addr":"172.21.15.96:6827","nonce":12463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":12463},{"type":"v1","addr":"172.21.15.96:6829","nonce":12463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":12463},{"type":"v1","addr":"172.21.15.96:6833","nonce":12463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":12463},{"type":"v1","addr":"172.21.15.96:6831","nonce":12463}]},"public_addr":"172.21.15.96:6827/12463","cluster_addr":"172.21.15.96:6829/12463","heartbeat_back_addr":"172.21.15.96:6833/12463","heartbeat_front_addr":"172.21.15.96:6831/12463","state":["exists","up"]},{"osd":7,"uuid":"c6d71846-d68e-430f-ab72-0fb8ea4bf640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":12462},{"type":"v1","addr":"172.21.15.96:6819","nonce":12462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":12462},{"type":"v1","addr":"172.21.15.96:6821","nonce":12462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":12462},{"type":"v1","addr":"172.21.15.96:6825","nonce":12462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":12462},{"type":"v1","addr":"172.21.15.96:6823","nonce":12462}]},"public_addr":"172.21.15.96:6819/12462","cluster_addr":"172.21.15.96:6821/12462","heartbeat_back_addr":"172.21.15.96:6825/12462","heartbeat_front_addr":"172.21.15.96:6823/12462","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.875762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.900817+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.210347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.133973+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.864697+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.131015+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.237225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.154377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-05T03:50:53.254 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.248+0000 7fd43322f700 1 -- 172.21.15.158:0/1406267178 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd40c03b250 msgr2=0x7fd40c03d760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:53.254 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.248+0000 7fd43322f700 1 --2- 172.21.15.158:0/1406267178 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd40c03b250 0x7fd40c03d760 crc :-1 s=READY pgs=170 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:53.254 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.248+0000 7fd43322f700 1 -- 172.21.15.158:0/1406267178 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd42c140e40 msgr2=0x7fd42c154cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:53.254 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.248+0000 7fd43322f700 1 --2- 172.21.15.158:0/1406267178 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd42c140e40 0x7fd42c154cb0 secure :-1 s=READY pgs=368 cs=0 l=1 rx=0x7fd4240032b0 tx=0x7fd424010ee0).stop 2019-12-05T03:50:53.254 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.248+0000 7fd43322f700 1 -- 172.21.15.158:0/1406267178 shutdown_connections 2019-12-05T03:50:53.255 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.248+0000 7fd43322f700 1 --2- 172.21.15.158:0/1406267178 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fd40c03b250 0x7fd40c03d760 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:53.255 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.248+0000 7fd43322f700 1 --2- 172.21.15.158:0/1406267178 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fd42c140160 0x7fd42c128d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:53.255 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.248+0000 7fd43322f700 1 --2- 172.21.15.158:0/1406267178 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fd42c140e40 0x7fd42c154cb0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:53.255 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.248+0000 7fd43322f700 1 -- 172.21.15.158:0/1406267178 shutdown_connections 2019-12-05T03:50:53.255 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.248+0000 7fd43322f700 1 -- 172.21.15.158:0/1406267178 wait complete. 2019-12-05T03:50:53.255 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.248+0000 7fd43322f700 1 -- 172.21.15.158:0/1406267178 >> 172.21.15.158:0/1406267178 conn(0x7fd42c05a740 msgr2=0x7fd42c12d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:53.268 INFO:teuthology.orchestra.run.smithi158:> cd /home/ubuntu/cephtest/mnt.0 && sudo touch layoutfile 2019-12-05T03:50:53.290 INFO:teuthology.orchestra.run.smithi158:> cd /home/ubuntu/cephtest/mnt.0 && sudo mkdir layoutdir 2019-12-05T03:50:53.377 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds 'allow rw' mon 'allow r' osd 'allow rw pool=cephfs_data,allow rw pool=data_new' 2019-12-05T03:50:53.557 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.544+0000 7f56bb644700 1 Processor -- start 2019-12-05T03:50:53.559 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.544+0000 7f56bb644700 1 -- start start 2019-12-05T03:50:53.559 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.544+0000 7f56bb644700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f56b409c430 0x7f56b409c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:53.559 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.544+0000 7f56bb644700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b40984f0 con 0x7f56b4099140 2019-12-05T03:50:53.559 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.544+0000 7f56bb644700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b407e8c0 con 0x7f56b4096910 2019-12-05T03:50:53.559 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.544+0000 7f56bb644700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56b407eaf0 con 0x7f56b409c430 2019-12-05T03:50:53.560 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.544+0000 7f56b9be1700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f56b4096910 0x7f56b40b34a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49976/0 (socket says 172.21.15.158:49976) 2019-12-05T03:50:53.560 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.544+0000 7f56b9be1700 1 -- 172.21.15.158:0/3350397051 learned_addr learned my addr 172.21.15.158:0/3350397051 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:53.560 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.544+0000 7f56ba3e2700 1 --2- 172.21.15.158:0/3350397051 >> v2:172.21.15.96:3300/0 conn(0x7f56b409c430 0x7f56b409c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:53.560 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.544+0000 7f56b8bdf700 1 -- 172.21.15.158:0/3350397051 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 441592305 0 0) 0x7f56b407e8c0 con 0x7f56b4096910 2019-12-05T03:50:53.560 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.544+0000 7f56b8bdf700 1 -- 172.21.15.158:0/3350397051 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56a00030b0 con 0x7f56b4096910 2019-12-05T03:50:53.560 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56b8bdf700 1 -- 172.21.15.158:0/3350397051 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3119733245 0 0) 0x7f56a00030b0 con 0x7f56b4096910 2019-12-05T03:50:53.560 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56b8bdf700 1 -- 172.21.15.158:0/3350397051 >> v2:172.21.15.96:3300/0 conn(0x7f56b409c430 msgr2=0x7f56b409c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:53.561 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56b8bdf700 1 --2- 172.21.15.158:0/3350397051 >> v2:172.21.15.96:3300/0 conn(0x7f56b409c430 0x7f56b409c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:53.561 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56b8bdf700 1 -- 172.21.15.158:0/3350397051 >> v1:172.21.15.96:6789/0 conn(0x7f56b4099140 legacy=0x7f56b409bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:53.561 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56b8bdf700 1 -- 172.21.15.158:0/3350397051 --> v1:172.21.15.158:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b409cdb0 con 0x7f56b4096910 2019-12-05T03:50:53.561 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56b8bdf700 1 -- 172.21.15.158:0/3350397051 <== mon.1 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 828730332 0 0) 0x7f56b0001750 con 0x7f56b4096910 2019-12-05T03:50:53.561 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56b8bdf700 1 -- 172.21.15.158:0/3350397051 >> v1:172.21.15.158:6789/0 conn(0x7f56b4096910 legacy=0x7f56b40b34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:53.561 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56b8bdf700 1 --2- 172.21.15.158:0/3350397051 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f56a00036e0 0x7f56a0003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:53.561 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56b8bdf700 1 --2- 172.21.15.158:0/3350397051 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56a0004420 0x7f56a0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:53.562 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56b8bdf700 1 --2- 172.21.15.158:0/3350397051 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f56a0004da0 0x7f56a000b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:50:53.562 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56b8bdf700 1 -- 172.21.15.158:0/3350397051 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b407eaf0 con 0x7f56a0004420 2019-12-05T03:50:53.562 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56ba3e2700 1 --2- 172.21.15.158:0/3350397051 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f56a0004da0 0x7f56a000b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:53.562 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56b8bdf700 1 -- 172.21.15.158:0/3350397051 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a004fc60 con 0x7f56a0004da0 2019-12-05T03:50:53.562 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56b8bdf700 1 -- 172.21.15.158:0/3350397051 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a004fea0 con 0x7f56a00036e0 2019-12-05T03:50:53.562 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56b9be1700 1 --2- 172.21.15.158:0/3350397051 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f56a00036e0 0x7f56a0003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:53.562 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56b93e0700 1 --2- 172.21.15.158:0/3350397051 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56a0004420 0x7f56a0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:53.563 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56ba3e2700 1 -- 172.21.15.158:0/3350397051 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f56a00036e0 msgr2=0x7f56a0003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:53.563 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56ba3e2700 1 --2- 172.21.15.158:0/3350397051 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f56a00036e0 0x7f56a0003b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:53.563 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56ba3e2700 1 -- 172.21.15.158:0/3350397051 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56a0004420 msgr2=0x7f56a0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:50:53.563 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56ba3e2700 1 --2- 172.21.15.158:0/3350397051 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56a0004420 0x7f56a0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:50:53.563 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56ba3e2700 1 -- 172.21.15.158:0/3350397051 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a00501a0 con 0x7f56a0004da0 2019-12-05T03:50:53.563 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56b9be1700 1 --2- 172.21.15.158:0/3350397051 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f56a00036e0 0x7f56a0003b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-12-05T03:50:53.563 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56b93e0700 1 --2- 172.21.15.158:0/3350397051 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56a0004420 0x7f56a0004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-12-05T03:50:53.564 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56ba3e2700 1 --2- 172.21.15.158:0/3350397051 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f56a0004da0 0x7f56a000b670 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f56ac0032b0 tx=0x7f56ac010320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:53.564 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56ba3e2700 1 -- 172.21.15.158:0/3350397051 reap_dead start 2019-12-05T03:50:53.564 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56ba3e2700 1 --2- 172.21.15.158:0/3350397051 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f56a0004da0 0x7f56a000b670 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f56ac0032b0 tx=0x7f56ac010320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:53.564 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56ba3e2700 1 --2- 172.21.15.158:0/3350397051 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f56a0004da0 0x7f56a000b670 secure :-1 s=READY pgs=370 cs=0 l=1 rx=0x7f56ac0032b0 tx=0x7f56ac010320).ready entity=mon.1 client_cookie=643e3b4b525633bf server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:53.564 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56ba3e2700 1 --2- 172.21.15.158:0/3350397051 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f56a0004da0 0x7f56a000b670 secure :-1 s=THROTTLE_DONE pgs=370 cs=0 l=1 rx=0x7f56ac0032b0 tx=0x7f56ac010320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:53.564 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56ba3e2700 1 --2- 172.21.15.158:0/3350397051 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f56a0004da0 0x7f56a000b670 secure :-1 s=THROTTLE_DONE pgs=370 cs=0 l=1 rx=0x7f56ac0032b0 tx=0x7f56ac010320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:53.564 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56b8bdf700 1 -- 172.21.15.158:0/3350397051 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56ac008d60 con 0x7f56a0004da0 2019-12-05T03:50:53.565 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56ba3e2700 1 --2- 172.21.15.158:0/3350397051 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f56a0004da0 0x7f56a000b670 secure :-1 s=THROTTLE_DONE pgs=370 cs=0 l=1 rx=0x7f56ac0032b0 tx=0x7f56ac010320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:53.565 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56b8bdf700 1 -- 172.21.15.158:0/3350397051 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56ac010c70 con 0x7f56a0004da0 2019-12-05T03:50:53.565 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56b8bdf700 1 -- 172.21.15.158:0/3350397051 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56ac005ca0 con 0x7f56a0004da0 2019-12-05T03:50:53.565 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56bb644700 1 -- 172.21.15.158:0/3350397051 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f56a0004da0 msgr2=0x7f56a000b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:53.565 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56bb644700 1 --2- 172.21.15.158:0/3350397051 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f56a0004da0 0x7f56a000b670 secure :-1 s=READY pgs=370 cs=0 l=1 rx=0x7f56ac0032b0 tx=0x7f56ac010320).stop 2019-12-05T03:50:53.565 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56bb644700 1 -- 172.21.15.158:0/3350397051 shutdown_connections 2019-12-05T03:50:53.565 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56bb644700 1 --2- 172.21.15.158:0/3350397051 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f56a0004da0 0x7f56a000b670 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:53.566 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56bb644700 1 -- 172.21.15.158:0/3350397051 shutdown_connections 2019-12-05T03:50:53.566 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56bb644700 1 -- 172.21.15.158:0/3350397051 wait complete. 2019-12-05T03:50:53.566 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.548+0000 7f56bb644700 1 -- 172.21.15.158:0/3350397051 >> 172.21.15.158:0/3350397051 conn(0x7f56b405d8a0 msgr2=0x7f56b405dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:53.570 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.552+0000 7f56bb644700 1 Processor -- start 2019-12-05T03:50:53.570 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.552+0000 7f56bb644700 1 -- start start 2019-12-05T03:50:53.570 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.552+0000 7f56bb644700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f56b40b2a00 0x7f56b409bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:53.570 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.552+0000 7f56bb644700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b413d040 con 0x7f56b41402d0 2019-12-05T03:50:53.570 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.552+0000 7f56bb644700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b40b36d0 con 0x7f56b40b32a0 2019-12-05T03:50:53.570 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.552+0000 7f56bb644700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b4060310 con 0x7f56b40b2a00 2019-12-05T03:50:53.570 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.552+0000 7f56b93e0700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f56b40b32a0 0x7f56b413c840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49990/0 (socket says 172.21.15.158:49990) 2019-12-05T03:50:53.571 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.552+0000 7f56b93e0700 1 -- 172.21.15.158:0/4107936324 learned_addr learned my addr 172.21.15.158:0/4107936324 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:50:53.571 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.552+0000 7f56b9be1700 1 --2- 172.21.15.158:0/4107936324 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f56b40b2a00 0x7f56b409bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:53.571 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.552+0000 7f56a67fc700 1 -- 172.21.15.158:0/4107936324 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2344120263 0 0) 0x7f56b40b36d0 con 0x7f56b40b32a0 2019-12-05T03:50:53.571 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.552+0000 7f56a67fc700 1 -- 172.21.15.158:0/4107936324 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f569c0030b0 con 0x7f56b40b32a0 2019-12-05T03:50:53.571 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.552+0000 7f56a67fc700 1 -- 172.21.15.158:0/4107936324 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1562250121 0 0) 0x7f56b413d040 con 0x7f56b41402d0 2019-12-05T03:50:53.571 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.552+0000 7f56a67fc700 1 -- 172.21.15.158:0/4107936324 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56b40b36d0 con 0x7f56b41402d0 2019-12-05T03:50:53.571 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.552+0000 7f56b9be1700 1 -- 172.21.15.158:0/4107936324 >> v1:172.21.15.158:6789/0 conn(0x7f56b40b32a0 legacy=0x7f56b413c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:53.572 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.552+0000 7f56b9be1700 1 -- 172.21.15.158:0/4107936324 >> v1:172.21.15.96:6789/0 conn(0x7f56b41402d0 legacy=0x7f56b412c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:53.572 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.552+0000 7f56b9be1700 1 -- 172.21.15.158:0/4107936324 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b412cbc0 con 0x7f56b40b2a00 2019-12-05T03:50:53.572 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.552+0000 7f56b9be1700 1 --2- 172.21.15.158:0/4107936324 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f56b40b2a00 0x7f56b409bfa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f56b0001460 tx=0x7f56b0010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:53.572 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.552+0000 7f56b9be1700 1 --2- 172.21.15.158:0/4107936324 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f56b40b2a00 0x7f56b409bfa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f56b0001460 tx=0x7f56b0010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:53.572 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.552+0000 7f56b9be1700 1 --2- 172.21.15.158:0/4107936324 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f56b40b2a00 0x7f56b409bfa0 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7f56b0001460 tx=0x7f56b0010960).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:53.572 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.552+0000 7f56b9be1700 1 --2- 172.21.15.158:0/4107936324 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f56b40b2a00 0x7f56b409bfa0 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f56b0001460 tx=0x7f56b0010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:53.572 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.556+0000 7f56a67fc700 1 -- 172.21.15.158:0/4107936324 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56b000c940 con 0x7f56b40b2a00 2019-12-05T03:50:53.573 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.556+0000 7f56b9be1700 1 --2- 172.21.15.158:0/4107936324 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f56b40b2a00 0x7f56b409bfa0 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f56b0001460 tx=0x7f56b0010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:53.573 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.556+0000 7f56b9be1700 1 --2- 172.21.15.158:0/4107936324 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f56b40b2a00 0x7f56b409bfa0 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f56b0001460 tx=0x7f56b0010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:53.573 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.556+0000 7f56a67fc700 1 -- 172.21.15.158:0/4107936324 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b0010250 con 0x7f56b40b2a00 2019-12-05T03:50:53.573 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.556+0000 7f56bb644700 1 -- 172.21.15.158:0/4107936324 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56b4140700 con 0x7f56b40b2a00 2019-12-05T03:50:53.573 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.556+0000 7f56a67fc700 1 -- 172.21.15.158:0/4107936324 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56b000d0c0 con 0x7f56b40b2a00 2019-12-05T03:50:53.573 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.556+0000 7f56bb644700 1 -- 172.21.15.158:0/4107936324 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56b4140c50 con 0x7f56b40b2a00 2019-12-05T03:50:53.573 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.556+0000 7f56b9be1700 1 --2- 172.21.15.158:0/4107936324 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f56b40b2a00 0x7f56b409bfa0 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f56b0001460 tx=0x7f56b0010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:53.574 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.556+0000 7f56a67fc700 1 -- 172.21.15.158:0/4107936324 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f56b0005440 con 0x7f56b40b2a00 2019-12-05T03:50:53.574 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.556+0000 7f56b9be1700 1 --2- 172.21.15.158:0/4107936324 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f56b40b2a00 0x7f56b409bfa0 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f56b0001460 tx=0x7f56b0010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:53.574 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.556+0000 7f56a67fc700 1 --2- 172.21.15.158:0/4107936324 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f569c03b450 0x7f569c03d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:50:53.574 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.556+0000 7f56a67fc700 1 -- 172.21.15.158:0/4107936324 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6399+0+0 (secure 0 0 0) 0x7f56b004aab0 con 0x7f56b40b2a00 2019-12-05T03:50:53.574 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.556+0000 7f56b93e0700 1 --2- 172.21.15.158:0/4107936324 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f569c03b450 0x7f569c03d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:50:53.574 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.556+0000 7f56b93e0700 1 --2- 172.21.15.158:0/4107936324 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f569c03b450 0x7f569c03d960 crc :-1 s=READY pgs=171 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:50:53.574 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.560+0000 7f56bb644700 1 -- 172.21.15.158:0/4107936324 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56b40b3900 con 0x7f56b40b2a00 2019-12-05T03:50:53.576 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.568+0000 7f56b9be1700 1 --2- 172.21.15.158:0/4107936324 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f56b40b2a00 0x7f56b409bfa0 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f56b0001460 tx=0x7f56b0010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:53.576 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.568+0000 7f56a67fc700 1 -- 172.21.15.158:0/4107936324 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f56b0031b30 con 0x7f56b40b2a00 2019-12-05T03:50:53.745 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.736+0000 7f56bb644700 1 -- 172.21.15.158:0/4107936324 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rw", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]} v 0) v1 -- 0x7f56b40554e0 con 0x7f56b40b2a00 2019-12-05T03:50:53.754 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.748+0000 7f56b9be1700 1 --2- 172.21.15.158:0/4107936324 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f56b40b2a00 0x7f56b409bfa0 secure :-1 s=THROTTLE_DONE pgs=82 cs=0 l=1 rx=0x7f56b0001460 tx=0x7f56b0010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:50:53.754 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.748+0000 7f56a67fc700 1 -- 172.21.15.158:0/4107936324 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rw", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]}]=0 updated caps for client.0 v17) v1 ==== 210+0+0 (secure 0 0 0) 0x7f56b0031d90 con 0x7f56b40b2a00 2019-12-05T03:50:53.760 INFO:teuthology.orchestra.run.smithi158.stderr:updated caps for client.0 2019-12-05T03:50:53.764 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.756+0000 7f56bb644700 1 -- 172.21.15.158:0/4107936324 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f569c03b450 msgr2=0x7f569c03d960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:53.765 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.756+0000 7f56bb644700 1 --2- 172.21.15.158:0/4107936324 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f569c03b450 0x7f569c03d960 crc :-1 s=READY pgs=171 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:53.766 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.756+0000 7f56bb644700 1 -- 172.21.15.158:0/4107936324 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f56b40b2a00 msgr2=0x7f56b409bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:50:53.766 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.756+0000 7f56bb644700 1 --2- 172.21.15.158:0/4107936324 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f56b40b2a00 0x7f56b409bfa0 secure :-1 s=READY pgs=82 cs=0 l=1 rx=0x7f56b0001460 tx=0x7f56b0010960).stop 2019-12-05T03:50:53.766 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.756+0000 7f56bb644700 1 -- 172.21.15.158:0/4107936324 shutdown_connections 2019-12-05T03:50:53.766 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.756+0000 7f56bb644700 1 --2- 172.21.15.158:0/4107936324 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f569c03b450 0x7f569c03d960 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:53.767 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.756+0000 7f56bb644700 1 --2- 172.21.15.158:0/4107936324 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f56b40b2a00 0x7f56b409bfa0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:50:53.767 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.756+0000 7f56bb644700 1 -- 172.21.15.158:0/4107936324 shutdown_connections 2019-12-05T03:50:53.767 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.756+0000 7f56bb644700 1 -- 172.21.15.158:0/4107936324 wait complete. 2019-12-05T03:50:53.767 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:50:53.756+0000 7f56bb644700 1 -- 172.21.15.158:0/4107936324 >> 172.21.15.158:0/4107936324 conn(0x7f56b40b5cd0 msgr2=0x7f56b412f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:50:53.777 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:53.777 INFO:teuthology.orchestra.run.smithi158:> stat --file-system '--printf=%T 2019-12-05T03:50:53.777 INFO:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.0 2019-12-05T03:50:53.789 INFO:teuthology.orchestra.run.smithi158.stdout:fuseblk 2019-12-05T03:50:53.790 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2019-12-05T03:50:53.790 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi158.front.sepia.ceph.com... 2019-12-05T03:50:53.790 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-12-05T03:50:53.790 INFO:teuthology.orchestra.run.smithi158:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2019-12-05T03:50:53.885 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi158.stderr:ceph-fuse[16506]: fuse finished with error 0 and tester_r 0 2019-12-05T03:50:53.890 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:50:53.890 INFO:teuthology.orchestra.run.smithi158:> stat --file-system '--printf=%T 2019-12-05T03:50:53.890 INFO:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.0 2019-12-05T03:50:53.964 INFO:teuthology.orchestra.run.smithi158.stdout:ext2/ext3 2019-12-05T03:50:53.964 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2019-12-05T03:50:53.964 INFO:teuthology.orchestra.run:waiting for 900 2019-12-05T03:50:57.835 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:50:57.839 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:51:00.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-12-05T03:51:00.067 INFO:teuthology.orchestra.run.smithi158:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-12-05T03:51:00.079 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-05T03:51:00.246 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.236+0000 7f0d8f73b700 1 Processor -- start 2019-12-05T03:51:00.246 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.236+0000 7f0d8f73b700 1 -- start start 2019-12-05T03:51:00.246 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.236+0000 7f0d8f73b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f0d8805a740 0x7f0d88155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:51:00.247 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.236+0000 7f0d8f73b700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d880accb0 con 0x7f0d8809a320 2019-12-05T03:51:00.247 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.236+0000 7f0d8f73b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d88156100 con 0x7f0d8809cf60 2019-12-05T03:51:00.247 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.236+0000 7f0d8f73b700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d8809a750 con 0x7f0d8805a740 2019-12-05T03:51:00.247 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.236+0000 7f0d8e4d9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f0d8805a740 0x7f0d88155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:00.247 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.236+0000 7f0d8dcd8700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f0d8809cf60 0x7f0d88151460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:49998/0 (socket says 172.21.15.158:49998) 2019-12-05T03:51:00.248 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.236+0000 7f0d8dcd8700 1 -- 172.21.15.158:0/2960297632 learned_addr learned my addr 172.21.15.158:0/2960297632 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:51:00.248 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.236+0000 7f0d8e4d9700 1 -- 172.21.15.158:0/2960297632 >> v1:172.21.15.158:6789/0 conn(0x7f0d8809cf60 legacy=0x7f0d88151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:00.248 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.236+0000 7f0d8e4d9700 1 -- 172.21.15.158:0/2960297632 >> v1:172.21.15.96:6789/0 conn(0x7f0d8809a320 legacy=0x7f0d881553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:00.248 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.236+0000 7f0d8e4d9700 1 -- 172.21.15.158:0/2960297632 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8805ab70 con 0x7f0d8805a740 2019-12-05T03:51:00.249 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.236+0000 7f0d8e4d9700 1 --2- 172.21.15.158:0/2960297632 >> v2:172.21.15.158:3300/0 conn(0x7f0d8805a740 0x7f0d88155bb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0d8809c740 tx=0x7f0d8000ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.249 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.236+0000 7f0d8e4d9700 1 --2- 172.21.15.158:0/2960297632 >> v2:172.21.15.158:3300/0 conn(0x7f0d8805a740 0x7f0d88155bb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0d8809c740 tx=0x7f0d8000ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.249 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.236+0000 7f0d8e4d9700 1 --2- 172.21.15.158:0/2960297632 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d8805a740 0x7f0d88155bb0 secure :-1 s=READY pgs=373 cs=0 l=1 rx=0x7f0d8809c740 tx=0x7f0d8000ff70).ready entity=mon.1 client_cookie=f01df4503cb1578f server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:51:00.249 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.236+0000 7f0d8e4d9700 1 --2- 172.21.15.158:0/2960297632 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d8805a740 0x7f0d88155bb0 secure :-1 s=THROTTLE_DONE pgs=373 cs=0 l=1 rx=0x7f0d8809c740 tx=0x7f0d8000ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.250 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.236+0000 7f0d8ccd6700 1 -- 172.21.15.158:0/2960297632 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d80010970 con 0x7f0d8805a740 2019-12-05T03:51:00.250 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.236+0000 7f0d8e4d9700 1 --2- 172.21.15.158:0/2960297632 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d8805a740 0x7f0d88155bb0 secure :-1 s=THROTTLE_DONE pgs=373 cs=0 l=1 rx=0x7f0d8809c740 tx=0x7f0d8000ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.250 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.236+0000 7f0d8e4d9700 1 --2- 172.21.15.158:0/2960297632 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d8805a740 0x7f0d88155bb0 secure :-1 s=THROTTLE_DONE pgs=373 cs=0 l=1 rx=0x7f0d8809c740 tx=0x7f0d8000ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.250 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.236+0000 7f0d8ccd6700 1 -- 172.21.15.158:0/2960297632 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d80008b50 con 0x7f0d8805a740 2019-12-05T03:51:00.251 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.236+0000 7f0d8ccd6700 1 -- 172.21.15.158:0/2960297632 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d800110c0 con 0x7f0d8805a740 2019-12-05T03:51:00.251 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.236+0000 7f0d8f73b700 1 -- 172.21.15.158:0/2960297632 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d8805a740 msgr2=0x7f0d88155bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:00.251 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.236+0000 7f0d8f73b700 1 --2- 172.21.15.158:0/2960297632 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d8805a740 0x7f0d88155bb0 secure :-1 s=READY pgs=373 cs=0 l=1 rx=0x7f0d8809c740 tx=0x7f0d8000ff70).stop 2019-12-05T03:51:00.251 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.236+0000 7f0d8f73b700 1 -- 172.21.15.158:0/2960297632 shutdown_connections 2019-12-05T03:51:00.251 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.236+0000 7f0d8f73b700 1 --2- 172.21.15.158:0/2960297632 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d8805a740 0x7f0d88155bb0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:00.251 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.240+0000 7f0d8f73b700 1 -- 172.21.15.158:0/2960297632 shutdown_connections 2019-12-05T03:51:00.252 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.240+0000 7f0d8f73b700 1 -- 172.21.15.158:0/2960297632 wait complete. 2019-12-05T03:51:00.252 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.240+0000 7f0d8f73b700 1 -- 172.21.15.158:0/2960297632 >> 172.21.15.158:0/2960297632 conn(0x7f0d880b7e60 msgr2=0x7f0d880b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:51:00.258 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.240+0000 7f0d8f73b700 1 Processor -- start 2019-12-05T03:51:00.258 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.240+0000 7f0d8f73b700 1 -- start start 2019-12-05T03:51:00.258 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.240+0000 7f0d8f73b700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0d88151230 0x7f0d881234f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:00.259 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.240+0000 7f0d8f73b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f0d88126690 0x7f0d88125090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:00.259 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.240+0000 7f0d8f73b700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0d88134710 0x7f0d88134b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:00.259 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.240+0000 7f0d8f73b700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d88139530 con 0x7f0d88134710 2019-12-05T03:51:00.259 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.240+0000 7f0d8f73b700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d88135440 con 0x7f0d88126690 2019-12-05T03:51:00.260 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.240+0000 7f0d8f73b700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d88139260 con 0x7f0d88151230 2019-12-05T03:51:00.260 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.240+0000 7f0d8d4d7700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f0d88126690 0x7f0d88125090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:00.260 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.240+0000 7f0d8d4d7700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f0d88126690 0x7f0d88125090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:55222/0 (socket says 172.21.15.158:55222) 2019-12-05T03:51:00.260 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.240+0000 7f0d8d4d7700 1 -- 172.21.15.158:0/4242807778 learned_addr learned my addr 172.21.15.158:0/4242807778 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:51:00.260 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.240+0000 7f0d8e4d9700 1 --2- 172.21.15.158:0/4242807778 >> v2:172.21.15.96:3300/0 conn(0x7f0d88134710 0x7f0d88134b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:00.261 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.240+0000 7f0d8dcd8700 1 --2- 172.21.15.158:0/4242807778 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0d88151230 0x7f0d881234f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:00.261 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.244+0000 7f0d8d4d7700 1 -- 172.21.15.158:0/4242807778 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0d88151230 msgr2=0x7f0d881234f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:00.261 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.244+0000 7f0d8d4d7700 1 --2- 172.21.15.158:0/4242807778 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0d88151230 0x7f0d881234f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:00.261 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.244+0000 7f0d8d4d7700 1 -- 172.21.15.158:0/4242807778 >> v2:172.21.15.96:3300/0 conn(0x7f0d88134710 msgr2=0x7f0d88134b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:00.261 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.244+0000 7f0d8d4d7700 1 --2- 172.21.15.158:0/4242807778 >> v2:172.21.15.96:3300/0 conn(0x7f0d88134710 0x7f0d88134b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:00.262 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.244+0000 7f0d8d4d7700 1 -- 172.21.15.158:0/4242807778 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d881255e0 con 0x7f0d88126690 2019-12-05T03:51:00.262 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.244+0000 7f0d8d4d7700 1 --2- 172.21.15.158:0/4242807778 >> v2:172.21.15.158:3300/0 conn(0x7f0d88126690 0x7f0d88125090 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0d84000e90 tx=0x7f0d840109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.262 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.244+0000 7f0d8d4d7700 1 --2- 172.21.15.158:0/4242807778 >> v2:172.21.15.158:3300/0 conn(0x7f0d88126690 0x7f0d88125090 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0d84000e90 tx=0x7f0d840109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.262 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.244+0000 7f0d8d4d7700 1 --2- 172.21.15.158:0/4242807778 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d88126690 0x7f0d88125090 secure :-1 s=READY pgs=374 cs=0 l=1 rx=0x7f0d84000e90 tx=0x7f0d840109a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:51:00.262 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.244+0000 7f0d8d4d7700 1 --2- 172.21.15.158:0/4242807778 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d88126690 0x7f0d88125090 secure :-1 s=THROTTLE_DONE pgs=374 cs=0 l=1 rx=0x7f0d84000e90 tx=0x7f0d840109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.262 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.244+0000 7f0d7e7fc700 1 -- 172.21.15.158:0/4242807778 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d8400caa0 con 0x7f0d88126690 2019-12-05T03:51:00.262 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.244+0000 7f0d8d4d7700 1 --2- 172.21.15.158:0/4242807778 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d88126690 0x7f0d88125090 secure :-1 s=THROTTLE_DONE pgs=374 cs=0 l=1 rx=0x7f0d84000e90 tx=0x7f0d840109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.263 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.244+0000 7f0d7e7fc700 1 -- 172.21.15.158:0/4242807778 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d8400c6c0 con 0x7f0d88126690 2019-12-05T03:51:00.263 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.244+0000 7f0d8d4d7700 1 --2- 172.21.15.158:0/4242807778 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d88126690 0x7f0d88125090 secure :-1 s=THROTTLE_DONE pgs=374 cs=0 l=1 rx=0x7f0d84000e90 tx=0x7f0d840109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.263 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.244+0000 7f0d8f73b700 1 -- 172.21.15.158:0/4242807778 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d881356e0 con 0x7f0d88126690 2019-12-05T03:51:00.263 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.244+0000 7f0d7e7fc700 1 -- 172.21.15.158:0/4242807778 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d840111a0 con 0x7f0d88126690 2019-12-05T03:51:00.263 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.244+0000 7f0d8f73b700 1 -- 172.21.15.158:0/4242807778 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d88135ac0 con 0x7f0d88126690 2019-12-05T03:51:00.263 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.244+0000 7f0d8d4d7700 1 --2- 172.21.15.158:0/4242807778 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d88126690 0x7f0d88125090 secure :-1 s=THROTTLE_DONE pgs=374 cs=0 l=1 rx=0x7f0d84000e90 tx=0x7f0d840109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.264 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.244+0000 7f0d7e7fc700 1 -- 172.21.15.158:0/4242807778 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f0d84011500 con 0x7f0d88126690 2019-12-05T03:51:00.264 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.244+0000 7f0d8d4d7700 1 --2- 172.21.15.158:0/4242807778 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d88126690 0x7f0d88125090 secure :-1 s=THROTTLE_DONE pgs=374 cs=0 l=1 rx=0x7f0d84000e90 tx=0x7f0d840109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.264 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.244+0000 7f0d7e7fc700 1 --2- 172.21.15.158:0/4242807778 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f0d6803acc0 0x7f0d6803d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:00.264 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.244+0000 7f0d7e7fc700 1 -- 172.21.15.158:0/4242807778 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6399+0+0 (secure 0 0 0) 0x7f0d8404b250 con 0x7f0d88126690 2019-12-05T03:51:00.264 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.244+0000 7f0d8dcd8700 1 --2- 172.21.15.158:0/4242807778 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f0d6803acc0 0x7f0d6803d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:00.264 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.244+0000 7f0d8dcd8700 1 --2- 172.21.15.158:0/4242807778 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f0d6803acc0 0x7f0d6803d1d0 crc :-1 s=READY pgs=172 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:51:00.265 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.252+0000 7f0d8f73b700 1 -- 172.21.15.158:0/4242807778 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d881396f0 con 0x7f0d88126690 2019-12-05T03:51:00.265 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.256+0000 7f0d8d4d7700 1 --2- 172.21.15.158:0/4242807778 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d88126690 0x7f0d88125090 secure :-1 s=THROTTLE_DONE pgs=374 cs=0 l=1 rx=0x7f0d84000e90 tx=0x7f0d840109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.265 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.256+0000 7f0d7e7fc700 1 -- 172.21.15.158:0/4242807778 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f0d840322b0 con 0x7f0d88126690 2019-12-05T03:51:00.426 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.420+0000 7f0d8f73b700 1 -- 172.21.15.158:0/4242807778 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d880554e0 con 0x7f0d88126690 2019-12-05T03:51:00.428 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.420+0000 7f0d8d4d7700 1 --2- 172.21.15.158:0/4242807778 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d88126690 0x7f0d88125090 secure :-1 s=THROTTLE_DONE pgs=374 cs=0 l=1 rx=0x7f0d84000e90 tx=0x7f0d840109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.428 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.420+0000 7f0d7e7fc700 1 -- 172.21.15.158:0/4242807778 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16297 (secure 0 0 0) 0x7f0d84032510 con 0x7f0d88126690 2019-12-05T03:51:00.429 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:51:00.429 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":36,"fsid":"a91186ae-f496-4de1-918d-820c55ff1feb","created":"2019-12-05T03:49:39.187523+0000","modified":"2019-12-05T03:50:54.950075+0000","last_up_change":"2019-12-05T03:49:48.551934+0000","last_in_change":"2019-12-05T03:49:48.551934+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-05T03:49:52.900870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2019-12-05T03:50:42.436744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2019-12-05T03:50:43.620710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"data_new","create_time":"2019-12-05T03:50:51.740163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"782c4258-e28c-4a11-9d54-3c9c7a36fba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":12192},{"type":"v1","addr":"172.21.15.158:6801","nonce":12192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":12192},{"type":"v1","addr":"172.21.15.158:6803","nonce":12192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":12192},{"type":"v1","addr":"172.21.15.158:6807","nonce":12192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":12192},{"type":"v1","addr":"172.21.15.158:6805","nonce":12192}]},"public_addr":"172.21.15.158:6801/12192","cluster_addr":"172.21.15.158:6803/12192","heartbeat_back_addr":"172.21.15.158:6807/12192","heartbeat_front_addr":"172.21.15.158:6805/12192","state":["exists","up"]},{"osd":1,"uuid":"d4426b21-b666-4158-bf34-a24b14572731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":12193},{"type":"v1","addr":"172.21.15.158:6809","nonce":12193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":12193},{"type":"v1","addr":"172.21.15.158:6811","nonce":12193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":12193},{"type":"v1","addr":"172.21.15.158:6815","nonce":12193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":12193},{"type":"v1","addr":"172.21.15.158:6813","nonce":12193}]},"public_addr":"172.21.15.158:6809/12193","cluster_addr":"172.21.15.158:6811/12193","heartbeat_back_addr":"172.21.15.158:6815/12193","heartbeat_front_addr":"172.21.15.158:6813/12193","state":["exists","up"]},{"osd":2,"uuid":"22680edd-6490-4ab0-bb15-0605830e4cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":12195},{"type":"v1","addr":"172.21.15.158:6825","nonce":12195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":12195},{"type":"v1","addr":"172.21.15.158:6827","nonce":12195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":12195},{"type":"v1","addr":"172.21.15.158:6831","nonce":12195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":12195},{"type":"v1","addr":"172.21.15.158:6829","nonce":12195}]},"public_addr":"172.21.15.158:6825/12195","cluster_addr":"172.21.15.158:6827/12195","heartbeat_back_addr":"172.21.15.158:6831/12195","heartbeat_front_addr":"172.21.15.158:6829/12195","state":["exists","up"]},{"osd":3,"uuid":"7ec999ee-ace8-4ccb-a4f9-6f5d313bbbd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":12194},{"type":"v1","addr":"172.21.15.158:6817","nonce":12194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":12194},{"type":"v1","addr":"172.21.15.158:6819","nonce":12194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":12194},{"type":"v1","addr":"172.21.15.158:6823","nonce":12194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":12194},{"type":"v1","addr":"172.21.15.158:6821","nonce":12194}]},"public_addr":"172.21.15.158:6817/12194","cluster_addr":"172.21.15.158:6819/12194","heartbeat_back_addr":"172.21.15.158:6823/12194","heartbeat_front_addr":"172.21.15.158:6821/12194","state":["exists","up"]},{"osd":4,"uuid":"186e69c4-b69f-4dd1-bb8f-faf759c60484","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":12460},{"type":"v1","addr":"172.21.15.96:6803","nonce":12460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":12460},{"type":"v1","addr":"172.21.15.96:6805","nonce":12460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":12460},{"type":"v1","addr":"172.21.15.96:6809","nonce":12460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":12460},{"type":"v1","addr":"172.21.15.96:6807","nonce":12460}]},"public_addr":"172.21.15.96:6803/12460","cluster_addr":"172.21.15.96:6805/12460","heartbeat_back_addr":"172.21.15.96:6809/12460","heartbeat_front_addr":"172.21.15.96:6807/12460","state":["exists","up"]},{"osd":5,"uuid":"86b658b2-8b40-4cea-8163-305a3982758b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":12461},{"type":"v1","addr":"172.21.15.96:6811","nonce":12461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":12461},{"type":"v1","addr":"172.21.15.96:6813","nonce":12461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":12461},{"type":"v1","addr":"172.21.15.96:6817","nonce":12461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":12461},{"type":"v1","addr":"172.21.15.96:6815","nonce":12461}]},"public_addr":"172.21.15.96:6811/12461","cluster_addr":"172.21.15.96:6813/12461","heartbeat_back_addr":"172.21.15.96:6817/12461","heartbeat_front_addr":"172.21.15.96:6815/12461","state":["exists","up"]},{"osd":6,"uuid":"bdadaea8-9296-4788-bc59-d9c9eb8defdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":12463},{"type":"v1","addr":"172.21.15.96:6827","nonce":12463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":12463},{"type":"v1","addr":"172.21.15.96:6829","nonce":12463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":12463},{"type":"v1","addr":"172.21.15.96:6833","nonce":12463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":12463},{"type":"v1","addr":"172.21.15.96:6831","nonce":12463}]},"public_addr":"172.21.15.96:6827/12463","cluster_addr":"172.21.15.96:6829/12463","heartbeat_back_addr":"172.21.15.96:6833/12463","heartbeat_front_addr":"172.21.15.96:6831/12463","state":["exists","up"]},{"osd":7,"uuid":"c6d71846-d68e-430f-ab72-0fb8ea4bf640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":12462},{"type":"v1","addr":"172.21.15.96:6819","nonce":12462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":12462},{"type":"v1","addr":"172.21.15.96:6821","nonce":12462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":12462},{"type":"v1","addr":"172.21.15.96:6825","nonce":12462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":12462},{"type":"v1","addr":"172.21.15.96:6823","nonce":12462}]},"public_addr":"172.21.15.96:6819/12462","cluster_addr":"172.21.15.96:6821/12462","heartbeat_back_addr":"172.21.15.96:6825/12462","heartbeat_front_addr":"172.21.15.96:6823/12462","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.875762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.900817+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.210347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.133973+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.864697+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.131015+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.237225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.154377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-05T03:51:00.431 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.424+0000 7f0d8f73b700 1 -- 172.21.15.158:0/4242807778 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f0d6803acc0 msgr2=0x7f0d6803d1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:00.431 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.424+0000 7f0d8f73b700 1 --2- 172.21.15.158:0/4242807778 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f0d6803acc0 0x7f0d6803d1d0 crc :-1 s=READY pgs=172 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:00.431 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.424+0000 7f0d8f73b700 1 -- 172.21.15.158:0/4242807778 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d88126690 msgr2=0x7f0d88125090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:00.432 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.424+0000 7f0d8f73b700 1 --2- 172.21.15.158:0/4242807778 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d88126690 0x7f0d88125090 secure :-1 s=READY pgs=374 cs=0 l=1 rx=0x7f0d84000e90 tx=0x7f0d840109a0).stop 2019-12-05T03:51:00.432 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.424+0000 7f0d8f73b700 1 -- 172.21.15.158:0/4242807778 shutdown_connections 2019-12-05T03:51:00.432 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.424+0000 7f0d8f73b700 1 --2- 172.21.15.158:0/4242807778 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f0d6803acc0 0x7f0d6803d1d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:00.432 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.424+0000 7f0d8f73b700 1 --2- 172.21.15.158:0/4242807778 >> v2:172.21.15.96:3300/0 conn(0x7f0d88134710 0x7f0d88134b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:00.432 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.424+0000 7f0d8f73b700 1 --2- 172.21.15.158:0/4242807778 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0d88151230 0x7f0d881234f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:00.432 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.424+0000 7f0d8f73b700 1 --2- 172.21.15.158:0/4242807778 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0d88126690 0x7f0d88125090 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:00.433 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.424+0000 7f0d8f73b700 1 -- 172.21.15.158:0/4242807778 shutdown_connections 2019-12-05T03:51:00.433 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.424+0000 7f0d8f73b700 1 -- 172.21.15.158:0/4242807778 wait complete. 2019-12-05T03:51:00.433 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.424+0000 7f0d8f73b700 1 -- 172.21.15.158:0/4242807778 >> 172.21.15.158:0/4242807778 conn(0x7f0d880b5e10 msgr2=0x7f0d88127440 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:51:00.442 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:49:52.900870+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:50:42.436744+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 4, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'31', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:50:43.620710+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 5, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'32', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:50:51.740163+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'data_new', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 6, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'36', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-12-05T03:51:00.443 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-12-05T03:51:00.543 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.528+0000 7fde87ca7700 1 Processor -- start 2019-12-05T03:51:00.543 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.528+0000 7fde87ca7700 1 -- start start 2019-12-05T03:51:00.544 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.528+0000 7fde87ca7700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fde800b6970 0x7fde8009add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:51:00.544 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.528+0000 7fde87ca7700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde8009ba40 0x7fde8005a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:51:00.544 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.528+0000 7fde87ca7700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde80099e30 con 0x7fde8005a950 2019-12-05T03:51:00.544 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.528+0000 7fde87ca7700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde8009d210 con 0x7fde800b6970 2019-12-05T03:51:00.544 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.528+0000 7fde87ca7700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde80099b90 con 0x7fde8009ba40 2019-12-05T03:51:00.544 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.528+0000 7fde86244700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fde800b6970 0x7fde8009add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:00.544 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.528+0000 7fde86244700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fde800b6970 0x7fde8009add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:55230/0 (socket says 172.21.15.158:55230) 2019-12-05T03:51:00.545 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.528+0000 7fde86244700 1 -- 172.21.15.158:0/2267637678 learned_addr learned my addr 172.21.15.158:0/2267637678 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:51:00.545 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.532+0000 7fde85a43700 1 --2- 172.21.15.158:0/2267637678 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde8009ba40 0x7fde8005a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:00.545 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.532+0000 7fde86244700 1 -- 172.21.15.158:0/2267637678 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde8009ba40 msgr2=0x7fde8005a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:51:00.545 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.532+0000 7fde86244700 1 --2- 172.21.15.158:0/2267637678 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde8009ba40 0x7fde8005a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:51:00.545 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.532+0000 7fde86244700 1 -- 172.21.15.158:0/2267637678 >> v1:172.21.15.96:6789/0 conn(0x7fde8005a950 legacy=0x7fde80155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:00.545 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.532+0000 7fde86244700 1 -- 172.21.15.158:0/2267637678 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde8007e960 con 0x7fde800b6970 2019-12-05T03:51:00.545 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.532+0000 7fde86244700 1 --2- 172.21.15.158:0/2267637678 >> v2:172.21.15.158:3300/0 conn(0x7fde800b6970 0x7fde8009add0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fde78008b10 tx=0x7fde780100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.546 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.532+0000 7fde86244700 1 --2- 172.21.15.158:0/2267637678 >> v2:172.21.15.158:3300/0 conn(0x7fde800b6970 0x7fde8009add0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fde78008b10 tx=0x7fde780100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.546 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.532+0000 7fde86244700 1 --2- 172.21.15.158:0/2267637678 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fde800b6970 0x7fde8009add0 secure :-1 s=READY pgs=375 cs=0 l=1 rx=0x7fde78008b10 tx=0x7fde780100b0).ready entity=mon.1 client_cookie=d148f5ccd4e56f4 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:51:00.546 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.532+0000 7fde86244700 1 --2- 172.21.15.158:0/2267637678 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fde800b6970 0x7fde8009add0 secure :-1 s=THROTTLE_DONE pgs=375 cs=0 l=1 rx=0x7fde78008b10 tx=0x7fde780100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.546 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.532+0000 7fde85242700 1 -- 172.21.15.158:0/2267637678 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde78010da0 con 0x7fde800b6970 2019-12-05T03:51:00.546 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.532+0000 7fde86244700 1 --2- 172.21.15.158:0/2267637678 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fde800b6970 0x7fde8009add0 secure :-1 s=THROTTLE_DONE pgs=375 cs=0 l=1 rx=0x7fde78008b10 tx=0x7fde780100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.546 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.532+0000 7fde86244700 1 --2- 172.21.15.158:0/2267637678 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fde800b6970 0x7fde8009add0 secure :-1 s=THROTTLE_DONE pgs=375 cs=0 l=1 rx=0x7fde78008b10 tx=0x7fde780100b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.546 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.532+0000 7fde85242700 1 -- 172.21.15.158:0/2267637678 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde780109c0 con 0x7fde800b6970 2019-12-05T03:51:00.547 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.532+0000 7fde85242700 1 -- 172.21.15.158:0/2267637678 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde780114a0 con 0x7fde800b6970 2019-12-05T03:51:00.547 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.532+0000 7fde87ca7700 1 -- 172.21.15.158:0/2267637678 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fde800b6970 msgr2=0x7fde8009add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:00.547 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.532+0000 7fde87ca7700 1 --2- 172.21.15.158:0/2267637678 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fde800b6970 0x7fde8009add0 secure :-1 s=READY pgs=375 cs=0 l=1 rx=0x7fde78008b10 tx=0x7fde780100b0).stop 2019-12-05T03:51:00.547 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.532+0000 7fde87ca7700 1 -- 172.21.15.158:0/2267637678 shutdown_connections 2019-12-05T03:51:00.547 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.532+0000 7fde87ca7700 1 --2- 172.21.15.158:0/2267637678 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fde800b6970 0x7fde8009add0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:00.547 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.532+0000 7fde87ca7700 1 --2- 172.21.15.158:0/2267637678 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde8009ba40 0x7fde8005a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:51:00.547 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.532+0000 7fde87ca7700 1 -- 172.21.15.158:0/2267637678 shutdown_connections 2019-12-05T03:51:00.548 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.532+0000 7fde87ca7700 1 -- 172.21.15.158:0/2267637678 wait complete. 2019-12-05T03:51:00.548 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.532+0000 7fde87ca7700 1 -- 172.21.15.158:0/2267637678 >> 172.21.15.158:0/2267637678 conn(0x7fde800b7ef0 msgr2=0x7fde800b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:51:00.548 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.532+0000 7fde87ca7700 1 Processor -- start 2019-12-05T03:51:00.548 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.532+0000 7fde87ca7700 1 -- start start 2019-12-05T03:51:00.549 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.536+0000 7fde87ca7700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde8012c930 0x7fde8013eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:00.549 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.536+0000 7fde87ca7700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fde8012f2b0 0x7fde8012f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:00.549 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.536+0000 7fde87ca7700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde8013c070 con 0x7fde8013bc40 2019-12-05T03:51:00.549 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.536+0000 7fde87ca7700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde800b6080 con 0x7fde8012f2b0 2019-12-05T03:51:00.549 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.536+0000 7fde87ca7700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde8012ead0 con 0x7fde8012c930 2019-12-05T03:51:00.549 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.536+0000 7fde86a45700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fde8012f2b0 0x7fde8012f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:00.550 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.536+0000 7fde86a45700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fde8012f2b0 0x7fde8012f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:55238/0 (socket says 172.21.15.158:55238) 2019-12-05T03:51:00.550 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.536+0000 7fde86a45700 1 -- 172.21.15.158:0/1786993665 learned_addr learned my addr 172.21.15.158:0/1786993665 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:51:00.550 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.536+0000 7fde86244700 1 --2- 172.21.15.158:0/1786993665 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde8012c930 0x7fde8013eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:00.550 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.536+0000 7fde86244700 1 -- 172.21.15.158:0/1786993665 >> v2:172.21.15.158:3300/0 conn(0x7fde8012f2b0 msgr2=0x7fde8012f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:00.550 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.536+0000 7fde86244700 1 --2- 172.21.15.158:0/1786993665 >> v2:172.21.15.158:3300/0 conn(0x7fde8012f2b0 0x7fde8012f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:00.550 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.536+0000 7fde86244700 1 -- 172.21.15.158:0/1786993665 >> v1:172.21.15.158:6789/0 conn(0x7fde8013bc40 legacy=0x7fde800b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:00.550 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.536+0000 7fde86244700 1 -- 172.21.15.158:0/1786993665 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde800acdb0 con 0x7fde8012c930 2019-12-05T03:51:00.551 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.536+0000 7fde86a45700 1 --2- 172.21.15.158:0/1786993665 >> v2:172.21.15.158:3300/0 conn(0x7fde8012f2b0 0x7fde8012f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:51:00.551 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.536+0000 7fde86244700 1 --2- 172.21.15.158:0/1786993665 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde8012c930 0x7fde8013eaa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fde800ad830 tx=0x7fde78010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.551 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.536+0000 7fde86244700 1 --2- 172.21.15.158:0/1786993665 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde8012c930 0x7fde8013eaa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fde800ad830 tx=0x7fde78010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.551 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.536+0000 7fde86244700 1 --2- 172.21.15.158:0/1786993665 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde8012c930 0x7fde8013eaa0 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7fde800ad830 tx=0x7fde78010cf0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:51:00.551 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.536+0000 7fde86244700 1 --2- 172.21.15.158:0/1786993665 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde8012c930 0x7fde8013eaa0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7fde800ad830 tx=0x7fde78010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.551 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.536+0000 7fde7effd700 1 -- 172.21.15.158:0/1786993665 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde78011bb0 con 0x7fde8012c930 2019-12-05T03:51:00.551 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.536+0000 7fde86244700 1 --2- 172.21.15.158:0/1786993665 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde8012c930 0x7fde8013eaa0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7fde800ad830 tx=0x7fde78010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.552 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.536+0000 7fde86244700 1 --2- 172.21.15.158:0/1786993665 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde8012c930 0x7fde8013eaa0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7fde800ad830 tx=0x7fde78010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.552 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.536+0000 7fde7effd700 1 -- 172.21.15.158:0/1786993665 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde780110c0 con 0x7fde8012c930 2019-12-05T03:51:00.552 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.536+0000 7fde87ca7700 1 -- 172.21.15.158:0/1786993665 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde8012e750 con 0x7fde8012c930 2019-12-05T03:51:00.552 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.536+0000 7fde7effd700 1 -- 172.21.15.158:0/1786993665 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde78005ab0 con 0x7fde8012c930 2019-12-05T03:51:00.552 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.536+0000 7fde87ca7700 1 -- 172.21.15.158:0/1786993665 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde8012fc30 con 0x7fde8012c930 2019-12-05T03:51:00.553 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.536+0000 7fde86244700 1 --2- 172.21.15.158:0/1786993665 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde8012c930 0x7fde8013eaa0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7fde800ad830 tx=0x7fde78010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.553 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.536+0000 7fde7effd700 1 -- 172.21.15.158:0/1786993665 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fde7800f280 con 0x7fde8012c930 2019-12-05T03:51:00.554 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.536+0000 7fde86244700 1 --2- 172.21.15.158:0/1786993665 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde8012c930 0x7fde8013eaa0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7fde800ad830 tx=0x7fde78010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.554 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.540+0000 7fde7effd700 1 --2- 172.21.15.158:0/1786993665 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fde6003ae40 0x7fde6003d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:00.554 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.540+0000 7fde7effd700 1 -- 172.21.15.158:0/1786993665 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6399+0+0 (secure 0 0 0) 0x7fde7804b520 con 0x7fde8012c930 2019-12-05T03:51:00.554 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.540+0000 7fde85a43700 1 --2- 172.21.15.158:0/1786993665 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fde6003ae40 0x7fde6003d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:00.554 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.540+0000 7fde85a43700 1 --2- 172.21.15.158:0/1786993665 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fde6003ae40 0x7fde6003d350 crc :-1 s=READY pgs=173 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:51:00.554 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.544+0000 7fde87ca7700 1 -- 172.21.15.158:0/1786993665 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde800554e0 con 0x7fde8012c930 2019-12-05T03:51:00.562 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.556+0000 7fde86244700 1 --2- 172.21.15.158:0/1786993665 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde8012c930 0x7fde8013eaa0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7fde800ad830 tx=0x7fde78010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.562 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.556+0000 7fde7effd700 1 -- 172.21.15.158:0/1786993665 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fde780325a0 con 0x7fde8012c930 2019-12-05T03:51:00.723 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.716+0000 7fde87ca7700 1 -- 172.21.15.158:0/1786993665 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7fde80066940 con 0x7fde8012c930 2019-12-05T03:51:00.723 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.716+0000 7fde86244700 1 --2- 172.21.15.158:0/1786993665 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde8012c930 0x7fde8013eaa0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7fde800ad830 tx=0x7fde78010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.724 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.716+0000 7fde7effd700 1 -- 172.21.15.158:0/1786993665 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v36) v1 ==== 92+0+10 (secure 0 0 0) 0x7fde78005d80 con 0x7fde8012c930 2019-12-05T03:51:00.724 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:51:00.726 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.720+0000 7fde87ca7700 1 -- 172.21.15.158:0/1786993665 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fde6003ae40 msgr2=0x7fde6003d350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:00.727 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.720+0000 7fde87ca7700 1 --2- 172.21.15.158:0/1786993665 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fde6003ae40 0x7fde6003d350 crc :-1 s=READY pgs=173 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:00.727 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.720+0000 7fde87ca7700 1 -- 172.21.15.158:0/1786993665 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde8012c930 msgr2=0x7fde8013eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:00.727 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.720+0000 7fde87ca7700 1 --2- 172.21.15.158:0/1786993665 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde8012c930 0x7fde8013eaa0 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7fde800ad830 tx=0x7fde78010cf0).stop 2019-12-05T03:51:00.727 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.720+0000 7fde87ca7700 1 -- 172.21.15.158:0/1786993665 shutdown_connections 2019-12-05T03:51:00.727 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.720+0000 7fde87ca7700 1 --2- 172.21.15.158:0/1786993665 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fde6003ae40 0x7fde6003d350 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:00.727 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.720+0000 7fde87ca7700 1 --2- 172.21.15.158:0/1786993665 >> v2:172.21.15.158:3300/0 conn(0x7fde8012f2b0 0x7fde8012f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:00.728 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.720+0000 7fde87ca7700 1 --2- 172.21.15.158:0/1786993665 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fde8012c930 0x7fde8013eaa0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:00.728 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.720+0000 7fde87ca7700 1 -- 172.21.15.158:0/1786993665 shutdown_connections 2019-12-05T03:51:00.728 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.720+0000 7fde87ca7700 1 -- 172.21.15.158:0/1786993665 wait complete. 2019-12-05T03:51:00.728 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.720+0000 7fde87ca7700 1 -- 172.21.15.158:0/1786993665 >> 172.21.15.158:0/1786993665 conn(0x7fde8009b490 msgr2=0x7fde80130560 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:51:00.736 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-12-05T03:51:00.836 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.824+0000 7f9c659ea700 1 Processor -- start 2019-12-05T03:51:00.836 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.824+0000 7f9c659ea700 1 -- start start 2019-12-05T03:51:00.837 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.824+0000 7f9c659ea700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f9c6009ba40 0x7f9c6009add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:51:00.837 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.824+0000 7f9c659ea700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c60099e30 con 0x7f9c600b6970 2019-12-05T03:51:00.837 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.824+0000 7f9c659ea700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c6007e960 con 0x7f9c600b5370 2019-12-05T03:51:00.837 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.824+0000 7f9c659ea700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c6009d210 con 0x7f9c6009ba40 2019-12-05T03:51:00.837 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.828+0000 7f9c5effd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f9c6009ba40 0x7f9c6009add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:00.837 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.828+0000 7f9c5effd700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f9c6009ba40 0x7f9c6009add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:55244/0 (socket says 172.21.15.158:55244) 2019-12-05T03:51:00.837 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.828+0000 7f9c5effd700 1 -- 172.21.15.158:0/3645498470 learned_addr learned my addr 172.21.15.158:0/3645498470 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:51:00.838 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.828+0000 7f9c5ffff700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f9c600b5370 0x7f9c600b57a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:50028/0 (socket says 172.21.15.158:50028) 2019-12-05T03:51:00.838 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.828+0000 7f9c5effd700 1 -- 172.21.15.158:0/3645498470 >> v1:172.21.15.158:6789/0 conn(0x7f9c600b5370 legacy=0x7f9c600b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:00.838 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.828+0000 7f9c5effd700 1 -- 172.21.15.158:0/3645498470 >> v1:172.21.15.96:6789/0 conn(0x7f9c600b6970 legacy=0x7f9c6005a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:00.838 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.828+0000 7f9c5e7fc700 1 -- 172.21.15.158:0/3645498470 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 441646199 0 0) 0x7f9c6007e960 con 0x7f9c600b5370 2019-12-05T03:51:00.838 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.828+0000 7f9c5effd700 1 -- 172.21.15.158:0/3645498470 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c600b5fa0 con 0x7f9c6009ba40 2019-12-05T03:51:00.838 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.828+0000 7f9c5effd700 1 --2- 172.21.15.158:0/3645498470 >> v2:172.21.15.158:3300/0 conn(0x7f9c6009ba40 0x7f9c6009add0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9c54008790 tx=0x7f9c5400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.838 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.828+0000 7f9c5effd700 1 --2- 172.21.15.158:0/3645498470 >> v2:172.21.15.158:3300/0 conn(0x7f9c6009ba40 0x7f9c6009add0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9c54008790 tx=0x7f9c5400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.839 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.828+0000 7f9c5effd700 1 --2- 172.21.15.158:0/3645498470 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c6009ba40 0x7f9c6009add0 secure :-1 s=READY pgs=378 cs=0 l=1 rx=0x7f9c54008790 tx=0x7f9c5400fcb0).ready entity=mon.1 client_cookie=4abd935f1d3789b9 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:51:00.839 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.828+0000 7f9c5effd700 1 --2- 172.21.15.158:0/3645498470 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c6009ba40 0x7f9c6009add0 secure :-1 s=THROTTLE_DONE pgs=378 cs=0 l=1 rx=0x7f9c54008790 tx=0x7f9c5400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.839 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.828+0000 7f9c5e7fc700 1 -- 172.21.15.158:0/3645498470 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c54008c90 con 0x7f9c6009ba40 2019-12-05T03:51:00.839 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.828+0000 7f9c5effd700 1 --2- 172.21.15.158:0/3645498470 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c6009ba40 0x7f9c6009add0 secure :-1 s=THROTTLE_DONE pgs=378 cs=0 l=1 rx=0x7f9c54008790 tx=0x7f9c5400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.839 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.828+0000 7f9c5effd700 1 --2- 172.21.15.158:0/3645498470 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c6009ba40 0x7f9c6009add0 secure :-1 s=THROTTLE_DONE pgs=378 cs=0 l=1 rx=0x7f9c54008790 tx=0x7f9c5400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.839 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.828+0000 7f9c5e7fc700 1 -- 172.21.15.158:0/3645498470 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c540088b0 con 0x7f9c6009ba40 2019-12-05T03:51:00.839 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.828+0000 7f9c5e7fc700 1 -- 172.21.15.158:0/3645498470 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c54011b80 con 0x7f9c6009ba40 2019-12-05T03:51:00.840 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.828+0000 7f9c659ea700 1 -- 172.21.15.158:0/3645498470 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c6009ba40 msgr2=0x7f9c6009add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:00.840 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.828+0000 7f9c659ea700 1 --2- 172.21.15.158:0/3645498470 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c6009ba40 0x7f9c6009add0 secure :-1 s=READY pgs=378 cs=0 l=1 rx=0x7f9c54008790 tx=0x7f9c5400fcb0).stop 2019-12-05T03:51:00.840 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.828+0000 7f9c659ea700 1 -- 172.21.15.158:0/3645498470 shutdown_connections 2019-12-05T03:51:00.840 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.828+0000 7f9c659ea700 1 --2- 172.21.15.158:0/3645498470 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c6009ba40 0x7f9c6009add0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:00.841 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.828+0000 7f9c659ea700 1 -- 172.21.15.158:0/3645498470 shutdown_connections 2019-12-05T03:51:00.841 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.828+0000 7f9c659ea700 1 -- 172.21.15.158:0/3645498470 wait complete. 2019-12-05T03:51:00.841 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.828+0000 7f9c659ea700 1 -- 172.21.15.158:0/3645498470 >> 172.21.15.158:0/3645498470 conn(0x7f9c600b7ef0 msgr2=0x7f9c600b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:51:00.847 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.832+0000 7f9c659ea700 1 Processor -- start 2019-12-05T03:51:00.847 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.832+0000 7f9c659ea700 1 -- start start 2019-12-05T03:51:00.847 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.832+0000 7f9c659ea700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f9c60154630 0x7f9c600ac610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:00.847 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.832+0000 7f9c659ea700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9c600b1e30 0x7f9c6007b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:00.847 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.832+0000 7f9c659ea700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c600acf60 con 0x7f9c6007b910 2019-12-05T03:51:00.847 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.832+0000 7f9c659ea700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c600b42a0 con 0x7f9c60154630 2019-12-05T03:51:00.847 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.832+0000 7f9c659ea700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c600b4540 con 0x7f9c600b1e30 2019-12-05T03:51:00.848 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.832+0000 7f9c5f7fe700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f9c60154630 0x7f9c600ac610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:00.848 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.832+0000 7f9c5ffff700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f9c6007b910 0x7f9c60152500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:50032/0 (socket says 172.21.15.158:50032) 2019-12-05T03:51:00.848 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.832+0000 7f9c5ffff700 1 -- 172.21.15.158:0/3118616003 learned_addr learned my addr 172.21.15.158:0/3118616003 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:51:00.848 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.832+0000 7f9c5effd700 1 --2- 172.21.15.158:0/3118616003 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9c600b1e30 0x7f9c6007b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:00.848 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.832+0000 7f9c47fff700 1 -- 172.21.15.158:0/3118616003 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 181500149 0 0) 0x7f9c600acf60 con 0x7f9c6007b910 2019-12-05T03:51:00.848 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.832+0000 7f9c47fff700 1 -- 172.21.15.158:0/3118616003 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c400030b0 con 0x7f9c6007b910 2019-12-05T03:51:00.849 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.832+0000 7f9c5f7fe700 1 -- 172.21.15.158:0/3118616003 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9c600b1e30 msgr2=0x7f9c6007b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:00.849 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.832+0000 7f9c5f7fe700 1 --2- 172.21.15.158:0/3118616003 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9c600b1e30 0x7f9c6007b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:00.849 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.832+0000 7f9c5f7fe700 1 -- 172.21.15.158:0/3118616003 >> v1:172.21.15.158:6789/0 conn(0x7f9c6007b910 legacy=0x7f9c60152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:00.849 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.832+0000 7f9c5f7fe700 1 -- 172.21.15.158:0/3118616003 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c600b47e0 con 0x7f9c60154630 2019-12-05T03:51:00.850 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.832+0000 7f9c5f7fe700 1 --2- 172.21.15.158:0/3118616003 >> v2:172.21.15.158:3300/0 conn(0x7f9c60154630 0x7f9c600ac610 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9c600b4460 tx=0x7f9c5000c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.850 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.832+0000 7f9c5f7fe700 1 --2- 172.21.15.158:0/3118616003 >> v2:172.21.15.158:3300/0 conn(0x7f9c60154630 0x7f9c600ac610 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9c600b4460 tx=0x7f9c5000c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.850 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.832+0000 7f9c5f7fe700 1 --2- 172.21.15.158:0/3118616003 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c60154630 0x7f9c600ac610 secure :-1 s=READY pgs=380 cs=0 l=1 rx=0x7f9c600b4460 tx=0x7f9c5000c320).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:51:00.850 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.832+0000 7f9c5f7fe700 1 --2- 172.21.15.158:0/3118616003 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c60154630 0x7f9c600ac610 secure :-1 s=THROTTLE_DONE pgs=380 cs=0 l=1 rx=0x7f9c600b4460 tx=0x7f9c5000c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.850 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.832+0000 7f9c47fff700 1 -- 172.21.15.158:0/3118616003 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c5000ca80 con 0x7f9c60154630 2019-12-05T03:51:00.850 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.832+0000 7f9c5f7fe700 1 --2- 172.21.15.158:0/3118616003 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c60154630 0x7f9c600ac610 secure :-1 s=THROTTLE_DONE pgs=380 cs=0 l=1 rx=0x7f9c600b4460 tx=0x7f9c5000c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.850 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.832+0000 7f9c5f7fe700 1 --2- 172.21.15.158:0/3118616003 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c60154630 0x7f9c600ac610 secure :-1 s=THROTTLE_DONE pgs=380 cs=0 l=1 rx=0x7f9c600b4460 tx=0x7f9c5000c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.851 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.832+0000 7f9c47fff700 1 -- 172.21.15.158:0/3118616003 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5000c6a0 con 0x7f9c60154630 2019-12-05T03:51:00.851 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.832+0000 7f9c47fff700 1 -- 172.21.15.158:0/3118616003 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c500110a0 con 0x7f9c60154630 2019-12-05T03:51:00.851 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.832+0000 7f9c659ea700 1 -- 172.21.15.158:0/3118616003 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c600b2260 con 0x7f9c60154630 2019-12-05T03:51:00.852 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.832+0000 7f9c659ea700 1 -- 172.21.15.158:0/3118616003 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c60153400 con 0x7f9c60154630 2019-12-05T03:51:00.852 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.836+0000 7f9c5f7fe700 1 --2- 172.21.15.158:0/3118616003 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c60154630 0x7f9c600ac610 secure :-1 s=THROTTLE_DONE pgs=380 cs=0 l=1 rx=0x7f9c600b4460 tx=0x7f9c5000c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.852 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.836+0000 7f9c47fff700 1 -- 172.21.15.158:0/3118616003 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f9c500113c0 con 0x7f9c60154630 2019-12-05T03:51:00.852 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.836+0000 7f9c5f7fe700 1 --2- 172.21.15.158:0/3118616003 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c60154630 0x7f9c600ac610 secure :-1 s=THROTTLE_DONE pgs=380 cs=0 l=1 rx=0x7f9c600b4460 tx=0x7f9c5000c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.853 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.836+0000 7f9c47fff700 1 --2- 172.21.15.158:0/3118616003 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f9c4003b220 0x7f9c4003d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:00.853 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.836+0000 7f9c47fff700 1 -- 172.21.15.158:0/3118616003 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6399+0+0 (secure 0 0 0) 0x7f9c5004b140 con 0x7f9c60154630 2019-12-05T03:51:00.853 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.836+0000 7f9c5effd700 1 --2- 172.21.15.158:0/3118616003 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f9c4003b220 0x7f9c4003d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:00.853 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.836+0000 7f9c5effd700 1 --2- 172.21.15.158:0/3118616003 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f9c4003b220 0x7f9c4003d730 crc :-1 s=READY pgs=174 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:51:00.853 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.840+0000 7f9c659ea700 1 -- 172.21.15.158:0/3118616003 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c6005a790 con 0x7f9c60154630 2019-12-05T03:51:00.854 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.844+0000 7f9c5f7fe700 1 --2- 172.21.15.158:0/3118616003 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c60154630 0x7f9c600ac610 secure :-1 s=THROTTLE_DONE pgs=380 cs=0 l=1 rx=0x7f9c600b4460 tx=0x7f9c5000c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:00.854 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.844+0000 7f9c47fff700 1 -- 172.21.15.158:0/3118616003 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f9c500321a0 con 0x7f9c60154630 2019-12-05T03:51:01.003 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.996+0000 7f9c659ea700 1 -- 172.21.15.158:0/3118616003 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f9c600554e0 con 0x7f9c60154630 2019-12-05T03:51:01.004 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.996+0000 7f9c5f7fe700 1 --2- 172.21.15.158:0/3118616003 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c60154630 0x7f9c600ac610 secure :-1 s=THROTTLE_DONE pgs=380 cs=0 l=1 rx=0x7f9c600b4460 tx=0x7f9c5000c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.005 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:00.996+0000 7f9c47fff700 1 -- 172.21.15.158:0/3118616003 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v36) v1 ==== 104+0+10 (secure 0 0 0) 0x7f9c50032400 con 0x7f9c60154630 2019-12-05T03:51:01.005 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:51:01.008 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.000+0000 7f9c659ea700 1 -- 172.21.15.158:0/3118616003 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f9c4003b220 msgr2=0x7f9c4003d730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:01.008 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.000+0000 7f9c659ea700 1 --2- 172.21.15.158:0/3118616003 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f9c4003b220 0x7f9c4003d730 crc :-1 s=READY pgs=174 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:01.008 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.000+0000 7f9c659ea700 1 -- 172.21.15.158:0/3118616003 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c60154630 msgr2=0x7f9c600ac610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:01.008 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.000+0000 7f9c659ea700 1 --2- 172.21.15.158:0/3118616003 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c60154630 0x7f9c600ac610 secure :-1 s=READY pgs=380 cs=0 l=1 rx=0x7f9c600b4460 tx=0x7f9c5000c320).stop 2019-12-05T03:51:01.009 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.000+0000 7f9c659ea700 1 -- 172.21.15.158:0/3118616003 shutdown_connections 2019-12-05T03:51:01.009 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.000+0000 7f9c659ea700 1 --2- 172.21.15.158:0/3118616003 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f9c4003b220 0x7f9c4003d730 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:01.009 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.000+0000 7f9c659ea700 1 --2- 172.21.15.158:0/3118616003 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9c60154630 0x7f9c600ac610 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:01.009 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.000+0000 7f9c659ea700 1 --2- 172.21.15.158:0/3118616003 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f9c600b1e30 0x7f9c6007b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:01.009 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.000+0000 7f9c659ea700 1 -- 172.21.15.158:0/3118616003 shutdown_connections 2019-12-05T03:51:01.010 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.000+0000 7f9c659ea700 1 -- 172.21.15.158:0/3118616003 wait complete. 2019-12-05T03:51:01.010 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.000+0000 7f9c659ea700 1 -- 172.21.15.158:0/3118616003 >> 172.21.15.158:0/3118616003 conn(0x7f9c6009b490 msgr2=0x7f9c6007be40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:51:01.017 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-12-05T03:51:01.114 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.100+0000 7fbfe441b700 1 Processor -- start 2019-12-05T03:51:01.114 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.100+0000 7fbfe441b700 1 -- start start 2019-12-05T03:51:01.114 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.104+0000 7fbfe441b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fbfdc09ba40 0x7fbfdc09add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:51:01.115 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.104+0000 7fbfe441b700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbfdc0b5370 0x7fbfdc0b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:51:01.115 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.104+0000 7fbfe441b700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfdc099e30 con 0x7fbfdc0b6970 2019-12-05T03:51:01.115 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.104+0000 7fbfe441b700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfdc09d210 con 0x7fbfdc0b5370 2019-12-05T03:51:01.115 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.104+0000 7fbfe441b700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfdc099b90 con 0x7fbfdc09ba40 2019-12-05T03:51:01.115 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.104+0000 7fbfe21b7700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fbfdc09ba40 0x7fbfdc09add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:01.116 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.104+0000 7fbfe29b8700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7fbfdc0b6970 0x7fbfdc05a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:50038/0 (socket says 172.21.15.158:50038) 2019-12-05T03:51:01.116 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.104+0000 7fbfe29b8700 1 -- 172.21.15.158:0/3481387469 learned_addr learned my addr 172.21.15.158:0/3481387469 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:51:01.116 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.104+0000 7fbfe31b9700 1 --2- 172.21.15.158:0/3481387469 >> v2:172.21.15.96:3300/0 conn(0x7fbfdc0b5370 0x7fbfdc0b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:01.116 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.104+0000 7fbfe21b7700 1 -- 172.21.15.158:0/3481387469 >> v2:172.21.15.96:3300/0 conn(0x7fbfdc0b5370 msgr2=0x7fbfdc0b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:51:01.117 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.104+0000 7fbfe21b7700 1 --2- 172.21.15.158:0/3481387469 >> v2:172.21.15.96:3300/0 conn(0x7fbfdc0b5370 0x7fbfdc0b57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:51:01.117 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.104+0000 7fbfe21b7700 1 -- 172.21.15.158:0/3481387469 >> v1:172.21.15.158:6789/0 conn(0x7fbfdc0b6970 legacy=0x7fbfdc05a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:01.117 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.104+0000 7fbfe19b6700 1 -- 172.21.15.158:0/3481387469 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2522993092 0 0) 0x7fbfdc099e30 con 0x7fbfdc0b6970 2019-12-05T03:51:01.117 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.104+0000 7fbfe21b7700 1 -- 172.21.15.158:0/3481387469 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfdc07e960 con 0x7fbfdc09ba40 2019-12-05T03:51:01.118 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.104+0000 7fbfe21b7700 1 --2- 172.21.15.158:0/3481387469 >> v2:172.21.15.158:3300/0 conn(0x7fbfdc09ba40 0x7fbfdc09add0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbfd0002f30 tx=0x7fbfd000fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.119 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.104+0000 7fbfe21b7700 1 --2- 172.21.15.158:0/3481387469 >> v2:172.21.15.158:3300/0 conn(0x7fbfdc09ba40 0x7fbfdc09add0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbfd0002f30 tx=0x7fbfd000fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.119 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.104+0000 7fbfe21b7700 1 --2- 172.21.15.158:0/3481387469 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfdc09ba40 0x7fbfdc09add0 secure :-1 s=READY pgs=382 cs=0 l=1 rx=0x7fbfd0002f30 tx=0x7fbfd000fc70).ready entity=mon.1 client_cookie=a990e75baa496e12 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:51:01.120 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.104+0000 7fbfe21b7700 1 --2- 172.21.15.158:0/3481387469 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfdc09ba40 0x7fbfdc09add0 secure :-1 s=THROTTLE_DONE pgs=382 cs=0 l=1 rx=0x7fbfd0002f30 tx=0x7fbfd000fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.120 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.104+0000 7fbfe19b6700 1 -- 172.21.15.158:0/3481387469 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfd0008bb0 con 0x7fbfdc09ba40 2019-12-05T03:51:01.120 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.104+0000 7fbfe21b7700 1 --2- 172.21.15.158:0/3481387469 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfdc09ba40 0x7fbfdc09add0 secure :-1 s=THROTTLE_DONE pgs=382 cs=0 l=1 rx=0x7fbfd0002f30 tx=0x7fbfd000fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.120 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.104+0000 7fbfe21b7700 1 --2- 172.21.15.158:0/3481387469 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfdc09ba40 0x7fbfdc09add0 secure :-1 s=THROTTLE_DONE pgs=382 cs=0 l=1 rx=0x7fbfd0002f30 tx=0x7fbfd000fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.120 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.104+0000 7fbfe19b6700 1 -- 172.21.15.158:0/3481387469 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd00087d0 con 0x7fbfdc09ba40 2019-12-05T03:51:01.121 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.104+0000 7fbfe19b6700 1 -- 172.21.15.158:0/3481387469 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfd0011820 con 0x7fbfdc09ba40 2019-12-05T03:51:01.121 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.104+0000 7fbfe441b700 1 -- 172.21.15.158:0/3481387469 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfdc09ba40 msgr2=0x7fbfdc09add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:01.121 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.104+0000 7fbfe441b700 1 --2- 172.21.15.158:0/3481387469 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfdc09ba40 0x7fbfdc09add0 secure :-1 s=READY pgs=382 cs=0 l=1 rx=0x7fbfd0002f30 tx=0x7fbfd000fc70).stop 2019-12-05T03:51:01.121 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.104+0000 7fbfe441b700 1 -- 172.21.15.158:0/3481387469 shutdown_connections 2019-12-05T03:51:01.121 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.104+0000 7fbfe441b700 1 --2- 172.21.15.158:0/3481387469 >> v2:172.21.15.96:3300/0 conn(0x7fbfdc0b5370 0x7fbfdc0b57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:51:01.121 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.108+0000 7fbfe441b700 1 --2- 172.21.15.158:0/3481387469 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfdc09ba40 0x7fbfdc09add0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:01.121 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.108+0000 7fbfe441b700 1 -- 172.21.15.158:0/3481387469 shutdown_connections 2019-12-05T03:51:01.122 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.108+0000 7fbfe441b700 1 -- 172.21.15.158:0/3481387469 wait complete. 2019-12-05T03:51:01.122 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.108+0000 7fbfe441b700 1 -- 172.21.15.158:0/3481387469 >> 172.21.15.158:0/3481387469 conn(0x7fbfdc0b7ef0 msgr2=0x7fbfdc0b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:51:01.125 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.108+0000 7fbfe441b700 1 Processor -- start 2019-12-05T03:51:01.125 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.108+0000 7fbfe441b700 1 -- start start 2019-12-05T03:51:01.125 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.112+0000 7fbfe441b700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbfdc07b940 0x7fbfdc12dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:01.125 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.112+0000 7fbfe441b700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fbfdc13a160 0x7fbfdc12d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:01.126 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.112+0000 7fbfe441b700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbfdc12d710 0x7fbfdc13ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:01.126 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.112+0000 7fbfe441b700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfdc154440 con 0x7fbfdc07b940 2019-12-05T03:51:01.126 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.112+0000 7fbfe441b700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfdc1546e0 con 0x7fbfdc13a160 2019-12-05T03:51:01.126 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.112+0000 7fbfe441b700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc13a590 con 0x7fbfdc12d710 2019-12-05T03:51:01.126 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.112+0000 7fbfe21b7700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fbfdc13a160 0x7fbfdc12d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:01.126 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.112+0000 7fbfe21b7700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fbfdc13a160 0x7fbfdc12d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:55264/0 (socket says 172.21.15.158:55264) 2019-12-05T03:51:01.126 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.112+0000 7fbfe21b7700 1 -- 172.21.15.158:0/1858467613 learned_addr learned my addr 172.21.15.158:0/1858467613 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:51:01.127 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.112+0000 7fbfe31b9700 1 --2- 172.21.15.158:0/1858467613 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbfdc12d710 0x7fbfdc13ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:01.127 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.112+0000 7fbfe29b8700 1 --2- 172.21.15.158:0/1858467613 >> v2:172.21.15.96:3300/0 conn(0x7fbfdc07b940 0x7fbfdc12dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:01.127 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.112+0000 7fbfe21b7700 1 -- 172.21.15.158:0/1858467613 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbfdc12d710 msgr2=0x7fbfdc13ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:01.127 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.112+0000 7fbfe21b7700 1 --2- 172.21.15.158:0/1858467613 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbfdc12d710 0x7fbfdc13ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:01.127 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.112+0000 7fbfe21b7700 1 -- 172.21.15.158:0/1858467613 >> v2:172.21.15.96:3300/0 conn(0x7fbfdc07b940 msgr2=0x7fbfdc12dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:01.127 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.112+0000 7fbfe21b7700 1 --2- 172.21.15.158:0/1858467613 >> v2:172.21.15.96:3300/0 conn(0x7fbfdc07b940 0x7fbfdc12dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:01.127 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.112+0000 7fbfe21b7700 1 -- 172.21.15.158:0/1858467613 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfdc13d210 con 0x7fbfdc13a160 2019-12-05T03:51:01.128 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.112+0000 7fbfe21b7700 1 --2- 172.21.15.158:0/1858467613 >> v2:172.21.15.158:3300/0 conn(0x7fbfdc13a160 0x7fbfdc12d1c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbfdc07e0c0 tx=0x7fbfd0008af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.128 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.112+0000 7fbfe21b7700 1 --2- 172.21.15.158:0/1858467613 >> v2:172.21.15.158:3300/0 conn(0x7fbfdc13a160 0x7fbfdc12d1c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbfdc07e0c0 tx=0x7fbfd0008af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.128 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.112+0000 7fbfe21b7700 1 --2- 172.21.15.158:0/1858467613 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfdc13a160 0x7fbfdc12d1c0 secure :-1 s=READY pgs=383 cs=0 l=1 rx=0x7fbfdc07e0c0 tx=0x7fbfd0008af0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:51:01.128 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.112+0000 7fbfe21b7700 1 --2- 172.21.15.158:0/1858467613 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfdc13a160 0x7fbfdc12d1c0 secure :-1 s=THROTTLE_DONE pgs=383 cs=0 l=1 rx=0x7fbfdc07e0c0 tx=0x7fbfd0008af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.128 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.112+0000 7fbfcf7fe700 1 -- 172.21.15.158:0/1858467613 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfd000f490 con 0x7fbfdc13a160 2019-12-05T03:51:01.128 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.112+0000 7fbfe21b7700 1 --2- 172.21.15.158:0/1858467613 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfdc13a160 0x7fbfdc12d1c0 secure :-1 s=THROTTLE_DONE pgs=383 cs=0 l=1 rx=0x7fbfdc07e0c0 tx=0x7fbfd0008af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.130 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.112+0000 7fbfe21b7700 1 --2- 172.21.15.158:0/1858467613 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfdc13a160 0x7fbfdc12d1c0 secure :-1 s=THROTTLE_DONE pgs=383 cs=0 l=1 rx=0x7fbfdc07e0c0 tx=0x7fbfd0008af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.130 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.112+0000 7fbfcf7fe700 1 -- 172.21.15.158:0/1858467613 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd0008db0 con 0x7fbfdc13a160 2019-12-05T03:51:01.130 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.112+0000 7fbfe441b700 1 -- 172.21.15.158:0/1858467613 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfdc13d420 con 0x7fbfdc13a160 2019-12-05T03:51:01.130 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.112+0000 7fbfcf7fe700 1 -- 172.21.15.158:0/1858467613 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfd0005920 con 0x7fbfdc13a160 2019-12-05T03:51:01.130 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.112+0000 7fbfe441b700 1 -- 172.21.15.158:0/1858467613 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfdc13d8f0 con 0x7fbfdc13a160 2019-12-05T03:51:01.130 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.112+0000 7fbfe21b7700 1 --2- 172.21.15.158:0/1858467613 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfdc13a160 0x7fbfdc12d1c0 secure :-1 s=THROTTLE_DONE pgs=383 cs=0 l=1 rx=0x7fbfdc07e0c0 tx=0x7fbfd0008af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.131 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.112+0000 7fbfcf7fe700 1 -- 172.21.15.158:0/1858467613 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fbfd00130b0 con 0x7fbfdc13a160 2019-12-05T03:51:01.131 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.112+0000 7fbfe21b7700 1 --2- 172.21.15.158:0/1858467613 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfdc13a160 0x7fbfdc12d1c0 secure :-1 s=THROTTLE_DONE pgs=383 cs=0 l=1 rx=0x7fbfdc07e0c0 tx=0x7fbfd0008af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.131 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.116+0000 7fbfcf7fe700 1 --2- 172.21.15.158:0/1858467613 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fbfc403ad40 0x7fbfc403d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:01.131 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.116+0000 7fbfcf7fe700 1 -- 172.21.15.158:0/1858467613 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6399+0+0 (secure 0 0 0) 0x7fbfd004b820 con 0x7fbfdc13a160 2019-12-05T03:51:01.131 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.116+0000 7fbfe29b8700 1 --2- 172.21.15.158:0/1858467613 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fbfc403ad40 0x7fbfc403d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:01.131 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.116+0000 7fbfe29b8700 1 --2- 172.21.15.158:0/1858467613 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fbfc403ad40 0x7fbfc403d250 crc :-1 s=READY pgs=175 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:51:01.131 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.116+0000 7fbfe441b700 1 -- 172.21.15.158:0/1858467613 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfdc1548a0 con 0x7fbfdc13a160 2019-12-05T03:51:01.132 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.124+0000 7fbfe21b7700 1 --2- 172.21.15.158:0/1858467613 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfdc13a160 0x7fbfdc12d1c0 secure :-1 s=THROTTLE_DONE pgs=383 cs=0 l=1 rx=0x7fbfdc07e0c0 tx=0x7fbfd0008af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.132 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.124+0000 7fbfcf7fe700 1 -- 172.21.15.158:0/1858467613 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fbfd00328a0 con 0x7fbfdc13a160 2019-12-05T03:51:01.292 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.284+0000 7fbfe441b700 1 -- 172.21.15.158:0/1858467613 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7fbfdc0554e0 con 0x7fbfdc13a160 2019-12-05T03:51:01.293 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.288+0000 7fbfe21b7700 1 --2- 172.21.15.158:0/1858467613 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfdc13a160 0x7fbfdc12d1c0 secure :-1 s=THROTTLE_DONE pgs=383 cs=0 l=1 rx=0x7fbfdc07e0c0 tx=0x7fbfd0008af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.293 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.288+0000 7fbfcf7fe700 1 -- 172.21.15.158:0/1858467613 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v36) v1 ==== 100+0+10 (secure 0 0 0) 0x7fbfd0032b00 con 0x7fbfdc13a160 2019-12-05T03:51:01.293 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:51:01.296 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.288+0000 7fbfe441b700 1 -- 172.21.15.158:0/1858467613 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fbfc403ad40 msgr2=0x7fbfc403d250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:01.297 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.288+0000 7fbfe441b700 1 --2- 172.21.15.158:0/1858467613 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fbfc403ad40 0x7fbfc403d250 crc :-1 s=READY pgs=175 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:01.297 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.288+0000 7fbfe441b700 1 -- 172.21.15.158:0/1858467613 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfdc13a160 msgr2=0x7fbfdc12d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:01.297 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.288+0000 7fbfe441b700 1 --2- 172.21.15.158:0/1858467613 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfdc13a160 0x7fbfdc12d1c0 secure :-1 s=READY pgs=383 cs=0 l=1 rx=0x7fbfdc07e0c0 tx=0x7fbfd0008af0).stop 2019-12-05T03:51:01.297 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.288+0000 7fbfe441b700 1 -- 172.21.15.158:0/1858467613 shutdown_connections 2019-12-05T03:51:01.297 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.288+0000 7fbfe441b700 1 --2- 172.21.15.158:0/1858467613 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fbfc403ad40 0x7fbfc403d250 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:01.297 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.288+0000 7fbfe441b700 1 --2- 172.21.15.158:0/1858467613 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fbfdc12d710 0x7fbfdc13ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:01.297 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.288+0000 7fbfe441b700 1 --2- 172.21.15.158:0/1858467613 >> v2:172.21.15.96:3300/0 conn(0x7fbfdc07b940 0x7fbfdc12dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:01.298 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.288+0000 7fbfe441b700 1 --2- 172.21.15.158:0/1858467613 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fbfdc13a160 0x7fbfdc12d1c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:01.298 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.288+0000 7fbfe441b700 1 -- 172.21.15.158:0/1858467613 shutdown_connections 2019-12-05T03:51:01.298 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.288+0000 7fbfe441b700 1 -- 172.21.15.158:0/1858467613 wait complete. 2019-12-05T03:51:01.298 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.288+0000 7fbfe441b700 1 -- 172.21.15.158:0/1858467613 >> 172.21.15.158:0/1858467613 conn(0x7fbfdc0b1e80 msgr2=0x7fbfdc12e760 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:51:01.305 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2019-12-05T03:51:01.406 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.392+0000 7f0b37b5c700 1 Processor -- start 2019-12-05T03:51:01.406 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.392+0000 7f0b37b5c700 1 -- start start 2019-12-05T03:51:01.406 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.396+0000 7f0b37b5c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f0b3009add0 0x7f0b300b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:51:01.406 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.396+0000 7f0b37b5c700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b30099e30 con 0x7f0b3009ba40 2019-12-05T03:51:01.406 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.396+0000 7f0b37b5c700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b300b60c0 con 0x7f0b300b6970 2019-12-05T03:51:01.407 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.396+0000 7f0b37b5c700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b3009d210 con 0x7f0b3009add0 2019-12-05T03:51:01.407 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.396+0000 7f0b360f9700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f0b300b6970 0x7f0b3005a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:50054/0 (socket says 172.21.15.158:50054) 2019-12-05T03:51:01.407 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.396+0000 7f0b368fa700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f0b3009add0 0x7f0b300b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:01.407 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.396+0000 7f0b360f9700 1 -- 172.21.15.158:0/324501961 learned_addr learned my addr 172.21.15.158:0/324501961 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:51:01.407 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.396+0000 7f0b368fa700 1 -- 172.21.15.158:0/324501961 >> v1:172.21.15.158:6789/0 conn(0x7f0b300b6970 legacy=0x7f0b3005a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:01.407 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.396+0000 7f0b368fa700 1 -- 172.21.15.158:0/324501961 >> v1:172.21.15.96:6789/0 conn(0x7f0b3009ba40 legacy=0x7f0b300b5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:01.407 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.396+0000 7f0b350f7700 1 -- 172.21.15.158:0/324501961 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3187753816 0 0) 0x7f0b300b60c0 con 0x7f0b300b6970 2019-12-05T03:51:01.408 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.396+0000 7f0b368fa700 1 -- 172.21.15.158:0/324501961 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b3007e960 con 0x7f0b3009add0 2019-12-05T03:51:01.408 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.396+0000 7f0b368fa700 1 --2- 172.21.15.158:0/324501961 >> v2:172.21.15.158:3300/0 conn(0x7f0b3009add0 0x7f0b300b5b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0b20001110 tx=0x7f0b20001150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.408 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.396+0000 7f0b368fa700 1 --2- 172.21.15.158:0/324501961 >> v2:172.21.15.158:3300/0 conn(0x7f0b3009add0 0x7f0b300b5b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0b20001110 tx=0x7f0b20001150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.408 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.396+0000 7f0b368fa700 1 --2- 172.21.15.158:0/324501961 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0b3009add0 0x7f0b300b5b70 secure :-1 s=READY pgs=385 cs=0 l=1 rx=0x7f0b20001110 tx=0x7f0b20001150).ready entity=mon.1 client_cookie=cfad8c76d70ee4ea server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:51:01.408 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.396+0000 7f0b368fa700 1 --2- 172.21.15.158:0/324501961 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0b3009add0 0x7f0b300b5b70 secure :-1 s=THROTTLE_DONE pgs=385 cs=0 l=1 rx=0x7f0b20001110 tx=0x7f0b20001150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.408 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.396+0000 7f0b350f7700 1 -- 172.21.15.158:0/324501961 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b28010a70 con 0x7f0b3009add0 2019-12-05T03:51:01.408 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.396+0000 7f0b368fa700 1 --2- 172.21.15.158:0/324501961 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0b3009add0 0x7f0b300b5b70 secure :-1 s=THROTTLE_DONE pgs=385 cs=0 l=1 rx=0x7f0b20001110 tx=0x7f0b20001150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.409 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.396+0000 7f0b350f7700 1 -- 172.21.15.158:0/324501961 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b28010690 con 0x7f0b3009add0 2019-12-05T03:51:01.409 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.396+0000 7f0b368fa700 1 --2- 172.21.15.158:0/324501961 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0b3009add0 0x7f0b300b5b70 secure :-1 s=THROTTLE_DONE pgs=385 cs=0 l=1 rx=0x7f0b20001110 tx=0x7f0b20001150).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.409 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.396+0000 7f0b37b5c700 1 -- 172.21.15.158:0/324501961 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0b3009add0 msgr2=0x7f0b300b5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:01.409 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.396+0000 7f0b350f7700 1 -- 172.21.15.158:0/324501961 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b280112b0 con 0x7f0b3009add0 2019-12-05T03:51:01.409 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.396+0000 7f0b37b5c700 1 --2- 172.21.15.158:0/324501961 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0b3009add0 0x7f0b300b5b70 secure :-1 s=READY pgs=385 cs=0 l=1 rx=0x7f0b20001110 tx=0x7f0b20001150).stop 2019-12-05T03:51:01.409 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.396+0000 7f0b37b5c700 1 -- 172.21.15.158:0/324501961 shutdown_connections 2019-12-05T03:51:01.409 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.396+0000 7f0b37b5c700 1 --2- 172.21.15.158:0/324501961 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0b3009add0 0x7f0b300b5b70 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:01.410 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.396+0000 7f0b37b5c700 1 -- 172.21.15.158:0/324501961 shutdown_connections 2019-12-05T03:51:01.410 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.396+0000 7f0b37b5c700 1 -- 172.21.15.158:0/324501961 wait complete. 2019-12-05T03:51:01.410 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.396+0000 7f0b37b5c700 1 -- 172.21.15.158:0/324501961 >> 172.21.15.158:0/324501961 conn(0x7f0b300b7ef0 msgr2=0x7f0b300b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:51:01.411 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.400+0000 7f0b37b5c700 1 Processor -- start 2019-12-05T03:51:01.411 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.400+0000 7f0b37b5c700 1 -- start start 2019-12-05T03:51:01.414 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.400+0000 7f0b37b5c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f0b30141950 0x7f0b3007b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:01.415 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.400+0000 7f0b37b5c700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b30131840 0x7f0b30131c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:01.415 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.400+0000 7f0b37b5c700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b30141300 con 0x7f0b30140ed0 2019-12-05T03:51:01.415 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.400+0000 7f0b37b5c700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b30141d80 con 0x7f0b30141950 2019-12-05T03:51:01.415 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.400+0000 7f0b37b5c700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b301416b0 con 0x7f0b30131840 2019-12-05T03:51:01.415 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.400+0000 7f0b360f9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f0b30141950 0x7f0b3007b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:01.415 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.400+0000 7f0b360f9700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f0b30141950 0x7f0b3007b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:55278/0 (socket says 172.21.15.158:55278) 2019-12-05T03:51:01.415 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.400+0000 7f0b358f8700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f0b30140ed0 0x7f0b300b3ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:50060/0 (socket says 172.21.15.158:50060) 2019-12-05T03:51:01.416 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.400+0000 7f0b360f9700 1 -- 172.21.15.158:0/607983679 learned_addr learned my addr 172.21.15.158:0/607983679 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:51:01.416 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.400+0000 7f0b368fa700 1 --2- 172.21.15.158:0/607983679 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b30131840 0x7f0b30131c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:01.416 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.404+0000 7f0b360f9700 1 -- 172.21.15.158:0/607983679 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b30131840 msgr2=0x7f0b30131c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:01.416 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.404+0000 7f0b360f9700 1 --2- 172.21.15.158:0/607983679 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b30131840 0x7f0b30131c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:01.416 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.404+0000 7f0b360f9700 1 -- 172.21.15.158:0/607983679 >> v1:172.21.15.158:6789/0 conn(0x7f0b30140ed0 legacy=0x7f0b300b3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:01.416 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.404+0000 7f0b360f9700 1 -- 172.21.15.158:0/607983679 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b30148110 con 0x7f0b30141950 2019-12-05T03:51:01.416 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.404+0000 7f0b360f9700 1 --2- 172.21.15.158:0/607983679 >> v2:172.21.15.158:3300/0 conn(0x7f0b30141950 0x7f0b3007b7c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0b200012a0 tx=0x7f0b200012e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.417 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.404+0000 7f0b360f9700 1 --2- 172.21.15.158:0/607983679 >> v2:172.21.15.158:3300/0 conn(0x7f0b30141950 0x7f0b3007b7c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0b200012a0 tx=0x7f0b200012e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.417 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.404+0000 7f0b360f9700 1 --2- 172.21.15.158:0/607983679 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0b30141950 0x7f0b3007b7c0 secure :-1 s=READY pgs=387 cs=0 l=1 rx=0x7f0b200012a0 tx=0x7f0b200012e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:51:01.417 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.404+0000 7f0b360f9700 1 --2- 172.21.15.158:0/607983679 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0b30141950 0x7f0b3007b7c0 secure :-1 s=THROTTLE_DONE pgs=387 cs=0 l=1 rx=0x7f0b200012a0 tx=0x7f0b200012e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.417 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.404+0000 7f0b360f9700 1 --2- 172.21.15.158:0/607983679 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0b30141950 0x7f0b3007b7c0 secure :-1 s=THROTTLE_DONE pgs=387 cs=0 l=1 rx=0x7f0b200012a0 tx=0x7f0b200012e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.417 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.404+0000 7f0b26ffd700 1 -- 172.21.15.158:0/607983679 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b2c011530 con 0x7f0b30141950 2019-12-05T03:51:01.417 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.404+0000 7f0b360f9700 1 --2- 172.21.15.158:0/607983679 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0b30141950 0x7f0b3007b7c0 secure :-1 s=THROTTLE_DONE pgs=387 cs=0 l=1 rx=0x7f0b200012a0 tx=0x7f0b200012e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.417 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.404+0000 7f0b26ffd700 1 -- 172.21.15.158:0/607983679 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b2c011150 con 0x7f0b30141950 2019-12-05T03:51:01.418 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.404+0000 7f0b37b5c700 1 -- 172.21.15.158:0/607983679 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b3013d910 con 0x7f0b30141950 2019-12-05T03:51:01.418 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.404+0000 7f0b26ffd700 1 -- 172.21.15.158:0/607983679 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b2c011b10 con 0x7f0b30141950 2019-12-05T03:51:01.418 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.404+0000 7f0b37b5c700 1 -- 172.21.15.158:0/607983679 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b3013dde0 con 0x7f0b30141950 2019-12-05T03:51:01.418 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.404+0000 7f0b360f9700 1 --2- 172.21.15.158:0/607983679 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0b30141950 0x7f0b3007b7c0 secure :-1 s=THROTTLE_DONE pgs=387 cs=0 l=1 rx=0x7f0b200012a0 tx=0x7f0b200012e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.418 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.404+0000 7f0b26ffd700 1 -- 172.21.15.158:0/607983679 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f0b2c00b330 con 0x7f0b30141950 2019-12-05T03:51:01.418 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.404+0000 7f0b360f9700 1 --2- 172.21.15.158:0/607983679 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0b30141950 0x7f0b3007b7c0 secure :-1 s=THROTTLE_DONE pgs=387 cs=0 l=1 rx=0x7f0b200012a0 tx=0x7f0b200012e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.418 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.404+0000 7f0b26ffd700 1 --2- 172.21.15.158:0/607983679 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f0b1803adb0 0x7f0b1803d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:01.419 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.404+0000 7f0b26ffd700 1 -- 172.21.15.158:0/607983679 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6399+0+0 (secure 0 0 0) 0x7f0b2c04af40 con 0x7f0b30141950 2019-12-05T03:51:01.419 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.404+0000 7f0b358f8700 1 --2- 172.21.15.158:0/607983679 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f0b1803adb0 0x7f0b1803d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:01.419 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.408+0000 7f0b358f8700 1 --2- 172.21.15.158:0/607983679 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f0b1803adb0 0x7f0b1803d2c0 crc :-1 s=READY pgs=176 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:51:01.419 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.408+0000 7f0b37b5c700 1 -- 172.21.15.158:0/607983679 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b300554e0 con 0x7f0b30141950 2019-12-05T03:51:01.422 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.416+0000 7f0b360f9700 1 --2- 172.21.15.158:0/607983679 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0b30141950 0x7f0b3007b7c0 secure :-1 s=THROTTLE_DONE pgs=387 cs=0 l=1 rx=0x7f0b200012a0 tx=0x7f0b200012e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.422 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.416+0000 7f0b26ffd700 1 -- 172.21.15.158:0/607983679 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f0b2c031fc0 con 0x7f0b30141950 2019-12-05T03:51:01.582 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.576+0000 7f0b37b5c700 1 -- 172.21.15.158:0/607983679 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "data_new"} v 0) v1 -- 0x7f0b30066940 con 0x7f0b30141950 2019-12-05T03:51:01.583 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.576+0000 7f0b360f9700 1 --2- 172.21.15.158:0/607983679 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0b30141950 0x7f0b3007b7c0 secure :-1 s=THROTTLE_DONE pgs=387 cs=0 l=1 rx=0x7f0b200012a0 tx=0x7f0b200012e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.583 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.576+0000 7f0b26ffd700 1 -- 172.21.15.158:0/607983679 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "data_new"}]=0 v36) v1 ==== 97+0+10 (secure 0 0 0) 0x7f0b2c032220 con 0x7f0b30141950 2019-12-05T03:51:01.583 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:51:01.586 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.580+0000 7f0b37b5c700 1 -- 172.21.15.158:0/607983679 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f0b1803adb0 msgr2=0x7f0b1803d2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:01.586 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.580+0000 7f0b37b5c700 1 --2- 172.21.15.158:0/607983679 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f0b1803adb0 0x7f0b1803d2c0 crc :-1 s=READY pgs=176 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:01.586 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.580+0000 7f0b37b5c700 1 -- 172.21.15.158:0/607983679 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0b30141950 msgr2=0x7f0b3007b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:01.586 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.580+0000 7f0b37b5c700 1 --2- 172.21.15.158:0/607983679 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0b30141950 0x7f0b3007b7c0 secure :-1 s=READY pgs=387 cs=0 l=1 rx=0x7f0b200012a0 tx=0x7f0b200012e0).stop 2019-12-05T03:51:01.586 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.580+0000 7f0b37b5c700 1 -- 172.21.15.158:0/607983679 shutdown_connections 2019-12-05T03:51:01.586 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.580+0000 7f0b37b5c700 1 --2- 172.21.15.158:0/607983679 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f0b1803adb0 0x7f0b1803d2c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:01.587 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.580+0000 7f0b37b5c700 1 --2- 172.21.15.158:0/607983679 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f0b30141950 0x7f0b3007b7c0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:01.587 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.580+0000 7f0b37b5c700 1 --2- 172.21.15.158:0/607983679 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f0b30131840 0x7f0b30131c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:01.587 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.580+0000 7f0b37b5c700 1 -- 172.21.15.158:0/607983679 shutdown_connections 2019-12-05T03:51:01.587 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.580+0000 7f0b37b5c700 1 -- 172.21.15.158:0/607983679 wait complete. 2019-12-05T03:51:01.587 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.580+0000 7f0b37b5c700 1 -- 172.21.15.158:0/607983679 >> 172.21.15.158:0/607983679 conn(0x7f0b3005a1f0 msgr2=0x7f0b300593f0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:51:01.596 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-12-05T03:51:01.597 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-12-05T03:51:01.697 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.684+0000 7fa1be5dc700 1 Processor -- start 2019-12-05T03:51:01.697 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.684+0000 7fa1be5dc700 1 -- start start 2019-12-05T03:51:01.698 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.688+0000 7fa1be5dc700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa1b809cf60 0x7fa1b809a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:51:01.698 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.688+0000 7fa1be5dc700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa1b805a740 0x7fa1b8151460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:51:01.698 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.688+0000 7fa1be5dc700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1b80accb0 con 0x7fa1b81519b0 2019-12-05T03:51:01.698 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.688+0000 7fa1be5dc700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b80b1730 con 0x7fa1b809cf60 2019-12-05T03:51:01.698 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.688+0000 7fa1be5dc700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b80b19d0 con 0x7fa1b805a740 2019-12-05T03:51:01.698 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.688+0000 7fa1b7fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa1b805a740 0x7fa1b8151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:01.698 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.688+0000 7fa1b7fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa1b805a740 0x7fa1b8151460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:55286/0 (socket says 172.21.15.158:55286) 2019-12-05T03:51:01.699 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.688+0000 7fa1b7fff700 1 -- 172.21.15.158:0/709424785 learned_addr learned my addr 172.21.15.158:0/709424785 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:51:01.699 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.688+0000 7fa1bcb79700 1 --2- 172.21.15.158:0/709424785 >> v2:172.21.15.96:3300/0 conn(0x7fa1b809cf60 0x7fa1b809a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:01.699 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.688+0000 7fa1b7fff700 1 -- 172.21.15.158:0/709424785 >> v2:172.21.15.96:3300/0 conn(0x7fa1b809cf60 msgr2=0x7fa1b809a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:51:01.699 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.688+0000 7fa1b7fff700 1 --2- 172.21.15.158:0/709424785 >> v2:172.21.15.96:3300/0 conn(0x7fa1b809cf60 0x7fa1b809a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:51:01.699 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.688+0000 7fa1b7fff700 1 -- 172.21.15.158:0/709424785 >> v1:172.21.15.96:6789/0 conn(0x7fa1b81519b0 legacy=0x7fa1b80b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:01.699 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.688+0000 7fa1b7fff700 1 -- 172.21.15.158:0/709424785 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b805ab70 con 0x7fa1b805a740 2019-12-05T03:51:01.699 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.688+0000 7fa1b7fff700 1 --2- 172.21.15.158:0/709424785 >> v2:172.21.15.158:3300/0 conn(0x7fa1b805a740 0x7fa1b8151460 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa1ac002f30 tx=0x7fa1ac00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.700 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.688+0000 7fa1b7fff700 1 --2- 172.21.15.158:0/709424785 >> v2:172.21.15.158:3300/0 conn(0x7fa1b805a740 0x7fa1b8151460 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa1ac002f30 tx=0x7fa1ac00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.700 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.688+0000 7fa1b7fff700 1 --2- 172.21.15.158:0/709424785 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1b805a740 0x7fa1b8151460 secure :-1 s=READY pgs=388 cs=0 l=1 rx=0x7fa1ac002f30 tx=0x7fa1ac00fd30).ready entity=mon.1 client_cookie=5adbffd657841b4d server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:51:01.700 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.688+0000 7fa1b7fff700 1 --2- 172.21.15.158:0/709424785 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1b805a740 0x7fa1b8151460 secure :-1 s=THROTTLE_DONE pgs=388 cs=0 l=1 rx=0x7fa1ac002f30 tx=0x7fa1ac00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.700 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.688+0000 7fa1b7fff700 1 --2- 172.21.15.158:0/709424785 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1b805a740 0x7fa1b8151460 secure :-1 s=THROTTLE_DONE pgs=388 cs=0 l=1 rx=0x7fa1ac002f30 tx=0x7fa1ac00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.701 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.688+0000 7fa1b77fe700 1 -- 172.21.15.158:0/709424785 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1ac011370 con 0x7fa1b805a740 2019-12-05T03:51:01.701 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.688+0000 7fa1b7fff700 1 --2- 172.21.15.158:0/709424785 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1b805a740 0x7fa1b8151460 secure :-1 s=THROTTLE_DONE pgs=388 cs=0 l=1 rx=0x7fa1ac002f30 tx=0x7fa1ac00fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.701 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.688+0000 7fa1b77fe700 1 -- 172.21.15.158:0/709424785 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1ac008bb0 con 0x7fa1b805a740 2019-12-05T03:51:01.701 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.688+0000 7fa1b77fe700 1 -- 172.21.15.158:0/709424785 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1ac011950 con 0x7fa1b805a740 2019-12-05T03:51:01.702 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.688+0000 7fa1be5dc700 1 -- 172.21.15.158:0/709424785 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1b805a740 msgr2=0x7fa1b8151460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:01.702 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.688+0000 7fa1be5dc700 1 --2- 172.21.15.158:0/709424785 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1b805a740 0x7fa1b8151460 secure :-1 s=READY pgs=388 cs=0 l=1 rx=0x7fa1ac002f30 tx=0x7fa1ac00fd30).stop 2019-12-05T03:51:01.702 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.688+0000 7fa1be5dc700 1 -- 172.21.15.158:0/709424785 shutdown_connections 2019-12-05T03:51:01.702 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.688+0000 7fa1be5dc700 1 --2- 172.21.15.158:0/709424785 >> v2:172.21.15.96:3300/0 conn(0x7fa1b809cf60 0x7fa1b809a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:51:01.702 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.688+0000 7fa1be5dc700 1 --2- 172.21.15.158:0/709424785 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1b805a740 0x7fa1b8151460 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:01.702 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.688+0000 7fa1be5dc700 1 -- 172.21.15.158:0/709424785 shutdown_connections 2019-12-05T03:51:01.702 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.688+0000 7fa1be5dc700 1 -- 172.21.15.158:0/709424785 wait complete. 2019-12-05T03:51:01.703 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.688+0000 7fa1be5dc700 1 -- 172.21.15.158:0/709424785 >> 172.21.15.158:0/709424785 conn(0x7fa1b80b7e60 msgr2=0x7fa1b80b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:51:01.706 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.692+0000 7fa1be5dc700 1 Processor -- start 2019-12-05T03:51:01.706 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.692+0000 7fa1be5dc700 1 -- start start 2019-12-05T03:51:01.707 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.692+0000 7fa1be5dc700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa1b812f9b0 0x7fa1b8130200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:01.707 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.692+0000 7fa1be5dc700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa1b8154250 0x7fa1b8151230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:01.707 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.692+0000 7fa1be5dc700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1b8130cd0 con 0x7fa1b8151780 2019-12-05T03:51:01.707 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.692+0000 7fa1be5dc700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b812ef40 con 0x7fa1b812f9b0 2019-12-05T03:51:01.707 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.692+0000 7fa1be5dc700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b80b0fa0 con 0x7fa1b8154250 2019-12-05T03:51:01.707 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.692+0000 7fa1bcb79700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa1b812f9b0 0x7fa1b8130200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:01.708 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.692+0000 7fa1bcb79700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7fa1b812f9b0 0x7fa1b8130200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:55290/0 (socket says 172.21.15.158:55290) 2019-12-05T03:51:01.708 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.692+0000 7fa1bcb79700 1 -- 172.21.15.158:0/950517669 learned_addr learned my addr 172.21.15.158:0/950517669 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:51:01.708 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.692+0000 7fa1b7fff700 1 --2- 172.21.15.158:0/950517669 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa1b8154250 0x7fa1b8151230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:01.708 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.692+0000 7fa1bcb79700 1 -- 172.21.15.158:0/950517669 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa1b8154250 msgr2=0x7fa1b8151230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:01.708 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.692+0000 7fa1bcb79700 1 --2- 172.21.15.158:0/950517669 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa1b8154250 0x7fa1b8151230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:01.708 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.692+0000 7fa1b57fa700 1 -- 172.21.15.158:0/950517669 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2011592847 0 0) 0x7fa1b8130cd0 con 0x7fa1b8151780 2019-12-05T03:51:01.708 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.692+0000 7fa1bcb79700 1 -- 172.21.15.158:0/950517669 >> v1:172.21.15.158:6789/0 conn(0x7fa1b8151780 legacy=0x7fa1b813fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:01.709 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.692+0000 7fa1bcb79700 1 -- 172.21.15.158:0/950517669 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b812d900 con 0x7fa1b812f9b0 2019-12-05T03:51:01.709 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.692+0000 7fa1bcb79700 1 --2- 172.21.15.158:0/950517669 >> v2:172.21.15.158:3300/0 conn(0x7fa1b812f9b0 0x7fa1b8130200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa1a8003070 tx=0x7fa1a8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.709 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.692+0000 7fa1bcb79700 1 --2- 172.21.15.158:0/950517669 >> v2:172.21.15.158:3300/0 conn(0x7fa1b812f9b0 0x7fa1b8130200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa1a8003070 tx=0x7fa1a8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.709 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.692+0000 7fa1bcb79700 1 --2- 172.21.15.158:0/950517669 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1b812f9b0 0x7fa1b8130200 secure :-1 s=READY pgs=390 cs=0 l=1 rx=0x7fa1a8003070 tx=0x7fa1a8010ba0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:51:01.709 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.692+0000 7fa1bcb79700 1 --2- 172.21.15.158:0/950517669 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1b812f9b0 0x7fa1b8130200 secure :-1 s=THROTTLE_DONE pgs=390 cs=0 l=1 rx=0x7fa1a8003070 tx=0x7fa1a8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.709 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.696+0000 7fa1b57fa700 1 -- 172.21.15.158:0/950517669 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1a8005930 con 0x7fa1b812f9b0 2019-12-05T03:51:01.709 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.696+0000 7fa1bcb79700 1 --2- 172.21.15.158:0/950517669 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1b812f9b0 0x7fa1b8130200 secure :-1 s=THROTTLE_DONE pgs=390 cs=0 l=1 rx=0x7fa1a8003070 tx=0x7fa1a8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.710 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.696+0000 7fa1bcb79700 1 --2- 172.21.15.158:0/950517669 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1b812f9b0 0x7fa1b8130200 secure :-1 s=THROTTLE_DONE pgs=390 cs=0 l=1 rx=0x7fa1a8003070 tx=0x7fa1a8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.710 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.696+0000 7fa1b57fa700 1 -- 172.21.15.158:0/950517669 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a8007160 con 0x7fa1b812f9b0 2019-12-05T03:51:01.710 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.696+0000 7fa1b57fa700 1 -- 172.21.15.158:0/950517669 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1a80087f0 con 0x7fa1b812f9b0 2019-12-05T03:51:01.710 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.696+0000 7fa1be5dc700 1 -- 172.21.15.158:0/950517669 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b8151bb0 con 0x7fa1b812f9b0 2019-12-05T03:51:01.710 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.696+0000 7fa1be5dc700 1 -- 172.21.15.158:0/950517669 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1b8140230 con 0x7fa1b812f9b0 2019-12-05T03:51:01.711 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.696+0000 7fa1bcb79700 1 --2- 172.21.15.158:0/950517669 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1b812f9b0 0x7fa1b8130200 secure :-1 s=THROTTLE_DONE pgs=390 cs=0 l=1 rx=0x7fa1a8003070 tx=0x7fa1a8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.711 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.696+0000 7fa1b57fa700 1 -- 172.21.15.158:0/950517669 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7fa1a8008ac0 con 0x7fa1b812f9b0 2019-12-05T03:51:01.711 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.696+0000 7fa1bcb79700 1 --2- 172.21.15.158:0/950517669 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1b812f9b0 0x7fa1b8130200 secure :-1 s=THROTTLE_DONE pgs=390 cs=0 l=1 rx=0x7fa1a8003070 tx=0x7fa1a8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.711 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.696+0000 7fa1b57fa700 1 --2- 172.21.15.158:0/950517669 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa19803ac80 0x7fa19803d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:01.711 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.696+0000 7fa1b57fa700 1 -- 172.21.15.158:0/950517669 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6399+0+0 (secure 0 0 0) 0x7fa1a804aff0 con 0x7fa1b812f9b0 2019-12-05T03:51:01.711 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.696+0000 7fa1b7fff700 1 --2- 172.21.15.158:0/950517669 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa19803ac80 0x7fa19803d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:01.711 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.696+0000 7fa1b7fff700 1 --2- 172.21.15.158:0/950517669 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa19803ac80 0x7fa19803d190 crc :-1 s=READY pgs=177 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:51:01.712 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.700+0000 7fa1be5dc700 1 -- 172.21.15.158:0/950517669 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1b80554e0 con 0x7fa1b812f9b0 2019-12-05T03:51:01.714 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.708+0000 7fa1bcb79700 1 --2- 172.21.15.158:0/950517669 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1b812f9b0 0x7fa1b8130200 secure :-1 s=THROTTLE_DONE pgs=390 cs=0 l=1 rx=0x7fa1a8003070 tx=0x7fa1a8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.715 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.708+0000 7fa1b57fa700 1 -- 172.21.15.158:0/950517669 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7fa1a8008dd0 con 0x7fa1b812f9b0 2019-12-05T03:51:01.880 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.872+0000 7fa1be5dc700 1 -- 172.21.15.158:0/950517669 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1b8066940 con 0x7fa1b812f9b0 2019-12-05T03:51:01.881 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.872+0000 7fa1bcb79700 1 --2- 172.21.15.158:0/950517669 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1b812f9b0 0x7fa1b8130200 secure :-1 s=THROTTLE_DONE pgs=390 cs=0 l=1 rx=0x7fa1a8003070 tx=0x7fa1a8010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:01.881 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.872+0000 7fa1b57fa700 1 -- 172.21.15.158:0/950517669 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2111 (secure 0 0 0) 0x7fa1a8032070 con 0x7fa1b812f9b0 2019-12-05T03:51:01.883 INFO:teuthology.orchestra.run.smithi158.stderr:dumped fsmap epoch 16 2019-12-05T03:51:01.883 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:51:01.883 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4604,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.96:6835/4291398037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":4291398037},{"type":"v1","addr":"172.21.15.96:6835","nonce":4291398037}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":15}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-12-05T03:50:44.549123+0000","modified":"2019-12-05T03:50:52.631965+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5095},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5095":{"gid":5095,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":2,"addr":"172.21.15.158:6833/2078196109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":2078196109},{"type":"v1","addr":"172.21.15.158:6833","nonce":2078196109}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2019-12-05T03:51:01.887 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.880+0000 7fa1be5dc700 1 -- 172.21.15.158:0/950517669 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa19803ac80 msgr2=0x7fa19803d190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:01.887 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.880+0000 7fa1be5dc700 1 --2- 172.21.15.158:0/950517669 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa19803ac80 0x7fa19803d190 crc :-1 s=READY pgs=177 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:01.887 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.880+0000 7fa1be5dc700 1 -- 172.21.15.158:0/950517669 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1b812f9b0 msgr2=0x7fa1b8130200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:01.887 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.880+0000 7fa1be5dc700 1 --2- 172.21.15.158:0/950517669 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1b812f9b0 0x7fa1b8130200 secure :-1 s=READY pgs=390 cs=0 l=1 rx=0x7fa1a8003070 tx=0x7fa1a8010ba0).stop 2019-12-05T03:51:01.887 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.880+0000 7fa1be5dc700 1 -- 172.21.15.158:0/950517669 shutdown_connections 2019-12-05T03:51:01.887 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.880+0000 7fa1be5dc700 1 --2- 172.21.15.158:0/950517669 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7fa19803ac80 0x7fa19803d190 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:01.887 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.880+0000 7fa1be5dc700 1 --2- 172.21.15.158:0/950517669 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7fa1b812f9b0 0x7fa1b8130200 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:01.888 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.880+0000 7fa1be5dc700 1 --2- 172.21.15.158:0/950517669 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7fa1b8154250 0x7fa1b8151230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:01.888 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.880+0000 7fa1be5dc700 1 -- 172.21.15.158:0/950517669 shutdown_connections 2019-12-05T03:51:01.888 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.880+0000 7fa1be5dc700 1 -- 172.21.15.158:0/950517669 wait complete. 2019-12-05T03:51:01.888 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:01.880+0000 7fa1be5dc700 1 -- 172.21.15.158:0/950517669 >> 172.21.15.158:0/950517669 conn(0x7fa1b805a740 msgr2=0x7fa1b80ac2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:51:02.102 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 5095}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 4, u'failed': [], u'epoch': 16, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [5, 6], u'info': {u'gid_5095': {u'export_targets': [], u'name': u'a', u'incarnation': 13, u'state_seq': 2, u'state': u'up:active', u'gid': 5095, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 2078196109, u'type': u'v2', u'addr': u'172.21.15.158:6832'}, {u'nonce': 2078196109, u'type': u'v1', u'addr': u'172.21.15.158:6833'}]}, u'addr': u'172.21.15.158:6833/2078196109'}}, u'fs_name': u'cephfs', u'created': u'2019-12-05T03:50:44.549123+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-12-05T03:50:52.631965+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-12-05T03:51:02.103 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-12-05T03:51:02.103 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2019-12-05T03:51:02.196 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2019-12-05T03:51:02.196 INFO:teuthology.orchestra.run.smithi158.stdout: "cluster_fsid": "a91186ae-f496-4de1-918d-820c55ff1feb", 2019-12-05T03:51:02.196 INFO:teuthology.orchestra.run.smithi158.stdout: "whoami": 0, 2019-12-05T03:51:02.196 INFO:teuthology.orchestra.run.smithi158.stdout: "id": 5095, 2019-12-05T03:51:02.197 INFO:teuthology.orchestra.run.smithi158.stdout: "want_state": "up:active", 2019-12-05T03:51:02.197 INFO:teuthology.orchestra.run.smithi158.stdout: "state": "up:active", 2019-12-05T03:51:02.197 INFO:teuthology.orchestra.run.smithi158.stdout: "rank_uptime": 14.931411381, 2019-12-05T03:51:02.197 INFO:teuthology.orchestra.run.smithi158.stdout: "mdsmap_epoch": 16, 2019-12-05T03:51:02.197 INFO:teuthology.orchestra.run.smithi158.stdout: "osdmap_epoch": 36, 2019-12-05T03:51:02.197 INFO:teuthology.orchestra.run.smithi158.stdout: "osdmap_epoch_barrier": 33, 2019-12-05T03:51:02.197 INFO:teuthology.orchestra.run.smithi158.stdout: "uptime": 15.214900695000001 2019-12-05T03:51:02.198 INFO:teuthology.orchestra.run.smithi158.stdout:} 2019-12-05T03:51:02.202 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "a91186ae-f496-4de1-918d-820c55ff1feb", "whoami": 0, "id": 5095, "want_state": "up:active", "state": "up:active", "rank_uptime": 14.931411381, "mdsmap_epoch": 16, "osdmap_epoch": 36, "osdmap_epoch_barrier": 33, "uptime": 15.214900695000001 } 2019-12-05T03:51:02.203 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2019-12-05T03:51:02.203 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2019-12-05T03:51:02.203 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi158.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2019-12-05T03:51:02.203 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:51:02.203 INFO:teuthology.orchestra.run.smithi158:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-12-05T03:51:02.211 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:51:02.211 INFO:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2019-12-05T03:51:02.292 DEBUG:teuthology.orchestra.run:got remote process result: 32 2019-12-05T03:51:02.295 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2019-12-05T03:51:02.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:51:02.295 INFO:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2019-12-05T03:51:02.371 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2019-12-05T03:51:02.371 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0 2019-12-05T03:51:02.438 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:51:02.438 INFO:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2019-12-05T03:51:02.454 DEBUG:teuthology.orchestra.run:got remote process result: 32 2019-12-05T03:51:02.458 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2019-12-05T03:51:02.458 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:51:02.459 INFO:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2019-12-05T03:51:02.495 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi158.stderr:2019-12-05T03:51:02.488+0000 7faf98334f40 -1 init, newargv = 0x55ce5d0760c0 newargc=7ceph-fuse[ 2019-12-05T03:51:02.496 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi158.stderr:16892]: starting ceph client 2019-12-05T03:51:02.505 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi158.stderr:ceph-fuse[16892]: starting fuse 2019-12-05T03:51:02.531 INFO:teuthology.orchestra.run.smithi158.stdout:49 2019-12-05T03:51:02.532 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2019-12-05T03:51:02.532 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:51:02.533 INFO:teuthology.orchestra.run.smithi158:> sudo python2 -c ' 2019-12-05T03:51:02.533 INFO:teuthology.orchestra.run.smithi158:> import glob 2019-12-05T03:51:02.533 INFO:teuthology.orchestra.run.smithi158:> import re 2019-12-05T03:51:02.533 INFO:teuthology.orchestra.run.smithi158:> import os 2019-12-05T03:51:02.533 INFO:teuthology.orchestra.run.smithi158:> import subprocess 2019-12-05T03:51:02.534 INFO:teuthology.orchestra.run.smithi158:> 2019-12-05T03:51:02.534 INFO:teuthology.orchestra.run.smithi158:> def find_socket(client_name): 2019-12-05T03:51:02.534 INFO:teuthology.orchestra.run.smithi158:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2019-12-05T03:51:02.534 INFO:teuthology.orchestra.run.smithi158:> files = glob.glob(asok_path) 2019-12-05T03:51:02.534 INFO:teuthology.orchestra.run.smithi158:> 2019-12-05T03:51:02.535 INFO:teuthology.orchestra.run.smithi158:> # Given a non-glob path, it better be there 2019-12-05T03:51:02.535 INFO:teuthology.orchestra.run.smithi158:> if "*" not in asok_path: 2019-12-05T03:51:02.535 INFO:teuthology.orchestra.run.smithi158:> assert(len(files) == 1) 2019-12-05T03:51:02.535 INFO:teuthology.orchestra.run.smithi158:> return files[0] 2019-12-05T03:51:02.535 INFO:teuthology.orchestra.run.smithi158:> 2019-12-05T03:51:02.536 INFO:teuthology.orchestra.run.smithi158:> for f in files: 2019-12-05T03:51:02.536 INFO:teuthology.orchestra.run.smithi158:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2019-12-05T03:51:02.536 INFO:teuthology.orchestra.run.smithi158:> if os.path.exists("/proc/{0}".format(pid)): 2019-12-05T03:51:02.536 INFO:teuthology.orchestra.run.smithi158:> return f 2019-12-05T03:51:02.536 INFO:teuthology.orchestra.run.smithi158:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2019-12-05T03:51:02.537 INFO:teuthology.orchestra.run.smithi158:> 2019-12-05T03:51:02.537 INFO:teuthology.orchestra.run.smithi158:> print(find_socket("client.0")) 2019-12-05T03:51:02.537 INFO:teuthology.orchestra.run.smithi158:> ' 2019-12-05T03:51:02.640 INFO:teuthology.orchestra.run.smithi158.stdout:/var/run/ceph/ceph-client.0.16892.asok 2019-12-05T03:51:02.640 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.16892.asok 2019-12-05T03:51:02.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:51:02.641 INFO:teuthology.orchestra.run.smithi158:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.16892.asok status 2019-12-05T03:51:02.826 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2019-12-05T03:51:02.826 INFO:teuthology.orchestra.run.smithi158.stdout: "metadata": { 2019-12-05T03:51:02.826 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_sha1": "c5290805033483ba0cec165c06bde07dae5f19ec", 2019-12-05T03:51:02.826 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_version": "ceph version 15.0.0-8014-gc529080 (c5290805033483ba0cec165c06bde07dae5f19ec) octopus (dev)", 2019-12-05T03:51:02.827 INFO:teuthology.orchestra.run.smithi158.stdout: "entity_id": "0", 2019-12-05T03:51:02.827 INFO:teuthology.orchestra.run.smithi158.stdout: "hostname": "smithi158", 2019-12-05T03:51:02.827 INFO:teuthology.orchestra.run.smithi158.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2019-12-05T03:51:02.827 INFO:teuthology.orchestra.run.smithi158.stdout: "pid": "16892", 2019-12-05T03:51:02.827 INFO:teuthology.orchestra.run.smithi158.stdout: "root": "/" 2019-12-05T03:51:02.827 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:51:02.827 INFO:teuthology.orchestra.run.smithi158.stdout: "dentry_count": 0, 2019-12-05T03:51:02.828 INFO:teuthology.orchestra.run.smithi158.stdout: "dentry_pinned_count": 0, 2019-12-05T03:51:02.828 INFO:teuthology.orchestra.run.smithi158.stdout: "id": 5260, 2019-12-05T03:51:02.828 INFO:teuthology.orchestra.run.smithi158.stdout: "inst": { 2019-12-05T03:51:02.828 INFO:teuthology.orchestra.run.smithi158.stdout: "name": { 2019-12-05T03:51:02.828 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "client", 2019-12-05T03:51:02.828 INFO:teuthology.orchestra.run.smithi158.stdout: "num": 5260 2019-12-05T03:51:02.828 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:51:02.829 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": { 2019-12-05T03:51:02.829 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:51:02.829 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:0", 2019-12-05T03:51:02.829 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 850239922 2019-12-05T03:51:02.829 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:51:02.829 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:51:02.829 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": { 2019-12-05T03:51:02.830 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:51:02.830 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:0", 2019-12-05T03:51:02.830 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 850239922 2019-12-05T03:51:02.830 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:51:02.830 INFO:teuthology.orchestra.run.smithi158.stdout: "inst_str": "client.5260 172.21.15.158:0/850239922", 2019-12-05T03:51:02.830 INFO:teuthology.orchestra.run.smithi158.stdout: "addr_str": "172.21.15.158:0/850239922", 2019-12-05T03:51:02.830 INFO:teuthology.orchestra.run.smithi158.stdout: "inode_count": 1, 2019-12-05T03:51:02.831 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_epoch": 16, 2019-12-05T03:51:02.831 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_epoch": 36, 2019-12-05T03:51:02.831 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_epoch_barrier": 0, 2019-12-05T03:51:02.831 INFO:teuthology.orchestra.run.smithi158.stdout: "blacklisted": false 2019-12-05T03:51:02.831 INFO:teuthology.orchestra.run.smithi158.stdout:} 2019-12-05T03:51:02.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:51:02.832 INFO:teuthology.orchestra.run.smithi158:> stat --file-system '--printf=%T 2019-12-05T03:51:02.832 INFO:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.0 2019-12-05T03:51:02.845 INFO:teuthology.orchestra.run.smithi158.stdout:fuseblk 2019-12-05T03:51:02.845 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2019-12-05T03:51:02.845 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:51:02.846 INFO:teuthology.orchestra.run.smithi158:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2019-12-05T03:51:02.933 INFO:teuthology.orchestra.run.smithi158:> cd /home/ubuntu/cephtest/mnt.0 && sudo setfattr -n ceph.file.layout.pool -v data_new layoutfile 2019-12-05T03:51:03.031 INFO:teuthology.orchestra.run.smithi158.stderr:setfattr: layoutfile: Permission denied 2019-12-05T03:51:03.032 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-05T03:51:03.033 INFO:teuthology.orchestra.run.smithi158:> cd /home/ubuntu/cephtest/mnt.0 && sudo setfattr -n ceph.dir.layout.pool -v data_new layoutdir 2019-12-05T03:51:03.118 INFO:teuthology.orchestra.run.smithi158.stderr:setfattr: layoutdir: Permission denied 2019-12-05T03:51:03.119 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-05T03:51:03.120 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:51:03.120 INFO:teuthology.orchestra.run.smithi158:> stat --file-system '--printf=%T 2019-12-05T03:51:03.120 INFO:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.0 2019-12-05T03:51:03.195 INFO:teuthology.orchestra.run.smithi158.stdout:fuseblk 2019-12-05T03:51:03.196 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2019-12-05T03:51:03.196 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi158.front.sepia.ceph.com... 2019-12-05T03:51:03.196 INFO:teuthology.orchestra.run:Running command with timeout 1800 2019-12-05T03:51:03.196 INFO:teuthology.orchestra.run.smithi158:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2019-12-05T03:51:03.293 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi158.stderr:ceph-fuse[16892]: fuse finished with error 0 and tester_r 0 2019-12-05T03:51:03.296 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:51:03.296 INFO:teuthology.orchestra.run.smithi158:> stat --file-system '--printf=%T 2019-12-05T03:51:03.296 INFO:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.0 2019-12-05T03:51:03.374 INFO:teuthology.orchestra.run.smithi158.stdout:ext2/ext3 2019-12-05T03:51:03.374 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2019-12-05T03:51:03.374 INFO:teuthology.orchestra.run:waiting for 900 2019-12-05T03:51:09.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2019-12-05T03:51:09.477 INFO:teuthology.orchestra.run.smithi158:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-12-05T03:51:09.487 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds 'allow rwp' mon 'allow r' osd 'allow rw pool=cephfs_data,allow rw pool=data_new' 2019-12-05T03:51:09.666 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.656+0000 7f98ccca1700 1 Processor -- start 2019-12-05T03:51:09.667 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.656+0000 7f98ccca1700 1 -- start start 2019-12-05T03:51:09.667 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.656+0000 7f98ccca1700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f98c8096910 0x7f98c8099140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:51:09.667 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.656+0000 7f98ccca1700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f98c80b34a0 0x7f98c80b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:51:09.667 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.656+0000 7f98ccca1700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f98c81550d0 0x7f98c8155500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:51:09.667 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.656+0000 7f98ccca1700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98c8097fb0 con 0x7f98c8096910 2019-12-05T03:51:09.667 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.656+0000 7f98ccca1700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98c8098250 con 0x7f98c80b34a0 2019-12-05T03:51:09.667 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.656+0000 7f98ccca1700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c80984f0 con 0x7f98c81550d0 2019-12-05T03:51:09.668 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.656+0000 7f98c659c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f98c80b34a0 0x7f98c80b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:09.668 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.656+0000 7f98c659c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f98c80b34a0 0x7f98c80b38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:55318/0 (socket says 172.21.15.158:55318) 2019-12-05T03:51:09.668 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.656+0000 7f98c659c700 1 -- 172.21.15.158:0/160125371 learned_addr learned my addr 172.21.15.158:0/160125371 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:51:09.668 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.656+0000 7f98c759e700 1 --2- 172.21.15.158:0/160125371 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f98c81550d0 0x7f98c8155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:09.668 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.656+0000 7f98c6d9d700 1 --2- 172.21.15.158:0/160125371 >> v2:172.21.15.96:3300/0 conn(0x7f98c8096910 0x7f98c8099140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:09.668 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.656+0000 7f98c659c700 1 -- 172.21.15.158:0/160125371 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f98c81550d0 msgr2=0x7f98c8155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:51:09.668 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.656+0000 7f98c659c700 1 --2- 172.21.15.158:0/160125371 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f98c81550d0 0x7f98c8155500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:51:09.669 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.656+0000 7f98c659c700 1 -- 172.21.15.158:0/160125371 >> v2:172.21.15.96:3300/0 conn(0x7f98c8096910 msgr2=0x7f98c8099140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:51:09.669 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.656+0000 7f98c659c700 1 --2- 172.21.15.158:0/160125371 >> v2:172.21.15.96:3300/0 conn(0x7f98c8096910 0x7f98c8099140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:51:09.669 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.656+0000 7f98c659c700 1 -- 172.21.15.158:0/160125371 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c807e8c0 con 0x7f98c80b34a0 2019-12-05T03:51:09.669 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.656+0000 7f98c759e700 1 --2- 172.21.15.158:0/160125371 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f98c81550d0 0x7f98c8155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-12-05T03:51:09.669 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.656+0000 7f98c6d9d700 1 --2- 172.21.15.158:0/160125371 >> v2:172.21.15.96:3300/0 conn(0x7f98c8096910 0x7f98c8099140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-12-05T03:51:09.669 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.656+0000 7f98c659c700 1 --2- 172.21.15.158:0/160125371 >> v2:172.21.15.158:3300/0 conn(0x7f98c80b34a0 0x7f98c80b38d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f98b8002f30 tx=0x7f98b800fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:09.669 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.656+0000 7f98c659c700 1 --2- 172.21.15.158:0/160125371 >> v2:172.21.15.158:3300/0 conn(0x7f98c80b34a0 0x7f98c80b38d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f98b8002f30 tx=0x7f98b800fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:09.670 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.656+0000 7f98c659c700 1 --2- 172.21.15.158:0/160125371 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98c80b34a0 0x7f98c80b38d0 secure :-1 s=READY pgs=395 cs=0 l=1 rx=0x7f98b8002f30 tx=0x7f98b800fdb0).ready entity=mon.1 client_cookie=145d7ec53ae60c22 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:51:09.670 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.656+0000 7f98c659c700 1 --2- 172.21.15.158:0/160125371 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98c80b34a0 0x7f98c80b38d0 secure :-1 s=THROTTLE_DONE pgs=395 cs=0 l=1 rx=0x7f98b8002f30 tx=0x7f98b800fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:09.670 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.656+0000 7f98c5d9b700 1 -- 172.21.15.158:0/160125371 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98b80113f0 con 0x7f98c80b34a0 2019-12-05T03:51:09.670 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.656+0000 7f98c659c700 1 --2- 172.21.15.158:0/160125371 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98c80b34a0 0x7f98c80b38d0 secure :-1 s=THROTTLE_DONE pgs=395 cs=0 l=1 rx=0x7f98b8002f30 tx=0x7f98b800fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:09.670 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.656+0000 7f98c659c700 1 --2- 172.21.15.158:0/160125371 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98c80b34a0 0x7f98c80b38d0 secure :-1 s=THROTTLE_DONE pgs=395 cs=0 l=1 rx=0x7f98b8002f30 tx=0x7f98b800fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:09.670 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.656+0000 7f98c5d9b700 1 -- 172.21.15.158:0/160125371 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b8008bb0 con 0x7f98c80b34a0 2019-12-05T03:51:09.670 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.656+0000 7f98c5d9b700 1 -- 172.21.15.158:0/160125371 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98b80119d0 con 0x7f98c80b34a0 2019-12-05T03:51:09.671 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.656+0000 7f98ccca1700 1 -- 172.21.15.158:0/160125371 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98c80b34a0 msgr2=0x7f98c80b38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:09.671 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.656+0000 7f98ccca1700 1 --2- 172.21.15.158:0/160125371 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98c80b34a0 0x7f98c80b38d0 secure :-1 s=READY pgs=395 cs=0 l=1 rx=0x7f98b8002f30 tx=0x7f98b800fdb0).stop 2019-12-05T03:51:09.671 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.660+0000 7f98ccca1700 1 -- 172.21.15.158:0/160125371 shutdown_connections 2019-12-05T03:51:09.671 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.660+0000 7f98ccca1700 1 --2- 172.21.15.158:0/160125371 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f98c81550d0 0x7f98c8155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:51:09.671 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.660+0000 7f98ccca1700 1 --2- 172.21.15.158:0/160125371 >> v2:172.21.15.96:3300/0 conn(0x7f98c8096910 0x7f98c8099140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:51:09.671 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.660+0000 7f98ccca1700 1 --2- 172.21.15.158:0/160125371 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f98c80b34a0 0x7f98c80b38d0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:09.671 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.660+0000 7f98ccca1700 1 -- 172.21.15.158:0/160125371 shutdown_connections 2019-12-05T03:51:09.672 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.660+0000 7f98ccca1700 1 -- 172.21.15.158:0/160125371 wait complete. 2019-12-05T03:51:09.672 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.660+0000 7f98ccca1700 1 -- 172.21.15.158:0/160125371 >> 172.21.15.158:0/160125371 conn(0x7f98c805d8a0 msgr2=0x7f98c805dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:51:09.674 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.660+0000 7f98ccca1700 1 Processor -- start 2019-12-05T03:51:09.675 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.660+0000 7f98ccca1700 1 -- start start 2019-12-05T03:51:09.675 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.660+0000 7f98ccca1700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f98c8140740 0x7f98c8154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:09.675 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.660+0000 7f98ccca1700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f98c813ca50 0x7f98c813ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:09.675 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.660+0000 7f98ccca1700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c8151d80 con 0x7f98c809c970 2019-12-05T03:51:09.675 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.660+0000 7f98ccca1700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98c813c560 con 0x7f98c813ca50 2019-12-05T03:51:09.675 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.660+0000 7f98ccca1700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c8152050 con 0x7f98c8140740 2019-12-05T03:51:09.676 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.660+0000 7f98c659c700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f98c8140740 0x7f98c8154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:09.676 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.660+0000 7f98c659c700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f98c8140740 0x7f98c8154ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.158:38066/0 (socket says 172.21.15.158:38066) 2019-12-05T03:51:09.676 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.660+0000 7f98c659c700 1 -- 172.21.15.158:0/3481703623 learned_addr learned my addr 172.21.15.158:0/3481703623 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:51:09.676 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.660+0000 7f98c759e700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f98c813ca50 0x7f98c813ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:09.676 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.664+0000 7f98c659c700 1 -- 172.21.15.158:0/3481703623 >> v2:172.21.15.96:3300/0 conn(0x7f98c813ca50 msgr2=0x7f98c813ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:09.676 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.664+0000 7f98c659c700 1 --2- 172.21.15.158:0/3481703623 >> v2:172.21.15.96:3300/0 conn(0x7f98c813ca50 0x7f98c813ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:09.676 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.664+0000 7f98c659c700 1 -- 172.21.15.158:0/3481703623 >> v1:172.21.15.96:6789/0 conn(0x7f98c809c970 legacy=0x7f98c813bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:09.677 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.664+0000 7f98c659c700 1 -- 172.21.15.158:0/3481703623 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c809cda0 con 0x7f98c8140740 2019-12-05T03:51:09.677 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.664+0000 7f98c759e700 1 --2- 172.21.15.158:0/3481703623 >> v2:172.21.15.96:3300/0 conn(0x7f98c813ca50 0x7f98c813ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:51:09.677 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.664+0000 7f98c659c700 1 --2- 172.21.15.158:0/3481703623 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f98c8140740 0x7f98c8154ae0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f98b8002f30 tx=0x7f98b8008bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:09.677 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.664+0000 7f98c659c700 1 --2- 172.21.15.158:0/3481703623 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f98c8140740 0x7f98c8154ae0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f98b8002f30 tx=0x7f98b8008bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:09.677 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.664+0000 7f98c659c700 1 --2- 172.21.15.158:0/3481703623 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f98c8140740 0x7f98c8154ae0 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7f98b8002f30 tx=0x7f98b8008bb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:51:09.677 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.664+0000 7f98c659c700 1 --2- 172.21.15.158:0/3481703623 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f98c8140740 0x7f98c8154ae0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f98b8002f30 tx=0x7f98b8008bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:09.677 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.664+0000 7f98c659c700 1 --2- 172.21.15.158:0/3481703623 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f98c8140740 0x7f98c8154ae0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f98b8002f30 tx=0x7f98b8008bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:09.678 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.664+0000 7f98bf7fe700 1 -- 172.21.15.158:0/3481703623 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98b8007340 con 0x7f98c8140740 2019-12-05T03:51:09.678 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.664+0000 7f98c659c700 1 --2- 172.21.15.158:0/3481703623 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f98c8140740 0x7f98c8154ae0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f98b8002f30 tx=0x7f98b8008bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:09.678 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.664+0000 7f98bf7fe700 1 -- 172.21.15.158:0/3481703623 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b80115f0 con 0x7f98c8140740 2019-12-05T03:51:09.678 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.664+0000 7f98ccca1700 1 -- 172.21.15.158:0/3481703623 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98c8155030 con 0x7f98c8140740 2019-12-05T03:51:09.678 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.664+0000 7f98bf7fe700 1 -- 172.21.15.158:0/3481703623 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98b8005540 con 0x7f98c8140740 2019-12-05T03:51:09.678 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.664+0000 7f98ccca1700 1 -- 172.21.15.158:0/3481703623 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98c80b4a20 con 0x7f98c8140740 2019-12-05T03:51:09.678 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.664+0000 7f98c659c700 1 --2- 172.21.15.158:0/3481703623 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f98c8140740 0x7f98c8154ae0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f98b8002f30 tx=0x7f98b8008bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:09.678 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.664+0000 7f98bf7fe700 1 -- 172.21.15.158:0/3481703623 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f98b8005850 con 0x7f98c8140740 2019-12-05T03:51:09.679 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.664+0000 7f98c659c700 1 --2- 172.21.15.158:0/3481703623 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f98c8140740 0x7f98c8154ae0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f98b8002f30 tx=0x7f98b8008bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:09.679 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.664+0000 7f98bf7fe700 1 --2- 172.21.15.158:0/3481703623 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f98ac03ae00 0x7f98ac03d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:09.679 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.664+0000 7f98bf7fe700 1 -- 172.21.15.158:0/3481703623 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6399+0+0 (secure 0 0 0) 0x7f98b808f650 con 0x7f98c8140740 2019-12-05T03:51:09.679 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.668+0000 7f98c6d9d700 1 --2- 172.21.15.158:0/3481703623 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f98ac03ae00 0x7f98ac03d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:09.679 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.668+0000 7f98c6d9d700 1 --2- 172.21.15.158:0/3481703623 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f98ac03ae00 0x7f98ac03d310 crc :-1 s=READY pgs=178 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:51:09.680 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.672+0000 7f98ccca1700 1 -- 172.21.15.158:0/3481703623 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98c8152380 con 0x7f98c8140740 2019-12-05T03:51:09.687 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.680+0000 7f98c659c700 1 --2- 172.21.15.158:0/3481703623 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f98c8140740 0x7f98c8154ae0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f98b8002f30 tx=0x7f98b8008bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:09.687 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.680+0000 7f98bf7fe700 1 -- 172.21.15.158:0/3481703623 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f98b80766d0 con 0x7f98c8140740 2019-12-05T03:51:09.856 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.848+0000 7f98ccca1700 1 -- 172.21.15.158:0/3481703623 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rwp", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]} v 0) v1 -- 0x7f98c80554e0 con 0x7f98c8140740 2019-12-05T03:51:09.865 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.860+0000 7f98c659c700 1 --2- 172.21.15.158:0/3481703623 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f98c8140740 0x7f98c8154ae0 secure :-1 s=THROTTLE_DONE pgs=84 cs=0 l=1 rx=0x7f98b8002f30 tx=0x7f98b8008bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:09.865 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.860+0000 7f98bf7fe700 1 -- 172.21.15.158:0/3481703623 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rwp", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]}]=0 updated caps for client.0 v18) v1 ==== 211+0+0 (secure 0 0 0) 0x7f98b8076930 con 0x7f98c8140740 2019-12-05T03:51:09.871 INFO:teuthology.orchestra.run.smithi158.stderr:updated caps for client.0 2019-12-05T03:51:09.875 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.868+0000 7f98ccca1700 1 -- 172.21.15.158:0/3481703623 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f98ac03ae00 msgr2=0x7f98ac03d310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:09.875 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.868+0000 7f98ccca1700 1 --2- 172.21.15.158:0/3481703623 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f98ac03ae00 0x7f98ac03d310 crc :-1 s=READY pgs=178 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:09.876 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.868+0000 7f98ccca1700 1 -- 172.21.15.158:0/3481703623 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f98c8140740 msgr2=0x7f98c8154ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:09.876 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.868+0000 7f98ccca1700 1 --2- 172.21.15.158:0/3481703623 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f98c8140740 0x7f98c8154ae0 secure :-1 s=READY pgs=84 cs=0 l=1 rx=0x7f98b8002f30 tx=0x7f98b8008bb0).stop 2019-12-05T03:51:09.876 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.868+0000 7f98ccca1700 1 -- 172.21.15.158:0/3481703623 shutdown_connections 2019-12-05T03:51:09.876 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.868+0000 7f98ccca1700 1 --2- 172.21.15.158:0/3481703623 >> v2:172.21.15.96:3300/0 conn(0x7f98c813ca50 0x7f98c813ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:09.876 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.868+0000 7f98ccca1700 1 --2- 172.21.15.158:0/3481703623 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f98ac03ae00 0x7f98ac03d310 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:09.877 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.868+0000 7f98ccca1700 1 --2- 172.21.15.158:0/3481703623 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f98c8140740 0x7f98c8154ae0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:09.877 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.868+0000 7f98ccca1700 1 -- 172.21.15.158:0/3481703623 shutdown_connections 2019-12-05T03:51:09.877 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.868+0000 7f98ccca1700 1 -- 172.21.15.158:0/3481703623 wait complete. 2019-12-05T03:51:09.877 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.868+0000 7f98ccca1700 1 -- 172.21.15.158:0/3481703623 >> 172.21.15.158:0/3481703623 conn(0x7f98c812fc20 msgr2=0x7f98c812f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:51:09.887 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-05T03:51:09.987 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.976+0000 7f90bef9c700 1 Processor -- start 2019-12-05T03:51:09.987 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.976+0000 7f90bef9c700 1 -- start start 2019-12-05T03:51:09.987 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.976+0000 7f90bef9c700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f90b809cf60 0x7f90b809a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:51:09.987 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.976+0000 7f90bef9c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f90b81553b0 0x7f90b81557e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:51:09.988 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.976+0000 7f90bef9c700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90b80accb0 con 0x7f90b805a740 2019-12-05T03:51:09.988 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.976+0000 7f90bef9c700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90b80b1730 con 0x7f90b809cf60 2019-12-05T03:51:09.988 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.976+0000 7f90bef9c700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90b80b19d0 con 0x7f90b81553b0 2019-12-05T03:51:09.988 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.976+0000 7f90bdd3a700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f90b81553b0 0x7f90b81557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:09.988 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.976+0000 7f90bcd38700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f90b805a740 0x7f90b8151460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:50112/0 (socket says 172.21.15.158:50112) 2019-12-05T03:51:09.989 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.976+0000 7f90bdd3a700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f90b81553b0 0x7f90b81557e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:55334/0 (socket says 172.21.15.158:55334) 2019-12-05T03:51:09.989 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.976+0000 7f90bcd38700 1 -- 172.21.15.158:0/721383592 learned_addr learned my addr 172.21.15.158:0/721383592 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:51:09.989 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.976+0000 7f90bd539700 1 --2- 172.21.15.158:0/721383592 >> v2:172.21.15.96:3300/0 conn(0x7f90b809cf60 0x7f90b809a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:09.989 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.976+0000 7f90bdd3a700 1 -- 172.21.15.158:0/721383592 >> v2:172.21.15.96:3300/0 conn(0x7f90b809cf60 msgr2=0x7f90b809a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:51:09.989 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.976+0000 7f90bdd3a700 1 --2- 172.21.15.158:0/721383592 >> v2:172.21.15.96:3300/0 conn(0x7f90b809cf60 0x7f90b809a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:51:09.989 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.976+0000 7f90bdd3a700 1 -- 172.21.15.158:0/721383592 >> v1:172.21.15.158:6789/0 conn(0x7f90b805a740 legacy=0x7f90b8151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:09.989 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.976+0000 7f90affff700 1 -- 172.21.15.158:0/721383592 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 315167543 0 0) 0x7f90b80accb0 con 0x7f90b805a740 2019-12-05T03:51:09.990 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.976+0000 7f90bdd3a700 1 -- 172.21.15.158:0/721383592 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b805ab70 con 0x7f90b81553b0 2019-12-05T03:51:09.990 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.976+0000 7f90bdd3a700 1 --2- 172.21.15.158:0/721383592 >> v2:172.21.15.158:3300/0 conn(0x7f90b81553b0 0x7f90b81557e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f90a8008790 tx=0x7f90a800fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:09.990 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.976+0000 7f90bdd3a700 1 --2- 172.21.15.158:0/721383592 >> v2:172.21.15.158:3300/0 conn(0x7f90b81553b0 0x7f90b81557e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f90a8008790 tx=0x7f90a800fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:09.990 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.976+0000 7f90bdd3a700 1 --2- 172.21.15.158:0/721383592 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f90b81553b0 0x7f90b81557e0 secure :-1 s=READY pgs=397 cs=0 l=1 rx=0x7f90a8008790 tx=0x7f90a800fc70).ready entity=mon.1 client_cookie=aeaa8326be695cfb server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:51:09.990 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.976+0000 7f90bdd3a700 1 --2- 172.21.15.158:0/721383592 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f90b81553b0 0x7f90b81557e0 secure :-1 s=THROTTLE_DONE pgs=397 cs=0 l=1 rx=0x7f90a8008790 tx=0x7f90a800fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:09.990 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.976+0000 7f90affff700 1 -- 172.21.15.158:0/721383592 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90a8008bb0 con 0x7f90b81553b0 2019-12-05T03:51:09.990 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.976+0000 7f90bdd3a700 1 --2- 172.21.15.158:0/721383592 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f90b81553b0 0x7f90b81557e0 secure :-1 s=THROTTLE_DONE pgs=397 cs=0 l=1 rx=0x7f90a8008790 tx=0x7f90a800fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:09.991 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.976+0000 7f90affff700 1 -- 172.21.15.158:0/721383592 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a80087d0 con 0x7f90b81553b0 2019-12-05T03:51:09.991 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.976+0000 7f90bdd3a700 1 --2- 172.21.15.158:0/721383592 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f90b81553b0 0x7f90b81557e0 secure :-1 s=THROTTLE_DONE pgs=397 cs=0 l=1 rx=0x7f90a8008790 tx=0x7f90a800fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:09.991 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.976+0000 7f90bef9c700 1 -- 172.21.15.158:0/721383592 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f90b81553b0 msgr2=0x7f90b81557e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:09.991 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.976+0000 7f90bef9c700 1 --2- 172.21.15.158:0/721383592 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f90b81553b0 0x7f90b81557e0 secure :-1 s=READY pgs=397 cs=0 l=1 rx=0x7f90a8008790 tx=0x7f90a800fc70).stop 2019-12-05T03:51:09.991 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.976+0000 7f90affff700 1 -- 172.21.15.158:0/721383592 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90a8011820 con 0x7f90b81553b0 2019-12-05T03:51:09.991 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.980+0000 7f90bef9c700 1 -- 172.21.15.158:0/721383592 shutdown_connections 2019-12-05T03:51:09.992 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.980+0000 7f90bef9c700 1 --2- 172.21.15.158:0/721383592 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f90b81553b0 0x7f90b81557e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:09.992 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.980+0000 7f90bef9c700 1 --2- 172.21.15.158:0/721383592 >> v2:172.21.15.96:3300/0 conn(0x7f90b809cf60 0x7f90b809a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:51:09.992 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.980+0000 7f90bef9c700 1 -- 172.21.15.158:0/721383592 shutdown_connections 2019-12-05T03:51:09.992 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.980+0000 7f90bef9c700 1 -- 172.21.15.158:0/721383592 wait complete. 2019-12-05T03:51:09.992 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.980+0000 7f90bef9c700 1 -- 172.21.15.158:0/721383592 >> 172.21.15.158:0/721383592 conn(0x7f90b80b7e60 msgr2=0x7f90b80b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:51:09.992 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.980+0000 7f90bef9c700 1 Processor -- start 2019-12-05T03:51:09.992 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.980+0000 7f90bef9c700 1 -- start start 2019-12-05T03:51:09.995 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.980+0000 7f90bef9c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f90b80ad240 0x7f90b807c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:09.995 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.980+0000 7f90bef9c700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f90b80b0990 0x7f90b80b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:09.995 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.980+0000 7f90bef9c700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90b813a350 con 0x7f90b813cf60 2019-12-05T03:51:09.996 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.980+0000 7f90bef9c700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90b813a650 con 0x7f90b80b0990 2019-12-05T03:51:09.996 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.980+0000 7f90bef9c700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90b813a8f0 con 0x7f90b80ad240 2019-12-05T03:51:09.996 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.980+0000 7f90bd539700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f90b80ad240 0x7f90b807c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:09.996 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.980+0000 7f90bd539700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f90b80ad240 0x7f90b807c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:55336/0 (socket says 172.21.15.158:55336) 2019-12-05T03:51:09.996 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.980+0000 7f90bd539700 1 -- 172.21.15.158:0/3514359580 learned_addr learned my addr 172.21.15.158:0/3514359580 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:51:09.996 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.980+0000 7f90bcd38700 1 --2- 172.21.15.158:0/3514359580 >> v2:172.21.15.96:3300/0 conn(0x7f90b80b0990 0x7f90b80b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:09.996 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.984+0000 7f90bd539700 1 -- 172.21.15.158:0/3514359580 >> v2:172.21.15.96:3300/0 conn(0x7f90b80b0990 msgr2=0x7f90b80b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:09.997 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.984+0000 7f90bd539700 1 --2- 172.21.15.158:0/3514359580 >> v2:172.21.15.96:3300/0 conn(0x7f90b80b0990 0x7f90b80b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:09.997 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.984+0000 7f90bd539700 1 -- 172.21.15.158:0/3514359580 >> v1:172.21.15.96:6789/0 conn(0x7f90b813cf60 legacy=0x7f90b813d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:09.997 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.984+0000 7f90bd539700 1 -- 172.21.15.158:0/3514359580 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b80adbf0 con 0x7f90b80ad240 2019-12-05T03:51:09.997 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.984+0000 7f90bd539700 1 --2- 172.21.15.158:0/3514359580 >> v2:172.21.15.158:3300/0 conn(0x7f90b80ad240 0x7f90b807c450 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f90b4003070 tx=0x7f90b4010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:09.997 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.984+0000 7f90bd539700 1 --2- 172.21.15.158:0/3514359580 >> v2:172.21.15.158:3300/0 conn(0x7f90b80ad240 0x7f90b807c450 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f90b4003070 tx=0x7f90b4010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:09.997 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.984+0000 7f90bd539700 1 --2- 172.21.15.158:0/3514359580 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f90b80ad240 0x7f90b807c450 secure :-1 s=READY pgs=398 cs=0 l=1 rx=0x7f90b4003070 tx=0x7f90b4010c00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:51:09.997 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.984+0000 7f90bd539700 1 --2- 172.21.15.158:0/3514359580 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f90b80ad240 0x7f90b807c450 secure :-1 s=THROTTLE_DONE pgs=398 cs=0 l=1 rx=0x7f90b4003070 tx=0x7f90b4010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:09.998 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.984+0000 7f90adffb700 1 -- 172.21.15.158:0/3514359580 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90b4005840 con 0x7f90b80ad240 2019-12-05T03:51:09.998 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.984+0000 7f90bd539700 1 --2- 172.21.15.158:0/3514359580 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f90b80ad240 0x7f90b807c450 secure :-1 s=THROTTLE_DONE pgs=398 cs=0 l=1 rx=0x7f90b4003070 tx=0x7f90b4010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:09.998 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.984+0000 7f90bd539700 1 --2- 172.21.15.158:0/3514359580 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f90b80ad240 0x7f90b807c450 secure :-1 s=THROTTLE_DONE pgs=398 cs=0 l=1 rx=0x7f90b4003070 tx=0x7f90b4010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:09.998 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.984+0000 7f90adffb700 1 -- 172.21.15.158:0/3514359580 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b4007160 con 0x7f90b80ad240 2019-12-05T03:51:09.998 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.984+0000 7f90bef9c700 1 -- 172.21.15.158:0/3514359580 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90b813db90 con 0x7f90b80ad240 2019-12-05T03:51:09.998 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.984+0000 7f90adffb700 1 -- 172.21.15.158:0/3514359580 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90b40087f0 con 0x7f90b80ad240 2019-12-05T03:51:09.998 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.984+0000 7f90bef9c700 1 -- 172.21.15.158:0/3514359580 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90b81536f0 con 0x7f90b80ad240 2019-12-05T03:51:09.999 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.984+0000 7f90bd539700 1 --2- 172.21.15.158:0/3514359580 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f90b80ad240 0x7f90b807c450 secure :-1 s=THROTTLE_DONE pgs=398 cs=0 l=1 rx=0x7f90b4003070 tx=0x7f90b4010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:09.999 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.984+0000 7f90adffb700 1 -- 172.21.15.158:0/3514359580 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f90b4008b00 con 0x7f90b80ad240 2019-12-05T03:51:09.999 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.984+0000 7f90bd539700 1 --2- 172.21.15.158:0/3514359580 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f90b80ad240 0x7f90b807c450 secure :-1 s=THROTTLE_DONE pgs=398 cs=0 l=1 rx=0x7f90b4003070 tx=0x7f90b4010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:09.999 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.984+0000 7f90adffb700 1 --2- 172.21.15.158:0/3514359580 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f909803adb0 0x7f909803d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:09.999 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.984+0000 7f90adffb700 1 -- 172.21.15.158:0/3514359580 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6399+0+0 (secure 0 0 0) 0x7f90b404b190 con 0x7f90b80ad240 2019-12-05T03:51:09.999 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.984+0000 7f90bcd38700 1 --2- 172.21.15.158:0/3514359580 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f909803adb0 0x7f909803d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:09.999 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.984+0000 7f90bcd38700 1 --2- 172.21.15.158:0/3514359580 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f909803adb0 0x7f909803d2c0 crc :-1 s=READY pgs=179 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:51:10.000 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:09.992+0000 7f90bef9c700 1 -- 172.21.15.158:0/3514359580 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90b80554e0 con 0x7f90b80ad240 2019-12-05T03:51:10.009 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.004+0000 7f90bd539700 1 --2- 172.21.15.158:0/3514359580 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f90b80ad240 0x7f90b807c450 secure :-1 s=THROTTLE_DONE pgs=398 cs=0 l=1 rx=0x7f90b4003070 tx=0x7f90b4010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.009 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.004+0000 7f90adffb700 1 -- 172.21.15.158:0/3514359580 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f90b4032210 con 0x7f90b80ad240 2019-12-05T03:51:10.177 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.172+0000 7f90bef9c700 1 -- 172.21.15.158:0/3514359580 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90b8066940 con 0x7f90b80ad240 2019-12-05T03:51:10.180 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.172+0000 7f90bd539700 1 --2- 172.21.15.158:0/3514359580 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f90b80ad240 0x7f90b807c450 secure :-1 s=THROTTLE_DONE pgs=398 cs=0 l=1 rx=0x7f90b4003070 tx=0x7f90b4010c00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.180 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.172+0000 7f90adffb700 1 -- 172.21.15.158:0/3514359580 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16297 (secure 0 0 0) 0x7f90b4032470 con 0x7f90b80ad240 2019-12-05T03:51:10.181 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:51:10.181 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":36,"fsid":"a91186ae-f496-4de1-918d-820c55ff1feb","created":"2019-12-05T03:49:39.187523+0000","modified":"2019-12-05T03:50:54.950075+0000","last_up_change":"2019-12-05T03:49:48.551934+0000","last_in_change":"2019-12-05T03:49:48.551934+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-05T03:49:52.900870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2019-12-05T03:50:42.436744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2019-12-05T03:50:43.620710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"data_new","create_time":"2019-12-05T03:50:51.740163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"782c4258-e28c-4a11-9d54-3c9c7a36fba6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6800","nonce":12192},{"type":"v1","addr":"172.21.15.158:6801","nonce":12192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6802","nonce":12192},{"type":"v1","addr":"172.21.15.158:6803","nonce":12192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6806","nonce":12192},{"type":"v1","addr":"172.21.15.158:6807","nonce":12192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6804","nonce":12192},{"type":"v1","addr":"172.21.15.158:6805","nonce":12192}]},"public_addr":"172.21.15.158:6801/12192","cluster_addr":"172.21.15.158:6803/12192","heartbeat_back_addr":"172.21.15.158:6807/12192","heartbeat_front_addr":"172.21.15.158:6805/12192","state":["exists","up"]},{"osd":1,"uuid":"d4426b21-b666-4158-bf34-a24b14572731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6808","nonce":12193},{"type":"v1","addr":"172.21.15.158:6809","nonce":12193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6810","nonce":12193},{"type":"v1","addr":"172.21.15.158:6811","nonce":12193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6814","nonce":12193},{"type":"v1","addr":"172.21.15.158:6815","nonce":12193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6812","nonce":12193},{"type":"v1","addr":"172.21.15.158:6813","nonce":12193}]},"public_addr":"172.21.15.158:6809/12193","cluster_addr":"172.21.15.158:6811/12193","heartbeat_back_addr":"172.21.15.158:6815/12193","heartbeat_front_addr":"172.21.15.158:6813/12193","state":["exists","up"]},{"osd":2,"uuid":"22680edd-6490-4ab0-bb15-0605830e4cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6824","nonce":12195},{"type":"v1","addr":"172.21.15.158:6825","nonce":12195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6826","nonce":12195},{"type":"v1","addr":"172.21.15.158:6827","nonce":12195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6830","nonce":12195},{"type":"v1","addr":"172.21.15.158:6831","nonce":12195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6828","nonce":12195},{"type":"v1","addr":"172.21.15.158:6829","nonce":12195}]},"public_addr":"172.21.15.158:6825/12195","cluster_addr":"172.21.15.158:6827/12195","heartbeat_back_addr":"172.21.15.158:6831/12195","heartbeat_front_addr":"172.21.15.158:6829/12195","state":["exists","up"]},{"osd":3,"uuid":"7ec999ee-ace8-4ccb-a4f9-6f5d313bbbd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6816","nonce":12194},{"type":"v1","addr":"172.21.15.158:6817","nonce":12194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6818","nonce":12194},{"type":"v1","addr":"172.21.15.158:6819","nonce":12194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6822","nonce":12194},{"type":"v1","addr":"172.21.15.158:6823","nonce":12194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6820","nonce":12194},{"type":"v1","addr":"172.21.15.158:6821","nonce":12194}]},"public_addr":"172.21.15.158:6817/12194","cluster_addr":"172.21.15.158:6819/12194","heartbeat_back_addr":"172.21.15.158:6823/12194","heartbeat_front_addr":"172.21.15.158:6821/12194","state":["exists","up"]},{"osd":4,"uuid":"186e69c4-b69f-4dd1-bb8f-faf759c60484","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":12460},{"type":"v1","addr":"172.21.15.96:6803","nonce":12460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":12460},{"type":"v1","addr":"172.21.15.96:6805","nonce":12460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":12460},{"type":"v1","addr":"172.21.15.96:6809","nonce":12460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":12460},{"type":"v1","addr":"172.21.15.96:6807","nonce":12460}]},"public_addr":"172.21.15.96:6803/12460","cluster_addr":"172.21.15.96:6805/12460","heartbeat_back_addr":"172.21.15.96:6809/12460","heartbeat_front_addr":"172.21.15.96:6807/12460","state":["exists","up"]},{"osd":5,"uuid":"86b658b2-8b40-4cea-8163-305a3982758b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":12461},{"type":"v1","addr":"172.21.15.96:6811","nonce":12461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":12461},{"type":"v1","addr":"172.21.15.96:6813","nonce":12461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":12461},{"type":"v1","addr":"172.21.15.96:6817","nonce":12461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":12461},{"type":"v1","addr":"172.21.15.96:6815","nonce":12461}]},"public_addr":"172.21.15.96:6811/12461","cluster_addr":"172.21.15.96:6813/12461","heartbeat_back_addr":"172.21.15.96:6817/12461","heartbeat_front_addr":"172.21.15.96:6815/12461","state":["exists","up"]},{"osd":6,"uuid":"bdadaea8-9296-4788-bc59-d9c9eb8defdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":12463},{"type":"v1","addr":"172.21.15.96:6827","nonce":12463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":12463},{"type":"v1","addr":"172.21.15.96:6829","nonce":12463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":12463},{"type":"v1","addr":"172.21.15.96:6833","nonce":12463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":12463},{"type":"v1","addr":"172.21.15.96:6831","nonce":12463}]},"public_addr":"172.21.15.96:6827/12463","cluster_addr":"172.21.15.96:6829/12463","heartbeat_back_addr":"172.21.15.96:6833/12463","heartbeat_front_addr":"172.21.15.96:6831/12463","state":["exists","up"]},{"osd":7,"uuid":"c6d71846-d68e-430f-ab72-0fb8ea4bf640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":12462},{"type":"v1","addr":"172.21.15.96:6819","nonce":12462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":12462},{"type":"v1","addr":"172.21.15.96:6821","nonce":12462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":12462},{"type":"v1","addr":"172.21.15.96:6825","nonce":12462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":12462},{"type":"v1","addr":"172.21.15.96:6823","nonce":12462}]},"public_addr":"172.21.15.96:6819/12462","cluster_addr":"172.21.15.96:6821/12462","heartbeat_back_addr":"172.21.15.96:6825/12462","heartbeat_front_addr":"172.21.15.96:6823/12462","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.875762+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.900817+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.210347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.133973+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:46.864697+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.131015+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.237225+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-05T03:49:47.154377+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-05T03:51:10.183 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.176+0000 7f90bef9c700 1 -- 172.21.15.158:0/3514359580 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f909803adb0 msgr2=0x7f909803d2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:10.184 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.176+0000 7f90bef9c700 1 --2- 172.21.15.158:0/3514359580 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f909803adb0 0x7f909803d2c0 crc :-1 s=READY pgs=179 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:10.184 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.176+0000 7f90bef9c700 1 -- 172.21.15.158:0/3514359580 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f90b80ad240 msgr2=0x7f90b807c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:10.184 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.176+0000 7f90bef9c700 1 --2- 172.21.15.158:0/3514359580 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f90b80ad240 0x7f90b807c450 secure :-1 s=READY pgs=398 cs=0 l=1 rx=0x7f90b4003070 tx=0x7f90b4010c00).stop 2019-12-05T03:51:10.184 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.176+0000 7f90bef9c700 1 -- 172.21.15.158:0/3514359580 shutdown_connections 2019-12-05T03:51:10.184 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.176+0000 7f90bef9c700 1 --2- 172.21.15.158:0/3514359580 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f909803adb0 0x7f909803d2c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:10.184 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.176+0000 7f90bef9c700 1 --2- 172.21.15.158:0/3514359580 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f90b80ad240 0x7f90b807c450 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:10.185 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.176+0000 7f90bef9c700 1 --2- 172.21.15.158:0/3514359580 >> v2:172.21.15.96:3300/0 conn(0x7f90b80b0990 0x7f90b80b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:10.185 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.176+0000 7f90bef9c700 1 -- 172.21.15.158:0/3514359580 shutdown_connections 2019-12-05T03:51:10.185 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.176+0000 7f90bef9c700 1 -- 172.21.15.158:0/3514359580 wait complete. 2019-12-05T03:51:10.185 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.176+0000 7f90bef9c700 1 -- 172.21.15.158:0/3514359580 >> 172.21.15.158:0/3514359580 conn(0x7f90b80acd60 msgr2=0x7f90b80b52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:51:10.195 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:49:52.900870+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:50:42.436744+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 4, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'31', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:50:43.620710+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 5, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'32', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-05T03:50:51.740163+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'data_new', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 6, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'36', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-12-05T03:51:10.195 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-12-05T03:51:10.303 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.292+0000 7f5428d23700 1 Processor -- start 2019-12-05T03:51:10.303 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.292+0000 7f5428d23700 1 -- start start 2019-12-05T03:51:10.303 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.292+0000 7f5428d23700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f542409add0 0x7f54240b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:51:10.303 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.292+0000 7f5428d23700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5424099e30 con 0x7f542409ba40 2019-12-05T03:51:10.303 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.292+0000 7f5428d23700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54240b60c0 con 0x7f54240b6970 2019-12-05T03:51:10.304 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.292+0000 7f5428d23700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f542409d210 con 0x7f542409add0 2019-12-05T03:51:10.304 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.292+0000 7f5422d9d700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f54240b6970 0x7f542405a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:50124/0 (socket says 172.21.15.158:50124) 2019-12-05T03:51:10.304 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.292+0000 7f542359e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f542409add0 0x7f54240b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:10.304 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.292+0000 7f5422d9d700 1 -- 172.21.15.158:0/1605872105 learned_addr learned my addr 172.21.15.158:0/1605872105 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:51:10.304 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.292+0000 7f5421d9b700 1 -- 172.21.15.158:0/1605872105 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 925736666 0 0) 0x7f54240b60c0 con 0x7f54240b6970 2019-12-05T03:51:10.304 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.292+0000 7f5421d9b700 1 -- 172.21.15.158:0/1605872105 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54100030b0 con 0x7f54240b6970 2019-12-05T03:51:10.304 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.292+0000 7f542359e700 1 -- 172.21.15.158:0/1605872105 >> v1:172.21.15.158:6789/0 conn(0x7f54240b6970 legacy=0x7f542405a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:10.305 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.292+0000 7f542359e700 1 -- 172.21.15.158:0/1605872105 >> v1:172.21.15.96:6789/0 conn(0x7f542409ba40 legacy=0x7f54240b5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:10.305 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.292+0000 7f5421d9b700 1 -- 172.21.15.158:0/1605872105 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2460676601 0 0) 0x7f5424099e30 con 0x7f542409ba40 2019-12-05T03:51:10.305 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.292+0000 7f542359e700 1 -- 172.21.15.158:0/1605872105 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542407e960 con 0x7f542409add0 2019-12-05T03:51:10.305 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.292+0000 7f542359e700 1 --2- 172.21.15.158:0/1605872105 >> v2:172.21.15.158:3300/0 conn(0x7f542409add0 0x7f54240b5b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f541c0032b0 tx=0x7f541c00ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.305 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.292+0000 7f542359e700 1 --2- 172.21.15.158:0/1605872105 >> v2:172.21.15.158:3300/0 conn(0x7f542409add0 0x7f54240b5b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f541c0032b0 tx=0x7f541c00ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.305 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.292+0000 7f542359e700 1 --2- 172.21.15.158:0/1605872105 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f542409add0 0x7f54240b5b70 secure :-1 s=READY pgs=400 cs=0 l=1 rx=0x7f541c0032b0 tx=0x7f541c00ff70).ready entity=mon.1 client_cookie=70d3aa0c6d354917 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:51:10.305 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.292+0000 7f542359e700 1 --2- 172.21.15.158:0/1605872105 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f542409add0 0x7f54240b5b70 secure :-1 s=THROTTLE_DONE pgs=400 cs=0 l=1 rx=0x7f541c0032b0 tx=0x7f541c00ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.306 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.292+0000 7f5421d9b700 1 -- 172.21.15.158:0/1605872105 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f541c010930 con 0x7f542409add0 2019-12-05T03:51:10.306 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.292+0000 7f542359e700 1 --2- 172.21.15.158:0/1605872105 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f542409add0 0x7f54240b5b70 secure :-1 s=THROTTLE_DONE pgs=400 cs=0 l=1 rx=0x7f541c0032b0 tx=0x7f541c00ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.306 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.292+0000 7f542359e700 1 --2- 172.21.15.158:0/1605872105 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f542409add0 0x7f54240b5b70 secure :-1 s=THROTTLE_DONE pgs=400 cs=0 l=1 rx=0x7f541c0032b0 tx=0x7f541c00ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.306 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.292+0000 7f5421d9b700 1 -- 172.21.15.158:0/1605872105 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541c008b10 con 0x7f542409add0 2019-12-05T03:51:10.306 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.292+0000 7f5421d9b700 1 -- 172.21.15.158:0/1605872105 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f541c0110c0 con 0x7f542409add0 2019-12-05T03:51:10.306 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.292+0000 7f5428d23700 1 -- 172.21.15.158:0/1605872105 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f542409add0 msgr2=0x7f54240b5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:10.306 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.292+0000 7f5428d23700 1 --2- 172.21.15.158:0/1605872105 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f542409add0 0x7f54240b5b70 secure :-1 s=READY pgs=400 cs=0 l=1 rx=0x7f541c0032b0 tx=0x7f541c00ff70).stop 2019-12-05T03:51:10.307 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.296+0000 7f5428d23700 1 -- 172.21.15.158:0/1605872105 shutdown_connections 2019-12-05T03:51:10.307 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.296+0000 7f5428d23700 1 --2- 172.21.15.158:0/1605872105 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f542409add0 0x7f54240b5b70 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:10.307 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.296+0000 7f5428d23700 1 -- 172.21.15.158:0/1605872105 shutdown_connections 2019-12-05T03:51:10.307 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.296+0000 7f5428d23700 1 -- 172.21.15.158:0/1605872105 wait complete. 2019-12-05T03:51:10.307 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.296+0000 7f5428d23700 1 -- 172.21.15.158:0/1605872105 >> 172.21.15.158:0/1605872105 conn(0x7f54240b7ef0 msgr2=0x7f54240b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:51:10.311 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.296+0000 7f5428d23700 1 Processor -- start 2019-12-05T03:51:10.312 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.296+0000 7f5428d23700 1 -- start start 2019-12-05T03:51:10.312 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.296+0000 7f5428d23700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f542412cd80 0x7f54240b4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:10.312 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.296+0000 7f5428d23700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f542405f690 0x7f542413e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:10.312 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.296+0000 7f5428d23700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5424065320 con 0x7f54240b0c60 2019-12-05T03:51:10.312 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.296+0000 7f5428d23700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54240b1090 con 0x7f542412cd80 2019-12-05T03:51:10.313 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.296+0000 7f5428d23700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54240ad260 con 0x7f542405f690 2019-12-05T03:51:10.313 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.296+0000 7f542259c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f542412cd80 0x7f54240b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:10.313 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.296+0000 7f542259c700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f542412cd80 0x7f54240b4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:55352/0 (socket says 172.21.15.158:55352) 2019-12-05T03:51:10.313 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.296+0000 7f542259c700 1 -- 172.21.15.158:0/1699369500 learned_addr learned my addr 172.21.15.158:0/1699369500 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:51:10.313 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.296+0000 7f542359e700 1 --2- 172.21.15.158:0/1699369500 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f542405f690 0x7f542413e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:10.313 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.300+0000 7f541b7fe700 1 -- 172.21.15.158:0/1699369500 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4189842681 0 0) 0x7f5424065320 con 0x7f54240b0c60 2019-12-05T03:51:10.313 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.300+0000 7f542259c700 1 -- 172.21.15.158:0/1699369500 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f542405f690 msgr2=0x7f542413e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:10.314 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.300+0000 7f542259c700 1 --2- 172.21.15.158:0/1699369500 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f542405f690 0x7f542413e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:10.314 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.300+0000 7f542259c700 1 -- 172.21.15.158:0/1699369500 >> v1:172.21.15.96:6789/0 conn(0x7f54240b0c60 legacy=0x7f542412c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:10.314 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.300+0000 7f542259c700 1 -- 172.21.15.158:0/1699369500 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542405fac0 con 0x7f542412cd80 2019-12-05T03:51:10.314 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.300+0000 7f542359e700 1 --2- 172.21.15.158:0/1699369500 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f542405f690 0x7f542413e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:51:10.314 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.300+0000 7f542259c700 1 --2- 172.21.15.158:0/1699369500 >> v2:172.21.15.158:3300/0 conn(0x7f542412cd80 0x7f54240b4180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f54240b0780 tx=0x7f540c0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.314 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.300+0000 7f542259c700 1 --2- 172.21.15.158:0/1699369500 >> v2:172.21.15.158:3300/0 conn(0x7f542412cd80 0x7f54240b4180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f54240b0780 tx=0x7f540c0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.314 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.300+0000 7f542259c700 1 --2- 172.21.15.158:0/1699369500 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f542412cd80 0x7f54240b4180 secure :-1 s=READY pgs=401 cs=0 l=1 rx=0x7f54240b0780 tx=0x7f540c0109a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:51:10.315 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.300+0000 7f542259c700 1 --2- 172.21.15.158:0/1699369500 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f542412cd80 0x7f54240b4180 secure :-1 s=THROTTLE_DONE pgs=401 cs=0 l=1 rx=0x7f54240b0780 tx=0x7f540c0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.315 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.300+0000 7f541b7fe700 1 -- 172.21.15.158:0/1699369500 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f540c00cb90 con 0x7f542412cd80 2019-12-05T03:51:10.315 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.300+0000 7f542259c700 1 --2- 172.21.15.158:0/1699369500 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f542412cd80 0x7f54240b4180 secure :-1 s=THROTTLE_DONE pgs=401 cs=0 l=1 rx=0x7f54240b0780 tx=0x7f540c0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.315 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.300+0000 7f542259c700 1 --2- 172.21.15.158:0/1699369500 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f542412cd80 0x7f54240b4180 secure :-1 s=THROTTLE_DONE pgs=401 cs=0 l=1 rx=0x7f54240b0780 tx=0x7f540c0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.315 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.300+0000 7f541b7fe700 1 -- 172.21.15.158:0/1699369500 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540c00c7b0 con 0x7f542412cd80 2019-12-05T03:51:10.315 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.300+0000 7f5428d23700 1 -- 172.21.15.158:0/1699369500 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f542413e750 con 0x7f542412cd80 2019-12-05T03:51:10.315 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.300+0000 7f541b7fe700 1 -- 172.21.15.158:0/1699369500 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f540c011120 con 0x7f542412cd80 2019-12-05T03:51:10.316 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.300+0000 7f5428d23700 1 -- 172.21.15.158:0/1699369500 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54240ad6a0 con 0x7f542412cd80 2019-12-05T03:51:10.316 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.300+0000 7f542259c700 1 --2- 172.21.15.158:0/1699369500 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f542412cd80 0x7f54240b4180 secure :-1 s=THROTTLE_DONE pgs=401 cs=0 l=1 rx=0x7f54240b0780 tx=0x7f540c0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.316 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.300+0000 7f541b7fe700 1 -- 172.21.15.158:0/1699369500 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f540c011430 con 0x7f542412cd80 2019-12-05T03:51:10.316 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.300+0000 7f542259c700 1 --2- 172.21.15.158:0/1699369500 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f542412cd80 0x7f54240b4180 secure :-1 s=THROTTLE_DONE pgs=401 cs=0 l=1 rx=0x7f54240b0780 tx=0x7f540c0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.316 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.300+0000 7f541b7fe700 1 --2- 172.21.15.158:0/1699369500 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f540803ac60 0x7f540803d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:10.317 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.300+0000 7f541b7fe700 1 -- 172.21.15.158:0/1699369500 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6399+0+0 (secure 0 0 0) 0x7f540c04b140 con 0x7f542412cd80 2019-12-05T03:51:10.317 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.304+0000 7f5422d9d700 1 --2- 172.21.15.158:0/1699369500 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f540803ac60 0x7f540803d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:10.317 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.304+0000 7f5422d9d700 1 --2- 172.21.15.158:0/1699369500 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f540803ac60 0x7f540803d170 crc :-1 s=READY pgs=180 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:51:10.317 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.308+0000 7f5428d23700 1 -- 172.21.15.158:0/1699369500 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54240554e0 con 0x7f542412cd80 2019-12-05T03:51:10.319 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.312+0000 7f542259c700 1 --2- 172.21.15.158:0/1699369500 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f542412cd80 0x7f54240b4180 secure :-1 s=THROTTLE_DONE pgs=401 cs=0 l=1 rx=0x7f54240b0780 tx=0x7f540c0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.320 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.312+0000 7f541b7fe700 1 -- 172.21.15.158:0/1699369500 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f542413e750 con 0x7f542412cd80 2019-12-05T03:51:10.476 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.468+0000 7f5428d23700 1 -- 172.21.15.158:0/1699369500 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"} v 0) v1 -- 0x7f5424066940 con 0x7f542412cd80 2019-12-05T03:51:10.477 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.468+0000 7f542259c700 1 --2- 172.21.15.158:0/1699369500 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f542412cd80 0x7f54240b4180 secure :-1 s=THROTTLE_DONE pgs=401 cs=0 l=1 rx=0x7f54240b0780 tx=0x7f540c0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.477 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.472+0000 7f541b7fe700 1 -- 172.21.15.158:0/1699369500 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "rbd"}]=0 v36) v1 ==== 92+0+10 (secure 0 0 0) 0x7f542405fac0 con 0x7f542412cd80 2019-12-05T03:51:10.477 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:51:10.479 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.472+0000 7f5428d23700 1 -- 172.21.15.158:0/1699369500 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f540803ac60 msgr2=0x7f540803d170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:10.479 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.472+0000 7f5428d23700 1 --2- 172.21.15.158:0/1699369500 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f540803ac60 0x7f540803d170 crc :-1 s=READY pgs=180 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:10.480 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.472+0000 7f5428d23700 1 -- 172.21.15.158:0/1699369500 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f542412cd80 msgr2=0x7f54240b4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:10.480 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.472+0000 7f5428d23700 1 --2- 172.21.15.158:0/1699369500 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f542412cd80 0x7f54240b4180 secure :-1 s=READY pgs=401 cs=0 l=1 rx=0x7f54240b0780 tx=0x7f540c0109a0).stop 2019-12-05T03:51:10.480 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.472+0000 7f5428d23700 1 -- 172.21.15.158:0/1699369500 shutdown_connections 2019-12-05T03:51:10.480 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.472+0000 7f5428d23700 1 --2- 172.21.15.158:0/1699369500 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f542405f690 0x7f542413e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:10.480 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.472+0000 7f5428d23700 1 --2- 172.21.15.158:0/1699369500 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f540803ac60 0x7f540803d170 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:10.480 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.472+0000 7f5428d23700 1 --2- 172.21.15.158:0/1699369500 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f542412cd80 0x7f54240b4180 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:10.481 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.472+0000 7f5428d23700 1 -- 172.21.15.158:0/1699369500 shutdown_connections 2019-12-05T03:51:10.481 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.472+0000 7f5428d23700 1 -- 172.21.15.158:0/1699369500 wait complete. 2019-12-05T03:51:10.481 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.472+0000 7f5428d23700 1 -- 172.21.15.158:0/1699369500 >> 172.21.15.158:0/1699369500 conn(0x7f5424130ed0 msgr2=0x7f542405a420 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:51:10.489 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-12-05T03:51:10.599 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.580+0000 7f7c33433700 1 Processor -- start 2019-12-05T03:51:10.599 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.580+0000 7f7c33433700 1 -- start start 2019-12-05T03:51:10.599 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.580+0000 7f7c33433700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7c2c0b6970 0x7f7c2c09add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:51:10.599 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.580+0000 7f7c33433700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7c2c09ba40 0x7f7c2c05a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:51:10.600 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.580+0000 7f7c33433700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c2c099e30 con 0x7f7c2c05a950 2019-12-05T03:51:10.600 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.580+0000 7f7c33433700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c2c09d210 con 0x7f7c2c09ba40 2019-12-05T03:51:10.600 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.580+0000 7f7c33433700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c2c099b90 con 0x7f7c2c0b6970 2019-12-05T03:51:10.600 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.580+0000 7f7c319d0700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7c2c0b6970 0x7f7c2c09add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:10.600 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.580+0000 7f7c319d0700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f7c2c0b6970 0x7f7c2c09add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:55358/0 (socket says 172.21.15.158:55358) 2019-12-05T03:51:10.601 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.580+0000 7f7c319d0700 1 -- 172.21.15.158:0/2451542329 learned_addr learned my addr 172.21.15.158:0/2451542329 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:51:10.601 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.580+0000 7f7c311cf700 1 --2- 172.21.15.158:0/2451542329 >> v2:172.21.15.96:3300/0 conn(0x7f7c2c09ba40 0x7f7c2c05a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:10.601 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.584+0000 7f7c319d0700 1 -- 172.21.15.158:0/2451542329 >> v2:172.21.15.96:3300/0 conn(0x7f7c2c09ba40 msgr2=0x7f7c2c05a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:51:10.601 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.584+0000 7f7c319d0700 1 --2- 172.21.15.158:0/2451542329 >> v2:172.21.15.96:3300/0 conn(0x7f7c2c09ba40 0x7f7c2c05a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:51:10.601 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.584+0000 7f7c319d0700 1 -- 172.21.15.158:0/2451542329 >> v1:172.21.15.96:6789/0 conn(0x7f7c2c05a950 legacy=0x7f7c2c155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:10.602 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.584+0000 7f7c319d0700 1 -- 172.21.15.158:0/2451542329 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2c07e960 con 0x7f7c2c0b6970 2019-12-05T03:51:10.602 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.584+0000 7f7c319d0700 1 --2- 172.21.15.158:0/2451542329 >> v2:172.21.15.158:3300/0 conn(0x7f7c2c0b6970 0x7f7c2c09add0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7c28002f30 tx=0x7f7c2800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.602 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.584+0000 7f7c319d0700 1 --2- 172.21.15.158:0/2451542329 >> v2:172.21.15.158:3300/0 conn(0x7f7c2c0b6970 0x7f7c2c09add0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7c28002f30 tx=0x7f7c2800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.602 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.584+0000 7f7c319d0700 1 --2- 172.21.15.158:0/2451542329 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c2c0b6970 0x7f7c2c09add0 secure :-1 s=READY pgs=402 cs=0 l=1 rx=0x7f7c28002f30 tx=0x7f7c2800fd30).ready entity=mon.1 client_cookie=7da1c8479a4285ed server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:51:10.602 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.584+0000 7f7c319d0700 1 --2- 172.21.15.158:0/2451542329 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c2c0b6970 0x7f7c2c09add0 secure :-1 s=THROTTLE_DONE pgs=402 cs=0 l=1 rx=0x7f7c28002f30 tx=0x7f7c2800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.603 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.584+0000 7f7c309ce700 1 -- 172.21.15.158:0/2451542329 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c28008c90 con 0x7f7c2c0b6970 2019-12-05T03:51:10.603 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.584+0000 7f7c319d0700 1 --2- 172.21.15.158:0/2451542329 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c2c0b6970 0x7f7c2c09add0 secure :-1 s=THROTTLE_DONE pgs=402 cs=0 l=1 rx=0x7f7c28002f30 tx=0x7f7c2800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.603 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.584+0000 7f7c319d0700 1 --2- 172.21.15.158:0/2451542329 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c2c0b6970 0x7f7c2c09add0 secure :-1 s=THROTTLE_DONE pgs=402 cs=0 l=1 rx=0x7f7c28002f30 tx=0x7f7c2800fd30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.603 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.584+0000 7f7c309ce700 1 -- 172.21.15.158:0/2451542329 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c280088b0 con 0x7f7c2c0b6970 2019-12-05T03:51:10.603 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.584+0000 7f7c309ce700 1 -- 172.21.15.158:0/2451542329 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c28011ad0 con 0x7f7c2c0b6970 2019-12-05T03:51:10.604 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.584+0000 7f7c33433700 1 -- 172.21.15.158:0/2451542329 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c2c0b6970 msgr2=0x7f7c2c09add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:10.604 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.584+0000 7f7c33433700 1 --2- 172.21.15.158:0/2451542329 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c2c0b6970 0x7f7c2c09add0 secure :-1 s=READY pgs=402 cs=0 l=1 rx=0x7f7c28002f30 tx=0x7f7c2800fd30).stop 2019-12-05T03:51:10.604 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.584+0000 7f7c33433700 1 -- 172.21.15.158:0/2451542329 shutdown_connections 2019-12-05T03:51:10.604 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.584+0000 7f7c33433700 1 --2- 172.21.15.158:0/2451542329 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7c2c0b6970 0x7f7c2c09add0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:10.604 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.584+0000 7f7c33433700 1 --2- 172.21.15.158:0/2451542329 >> v2:172.21.15.96:3300/0 conn(0x7f7c2c09ba40 0x7f7c2c05a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:51:10.605 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.584+0000 7f7c33433700 1 -- 172.21.15.158:0/2451542329 shutdown_connections 2019-12-05T03:51:10.605 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.584+0000 7f7c33433700 1 -- 172.21.15.158:0/2451542329 wait complete. 2019-12-05T03:51:10.605 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.584+0000 7f7c33433700 1 -- 172.21.15.158:0/2451542329 >> 172.21.15.158:0/2451542329 conn(0x7f7c2c0b7ef0 msgr2=0x7f7c2c0b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:51:10.605 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.588+0000 7f7c33433700 1 Processor -- start 2019-12-05T03:51:10.605 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.588+0000 7f7c33433700 1 -- start start 2019-12-05T03:51:10.606 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.588+0000 7f7c33433700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7c2c0b2750 0x7f7c2c0990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:10.606 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.588+0000 7f7c33433700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c2c1531e0 0x7f7c2c07a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:10.606 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.588+0000 7f7c33433700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c2c0acee0 con 0x7f7c2c07ad70 2019-12-05T03:51:10.606 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.588+0000 7f7c33433700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c2c134b10 con 0x7f7c2c0b2750 2019-12-05T03:51:10.606 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.588+0000 7f7c33433700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c134870 con 0x7f7c2c1531e0 2019-12-05T03:51:10.607 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.588+0000 7f7c319d0700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7c2c0b2750 0x7f7c2c0990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:10.607 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.588+0000 7f7c311cf700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c2c1531e0 0x7f7c2c07a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:10.607 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.588+0000 7f7c311cf700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c2c1531e0 0x7f7c2c07a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3301/0 says I am v2:172.21.15.158:38108/0 (socket says 172.21.15.158:38108) 2019-12-05T03:51:10.607 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.588+0000 7f7c311cf700 1 -- 172.21.15.158:0/2209367051 learned_addr learned my addr 172.21.15.158:0/2209367051 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:51:10.608 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.588+0000 7f7c319d0700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7c2c0b2750 0x7f7c2c0990b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.158:41952/0 (socket says 172.21.15.158:41952) 2019-12-05T03:51:10.608 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.592+0000 7f7c311cf700 1 -- 172.21.15.158:0/2209367051 >> v2:172.21.15.96:3300/0 conn(0x7f7c2c0b2750 msgr2=0x7f7c2c0990b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:10.608 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.592+0000 7f7c311cf700 1 --2- 172.21.15.158:0/2209367051 >> v2:172.21.15.96:3300/0 conn(0x7f7c2c0b2750 0x7f7c2c0990b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:10.608 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.592+0000 7f7c311cf700 1 -- 172.21.15.158:0/2209367051 >> v1:172.21.15.96:6789/0 conn(0x7f7c2c07ad70 legacy=0x7f7c2c151ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:10.608 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.592+0000 7f7c311cf700 1 -- 172.21.15.158:0/2209367051 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2c0b2b80 con 0x7f7c2c1531e0 2019-12-05T03:51:10.609 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.592+0000 7f7c319d0700 1 --2- 172.21.15.158:0/2209367051 >> v2:172.21.15.96:3300/0 conn(0x7f7c2c0b2750 0x7f7c2c0990b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:51:10.609 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.592+0000 7f7c311cf700 1 --2- 172.21.15.158:0/2209367051 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c2c1531e0 0x7f7c2c07a820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7c1c002f30 tx=0x7f7c1c010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.609 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.592+0000 7f7c311cf700 1 --2- 172.21.15.158:0/2209367051 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c2c1531e0 0x7f7c2c07a820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7c1c002f30 tx=0x7f7c1c010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.609 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.592+0000 7f7c311cf700 1 --2- 172.21.15.158:0/2209367051 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c2c1531e0 0x7f7c2c07a820 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7f7c1c002f30 tx=0x7f7c1c010ba0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:51:10.611 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.592+0000 7f7c311cf700 1 --2- 172.21.15.158:0/2209367051 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c2c1531e0 0x7f7c2c07a820 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f7c1c002f30 tx=0x7f7c1c010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.611 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.592+0000 7f7c227fc700 1 -- 172.21.15.158:0/2209367051 <== mon.2 v2:172.21.15.96:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c1c012650 con 0x7f7c2c1531e0 2019-12-05T03:51:10.611 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.592+0000 7f7c311cf700 1 --2- 172.21.15.158:0/2209367051 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c2c1531e0 0x7f7c2c07a820 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f7c1c002f30 tx=0x7f7c1c010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.611 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.592+0000 7f7c311cf700 1 --2- 172.21.15.158:0/2209367051 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c2c1531e0 0x7f7c2c07a820 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f7c1c002f30 tx=0x7f7c1c010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.612 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.592+0000 7f7c227fc700 1 -- 172.21.15.158:0/2209367051 <== mon.2 v2:172.21.15.96:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1c007150 con 0x7f7c2c1531e0 2019-12-05T03:51:10.612 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.592+0000 7f7c227fc700 1 -- 172.21.15.158:0/2209367051 <== mon.2 v2:172.21.15.96:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c1c012c30 con 0x7f7c2c1531e0 2019-12-05T03:51:10.612 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.592+0000 7f7c33433700 1 -- 172.21.15.158:0/2209367051 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c2c134500 con 0x7f7c2c1531e0 2019-12-05T03:51:10.612 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.592+0000 7f7c33433700 1 -- 172.21.15.158:0/2209367051 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c2c153610 con 0x7f7c2c1531e0 2019-12-05T03:51:10.612 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.592+0000 7f7c311cf700 1 --2- 172.21.15.158:0/2209367051 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c2c1531e0 0x7f7c2c07a820 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f7c1c002f30 tx=0x7f7c1c010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.614 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.592+0000 7f7c227fc700 1 -- 172.21.15.158:0/2209367051 <== mon.2 v2:172.21.15.96:3301/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f7c1c005540 con 0x7f7c2c1531e0 2019-12-05T03:51:10.614 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.592+0000 7f7c311cf700 1 --2- 172.21.15.158:0/2209367051 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c2c1531e0 0x7f7c2c07a820 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f7c1c002f30 tx=0x7f7c1c010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.614 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.592+0000 7f7c227fc700 1 --2- 172.21.15.158:0/2209367051 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f7c1403ae00 0x7f7c1403d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:10.615 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.592+0000 7f7c227fc700 1 -- 172.21.15.158:0/2209367051 <== mon.2 v2:172.21.15.96:3301/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6399+0+0 (secure 0 0 0) 0x7f7c1c04b190 con 0x7f7c2c1531e0 2019-12-05T03:51:10.615 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.592+0000 7f7c319d0700 1 --2- 172.21.15.158:0/2209367051 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f7c1403ae00 0x7f7c1403d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:10.615 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.592+0000 7f7c319d0700 1 --2- 172.21.15.158:0/2209367051 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f7c1403ae00 0x7f7c1403d310 crc :-1 s=READY pgs=181 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:51:10.615 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.596+0000 7f7c33433700 1 -- 172.21.15.158:0/2209367051 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c2c099600 con 0x7f7c2c1531e0 2019-12-05T03:51:10.615 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.604+0000 7f7c311cf700 1 --2- 172.21.15.158:0/2209367051 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c2c1531e0 0x7f7c2c07a820 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f7c1c002f30 tx=0x7f7c1c010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.616 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.604+0000 7f7c227fc700 1 -- 172.21.15.158:0/2209367051 <== mon.2 v2:172.21.15.96:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f7c1c032410 con 0x7f7c2c1531e0 2019-12-05T03:51:10.767 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.760+0000 7f7c33433700 1 -- 172.21.15.158:0/2209367051 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"} v 0) v1 -- 0x7f7c2c05ab60 con 0x7f7c2c1531e0 2019-12-05T03:51:10.768 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.760+0000 7f7c311cf700 1 --2- 172.21.15.158:0/2209367051 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c2c1531e0 0x7f7c2c07a820 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f7c1c002f30 tx=0x7f7c1c010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.768 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.760+0000 7f7c227fc700 1 -- 172.21.15.158:0/2209367051 <== mon.2 v2:172.21.15.96:3301/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_metadata"}]=0 v36) v1 ==== 104+0+10 (secure 0 0 0) 0x7f7c1c032130 con 0x7f7c2c1531e0 2019-12-05T03:51:10.770 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:51:10.773 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.764+0000 7f7c33433700 1 -- 172.21.15.158:0/2209367051 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f7c1403ae00 msgr2=0x7f7c1403d310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:10.773 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.764+0000 7f7c33433700 1 --2- 172.21.15.158:0/2209367051 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f7c1403ae00 0x7f7c1403d310 crc :-1 s=READY pgs=181 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:10.773 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.764+0000 7f7c33433700 1 -- 172.21.15.158:0/2209367051 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c2c1531e0 msgr2=0x7f7c2c07a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:10.774 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.764+0000 7f7c33433700 1 --2- 172.21.15.158:0/2209367051 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c2c1531e0 0x7f7c2c07a820 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7f7c1c002f30 tx=0x7f7c1c010ba0).stop 2019-12-05T03:51:10.774 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.764+0000 7f7c33433700 1 -- 172.21.15.158:0/2209367051 shutdown_connections 2019-12-05T03:51:10.774 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.764+0000 7f7c33433700 1 --2- 172.21.15.158:0/2209367051 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f7c1403ae00 0x7f7c1403d310 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:10.774 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.764+0000 7f7c33433700 1 --2- 172.21.15.158:0/2209367051 >> v2:172.21.15.96:3300/0 conn(0x7f7c2c0b2750 0x7f7c2c0990b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:10.774 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.764+0000 7f7c33433700 1 --2- 172.21.15.158:0/2209367051 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7c2c1531e0 0x7f7c2c07a820 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:10.774 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.768+0000 7f7c33433700 1 -- 172.21.15.158:0/2209367051 shutdown_connections 2019-12-05T03:51:10.774 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.768+0000 7f7c33433700 1 -- 172.21.15.158:0/2209367051 wait complete. 2019-12-05T03:51:10.775 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.768+0000 7f7c33433700 1 -- 172.21.15.158:0/2209367051 >> 172.21.15.158:0/2209367051 conn(0x7f7c2c05a2f0 msgr2=0x7f7c2c09b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:51:10.783 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-12-05T03:51:10.883 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.868+0000 7f8d5e6c7700 1 Processor -- start 2019-12-05T03:51:10.883 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.868+0000 7f8d5e6c7700 1 -- start start 2019-12-05T03:51:10.883 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.872+0000 7f8d5e6c7700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8d580b6970 0x7f8d5809add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:51:10.883 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.872+0000 7f8d5e6c7700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f8d5809ba40 0x7f8d5805a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:51:10.883 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.872+0000 7f8d5e6c7700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8d5805a950 0x7f8d58155290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:51:10.883 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.872+0000 7f8d5e6c7700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d5809d210 con 0x7f8d580b6970 2019-12-05T03:51:10.884 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.872+0000 7f8d5e6c7700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d58099b90 con 0x7f8d5809ba40 2019-12-05T03:51:10.884 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.872+0000 7f8d5e6c7700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d58099e30 con 0x7f8d5805a950 2019-12-05T03:51:10.884 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.872+0000 7f8d57fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f8d5809ba40 0x7f8d5805a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:10.884 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.872+0000 7f8d57fff700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f8d5809ba40 0x7f8d5805a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:55374/0 (socket says 172.21.15.158:55374) 2019-12-05T03:51:10.884 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.872+0000 7f8d57fff700 1 -- 172.21.15.158:0/2965634905 learned_addr learned my addr 172.21.15.158:0/2965634905 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:51:10.884 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.872+0000 7f8d5cc64700 1 --2- 172.21.15.158:0/2965634905 >> v2:172.21.15.96:3300/0 conn(0x7f8d580b6970 0x7f8d5809add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:10.885 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.872+0000 7f8d5d465700 1 --2- 172.21.15.158:0/2965634905 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8d5805a950 0x7f8d58155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:10.885 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.872+0000 7f8d57fff700 1 -- 172.21.15.158:0/2965634905 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8d5805a950 msgr2=0x7f8d58155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:51:10.885 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.872+0000 7f8d57fff700 1 --2- 172.21.15.158:0/2965634905 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8d5805a950 0x7f8d58155290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:51:10.885 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.872+0000 7f8d57fff700 1 -- 172.21.15.158:0/2965634905 >> v2:172.21.15.96:3300/0 conn(0x7f8d580b6970 msgr2=0x7f8d5809add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:51:10.885 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.872+0000 7f8d57fff700 1 --2- 172.21.15.158:0/2965634905 >> v2:172.21.15.96:3300/0 conn(0x7f8d580b6970 0x7f8d5809add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:51:10.885 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.872+0000 7f8d57fff700 1 -- 172.21.15.158:0/2965634905 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d5807e960 con 0x7f8d5809ba40 2019-12-05T03:51:10.885 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.872+0000 7f8d57fff700 1 --2- 172.21.15.158:0/2965634905 >> v2:172.21.15.158:3300/0 conn(0x7f8d5809ba40 0x7f8d5805a400 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8d4c002f30 tx=0x7f8d4c00fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.886 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.872+0000 7f8d57fff700 1 --2- 172.21.15.158:0/2965634905 >> v2:172.21.15.158:3300/0 conn(0x7f8d5809ba40 0x7f8d5805a400 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8d4c002f30 tx=0x7f8d4c00fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.886 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.872+0000 7f8d57fff700 1 --2- 172.21.15.158:0/2965634905 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8d5809ba40 0x7f8d5805a400 secure :-1 s=READY pgs=403 cs=0 l=1 rx=0x7f8d4c002f30 tx=0x7f8d4c00fdb0).ready entity=mon.1 client_cookie=efcb797df0006087 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:51:10.886 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.872+0000 7f8d57fff700 1 --2- 172.21.15.158:0/2965634905 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8d5809ba40 0x7f8d5805a400 secure :-1 s=THROTTLE_DONE pgs=403 cs=0 l=1 rx=0x7f8d4c002f30 tx=0x7f8d4c00fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.886 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.872+0000 7f8d577fe700 1 -- 172.21.15.158:0/2965634905 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d4c008c90 con 0x7f8d5809ba40 2019-12-05T03:51:10.886 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.872+0000 7f8d57fff700 1 --2- 172.21.15.158:0/2965634905 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8d5809ba40 0x7f8d5805a400 secure :-1 s=THROTTLE_DONE pgs=403 cs=0 l=1 rx=0x7f8d4c002f30 tx=0x7f8d4c00fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.886 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.872+0000 7f8d57fff700 1 --2- 172.21.15.158:0/2965634905 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8d5809ba40 0x7f8d5805a400 secure :-1 s=THROTTLE_DONE pgs=403 cs=0 l=1 rx=0x7f8d4c002f30 tx=0x7f8d4c00fdb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.886 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.872+0000 7f8d577fe700 1 -- 172.21.15.158:0/2965634905 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4c0088b0 con 0x7f8d5809ba40 2019-12-05T03:51:10.887 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.872+0000 7f8d577fe700 1 -- 172.21.15.158:0/2965634905 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d4c011b50 con 0x7f8d5809ba40 2019-12-05T03:51:10.887 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.872+0000 7f8d5e6c7700 1 -- 172.21.15.158:0/2965634905 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8d5809ba40 msgr2=0x7f8d5805a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:10.887 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.872+0000 7f8d5e6c7700 1 --2- 172.21.15.158:0/2965634905 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8d5809ba40 0x7f8d5805a400 secure :-1 s=READY pgs=403 cs=0 l=1 rx=0x7f8d4c002f30 tx=0x7f8d4c00fdb0).stop 2019-12-05T03:51:10.887 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.876+0000 7f8d5e6c7700 1 -- 172.21.15.158:0/2965634905 shutdown_connections 2019-12-05T03:51:10.887 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.876+0000 7f8d5e6c7700 1 --2- 172.21.15.158:0/2965634905 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8d5805a950 0x7f8d58155290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:51:10.887 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.876+0000 7f8d5e6c7700 1 --2- 172.21.15.158:0/2965634905 >> v2:172.21.15.96:3300/0 conn(0x7f8d580b6970 0x7f8d5809add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:51:10.887 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.876+0000 7f8d5e6c7700 1 --2- 172.21.15.158:0/2965634905 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8d5809ba40 0x7f8d5805a400 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:10.887 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.876+0000 7f8d5e6c7700 1 -- 172.21.15.158:0/2965634905 shutdown_connections 2019-12-05T03:51:10.888 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.876+0000 7f8d5e6c7700 1 -- 172.21.15.158:0/2965634905 wait complete. 2019-12-05T03:51:10.888 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.876+0000 7f8d5e6c7700 1 -- 172.21.15.158:0/2965634905 >> 172.21.15.158:0/2965634905 conn(0x7f8d580b7ef0 msgr2=0x7f8d580b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:51:10.891 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.876+0000 7f8d5e6c7700 1 Processor -- start 2019-12-05T03:51:10.892 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.876+0000 7f8d5e6c7700 1 -- start start 2019-12-05T03:51:10.892 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.880+0000 7f8d5e6c7700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f8d580acbd0 0x7f8d58152700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:10.892 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.880+0000 7f8d5e6c7700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8d5812e2f0 0x7f8d5807ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:10.892 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.880+0000 7f8d5e6c7700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d5813ca40 con 0x7f8d5807b2e0 2019-12-05T03:51:10.892 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.880+0000 7f8d5e6c7700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d58151f20 con 0x7f8d580acbd0 2019-12-05T03:51:10.892 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.880+0000 7f8d5e6c7700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d581521c0 con 0x7f8d5812e2f0 2019-12-05T03:51:10.893 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.880+0000 7f8d5cc64700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f8d580acbd0 0x7f8d58152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:10.893 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.880+0000 7f8d5cc64700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f8d580acbd0 0x7f8d58152700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:55378/0 (socket says 172.21.15.158:55378) 2019-12-05T03:51:10.893 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.880+0000 7f8d5cc64700 1 -- 172.21.15.158:0/846433082 learned_addr learned my addr 172.21.15.158:0/846433082 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:51:10.893 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.880+0000 7f8d57fff700 1 --2- 172.21.15.158:0/846433082 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8d5812e2f0 0x7f8d5807ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:10.893 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.880+0000 7f8d5cc64700 1 -- 172.21.15.158:0/846433082 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8d5812e2f0 msgr2=0x7f8d5807ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:10.893 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.880+0000 7f8d5cc64700 1 --2- 172.21.15.158:0/846433082 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8d5812e2f0 0x7f8d5807ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:10.893 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.880+0000 7f8d5cc64700 1 -- 172.21.15.158:0/846433082 >> v1:172.21.15.158:6789/0 conn(0x7f8d5807b2e0 legacy=0x7f8d58152d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:10.894 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.880+0000 7f8d5cc64700 1 -- 172.21.15.158:0/846433082 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d5812e720 con 0x7f8d580acbd0 2019-12-05T03:51:10.894 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.880+0000 7f8d5cc64700 1 --2- 172.21.15.158:0/846433082 >> v2:172.21.15.158:3300/0 conn(0x7f8d580acbd0 0x7f8d58152700 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8d580ada60 tx=0x7f8d48010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.894 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.880+0000 7f8d5cc64700 1 --2- 172.21.15.158:0/846433082 >> v2:172.21.15.158:3300/0 conn(0x7f8d580acbd0 0x7f8d58152700 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8d580ada60 tx=0x7f8d48010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.894 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.880+0000 7f8d5cc64700 1 --2- 172.21.15.158:0/846433082 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8d580acbd0 0x7f8d58152700 secure :-1 s=READY pgs=405 cs=0 l=1 rx=0x7f8d580ada60 tx=0x7f8d48010b60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:51:10.894 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.880+0000 7f8d5cc64700 1 --2- 172.21.15.158:0/846433082 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8d580acbd0 0x7f8d58152700 secure :-1 s=THROTTLE_DONE pgs=405 cs=0 l=1 rx=0x7f8d580ada60 tx=0x7f8d48010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.894 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.880+0000 7f8d557fa700 1 -- 172.21.15.158:0/846433082 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d48012590 con 0x7f8d580acbd0 2019-12-05T03:51:10.894 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.880+0000 7f8d5cc64700 1 --2- 172.21.15.158:0/846433082 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8d580acbd0 0x7f8d58152700 secure :-1 s=THROTTLE_DONE pgs=405 cs=0 l=1 rx=0x7f8d580ada60 tx=0x7f8d48010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.895 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.880+0000 7f8d5cc64700 1 --2- 172.21.15.158:0/846433082 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8d580acbd0 0x7f8d58152700 secure :-1 s=THROTTLE_DONE pgs=405 cs=0 l=1 rx=0x7f8d580ada60 tx=0x7f8d48010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.895 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.880+0000 7f8d557fa700 1 -- 172.21.15.158:0/846433082 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d48007150 con 0x7f8d580acbd0 2019-12-05T03:51:10.895 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.880+0000 7f8d5e6c7700 1 -- 172.21.15.158:0/846433082 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d58151af0 con 0x7f8d580acbd0 2019-12-05T03:51:10.895 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.880+0000 7f8d557fa700 1 -- 172.21.15.158:0/846433082 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d48012b70 con 0x7f8d580acbd0 2019-12-05T03:51:10.895 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.880+0000 7f8d5e6c7700 1 -- 172.21.15.158:0/846433082 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d5807b710 con 0x7f8d580acbd0 2019-12-05T03:51:10.895 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.880+0000 7f8d5cc64700 1 --2- 172.21.15.158:0/846433082 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8d580acbd0 0x7f8d58152700 secure :-1 s=THROTTLE_DONE pgs=405 cs=0 l=1 rx=0x7f8d580ada60 tx=0x7f8d48010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.895 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.880+0000 7f8d557fa700 1 -- 172.21.15.158:0/846433082 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f8d48005540 con 0x7f8d580acbd0 2019-12-05T03:51:10.896 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.880+0000 7f8d5cc64700 1 --2- 172.21.15.158:0/846433082 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8d580acbd0 0x7f8d58152700 secure :-1 s=THROTTLE_DONE pgs=405 cs=0 l=1 rx=0x7f8d580ada60 tx=0x7f8d48010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.896 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.884+0000 7f8d557fa700 1 --2- 172.21.15.158:0/846433082 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f8d3803ad20 0x7f8d3803d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:10.896 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.884+0000 7f8d557fa700 1 -- 172.21.15.158:0/846433082 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6399+0+0 (secure 0 0 0) 0x7f8d4804af50 con 0x7f8d580acbd0 2019-12-05T03:51:10.896 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.884+0000 7f8d57fff700 1 --2- 172.21.15.158:0/846433082 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f8d3803ad20 0x7f8d3803d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:10.896 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.884+0000 7f8d57fff700 1 --2- 172.21.15.158:0/846433082 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f8d3803ad20 0x7f8d3803d230 crc :-1 s=READY pgs=182 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:51:10.896 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.884+0000 7f8d5e6c7700 1 -- 172.21.15.158:0/846433082 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d580554e0 con 0x7f8d580acbd0 2019-12-05T03:51:10.897 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.892+0000 7f8d5cc64700 1 --2- 172.21.15.158:0/846433082 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8d580acbd0 0x7f8d58152700 secure :-1 s=THROTTLE_DONE pgs=405 cs=0 l=1 rx=0x7f8d580ada60 tx=0x7f8d48010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:10.898 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:10.892+0000 7f8d557fa700 1 -- 172.21.15.158:0/846433082 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f8d48031fd0 con 0x7f8d580acbd0 2019-12-05T03:51:11.050 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.044+0000 7f8d5e6c7700 1 -- 172.21.15.158:0/846433082 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"} v 0) v1 -- 0x7f8d58066940 con 0x7f8d580acbd0 2019-12-05T03:51:11.051 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.044+0000 7f8d5cc64700 1 --2- 172.21.15.158:0/846433082 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8d580acbd0 0x7f8d58152700 secure :-1 s=THROTTLE_DONE pgs=405 cs=0 l=1 rx=0x7f8d580ada60 tx=0x7f8d48010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:11.051 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.044+0000 7f8d557fa700 1 -- 172.21.15.158:0/846433082 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "cephfs_data"}]=0 v36) v1 ==== 100+0+10 (secure 0 0 0) 0x7f8d48032230 con 0x7f8d580acbd0 2019-12-05T03:51:11.051 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:51:11.054 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.048+0000 7f8d5e6c7700 1 -- 172.21.15.158:0/846433082 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f8d3803ad20 msgr2=0x7f8d3803d230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:11.054 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.048+0000 7f8d5e6c7700 1 --2- 172.21.15.158:0/846433082 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f8d3803ad20 0x7f8d3803d230 crc :-1 s=READY pgs=182 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:11.054 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.048+0000 7f8d5e6c7700 1 -- 172.21.15.158:0/846433082 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8d580acbd0 msgr2=0x7f8d58152700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:11.054 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.048+0000 7f8d5e6c7700 1 --2- 172.21.15.158:0/846433082 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8d580acbd0 0x7f8d58152700 secure :-1 s=READY pgs=405 cs=0 l=1 rx=0x7f8d580ada60 tx=0x7f8d48010b60).stop 2019-12-05T03:51:11.055 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.048+0000 7f8d5e6c7700 1 -- 172.21.15.158:0/846433082 shutdown_connections 2019-12-05T03:51:11.055 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.048+0000 7f8d5e6c7700 1 --2- 172.21.15.158:0/846433082 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f8d3803ad20 0x7f8d3803d230 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:11.055 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.048+0000 7f8d5e6c7700 1 --2- 172.21.15.158:0/846433082 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f8d580acbd0 0x7f8d58152700 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:11.055 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.048+0000 7f8d5e6c7700 1 --2- 172.21.15.158:0/846433082 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f8d5812e2f0 0x7f8d5807ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:11.055 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.048+0000 7f8d5e6c7700 1 -- 172.21.15.158:0/846433082 shutdown_connections 2019-12-05T03:51:11.055 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.048+0000 7f8d5e6c7700 1 -- 172.21.15.158:0/846433082 wait complete. 2019-12-05T03:51:11.056 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.048+0000 7f8d5e6c7700 1 -- 172.21.15.158:0/846433082 >> 172.21.15.158:0/846433082 conn(0x7f8d580b3980 msgr2=0x7f8d581316d0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:51:11.064 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2019-12-05T03:51:11.162 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.152+0000 7f994c60e700 1 Processor -- start 2019-12-05T03:51:11.163 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.152+0000 7f994c60e700 1 -- start start 2019-12-05T03:51:11.163 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.152+0000 7f994c60e700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f99440b6970 0x7f994409add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:51:11.163 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.152+0000 7f994c60e700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9944099e30 con 0x7f99440b5370 2019-12-05T03:51:11.163 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.152+0000 7f994c60e700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f994407e960 con 0x7f994409ba40 2019-12-05T03:51:11.163 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.152+0000 7f994c60e700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f994409d210 con 0x7f99440b6970 2019-12-05T03:51:11.164 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.152+0000 7f994a3aa700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f994409ba40 0x7f994405a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:50166/0 (socket says 172.21.15.158:50166) 2019-12-05T03:51:11.164 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.152+0000 7f994a3aa700 1 -- 172.21.15.158:0/2457302442 learned_addr learned my addr 172.21.15.158:0/2457302442 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:51:11.164 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.152+0000 7f994abab700 1 --2- 172.21.15.158:0/2457302442 >> v2:172.21.15.96:3300/0 conn(0x7f99440b6970 0x7f994409add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:11.164 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.152+0000 7f9949ba9700 1 -- 172.21.15.158:0/2457302442 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1006967291 0 0) 0x7f994407e960 con 0x7f994409ba40 2019-12-05T03:51:11.164 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.152+0000 7f9949ba9700 1 -- 172.21.15.158:0/2457302442 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f992c0030b0 con 0x7f994409ba40 2019-12-05T03:51:11.164 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.152+0000 7f9949ba9700 1 -- 172.21.15.158:0/2457302442 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4038646715 0 0) 0x7f992c0030b0 con 0x7f994409ba40 2019-12-05T03:51:11.164 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.152+0000 7f9949ba9700 1 -- 172.21.15.158:0/2457302442 >> v2:172.21.15.96:3300/0 conn(0x7f99440b6970 msgr2=0x7f994409add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:51:11.165 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.152+0000 7f9949ba9700 1 --2- 172.21.15.158:0/2457302442 >> v2:172.21.15.96:3300/0 conn(0x7f99440b6970 0x7f994409add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:51:11.165 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.152+0000 7f9949ba9700 1 -- 172.21.15.158:0/2457302442 >> v1:172.21.15.96:6789/0 conn(0x7f99440b5370 legacy=0x7f99440b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:11.165 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.152+0000 7f9949ba9700 1 -- 172.21.15.158:0/2457302442 --> v1:172.21.15.158:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99440b5fa0 con 0x7f994409ba40 2019-12-05T03:51:11.165 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.152+0000 7f9949ba9700 1 -- 172.21.15.158:0/2457302442 <== mon.1 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 828730332 0 0) 0x7f993c001ad0 con 0x7f994409ba40 2019-12-05T03:51:11.165 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.152+0000 7f9949ba9700 1 -- 172.21.15.158:0/2457302442 >> v1:172.21.15.158:6789/0 conn(0x7f994409ba40 legacy=0x7f994405a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:11.165 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.152+0000 7f9949ba9700 1 --2- 172.21.15.158:0/2457302442 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f992c0036e0 0x7f992c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:51:11.165 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.152+0000 7f9949ba9700 1 --2- 172.21.15.158:0/2457302442 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f992c004420 0x7f992c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:51:11.166 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.152+0000 7f9949ba9700 1 --2- 172.21.15.158:0/2457302442 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f992c004da0 0x7f992c00b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:51:11.166 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.152+0000 7f9949ba9700 1 -- 172.21.15.158:0/2457302442 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994409d210 con 0x7f992c004420 2019-12-05T03:51:11.166 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.152+0000 7f9949ba9700 1 -- 172.21.15.158:0/2457302442 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992c04fc60 con 0x7f992c004da0 2019-12-05T03:51:11.166 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.152+0000 7f9949ba9700 1 -- 172.21.15.158:0/2457302442 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f992c04fea0 con 0x7f992c0036e0 2019-12-05T03:51:11.166 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.152+0000 7f994b3ac700 1 --2- 172.21.15.158:0/2457302442 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f992c004da0 0x7f992c00b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:11.166 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.152+0000 7f994abab700 1 --2- 172.21.15.158:0/2457302442 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f992c0036e0 0x7f992c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:11.166 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.152+0000 7f994a3aa700 1 --2- 172.21.15.158:0/2457302442 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f992c004420 0x7f992c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:11.167 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.152+0000 7f994b3ac700 1 -- 172.21.15.158:0/2457302442 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f992c0036e0 msgr2=0x7f992c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:51:11.167 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.156+0000 7f994b3ac700 1 --2- 172.21.15.158:0/2457302442 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f992c0036e0 0x7f992c003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:51:11.167 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.156+0000 7f994b3ac700 1 -- 172.21.15.158:0/2457302442 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f992c004420 msgr2=0x7f992c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:51:11.167 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.156+0000 7f994b3ac700 1 --2- 172.21.15.158:0/2457302442 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f992c004420 0x7f992c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:51:11.167 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.156+0000 7f994b3ac700 1 -- 172.21.15.158:0/2457302442 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992c0501a0 con 0x7f992c004da0 2019-12-05T03:51:11.167 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.156+0000 7f994b3ac700 1 --2- 172.21.15.158:0/2457302442 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f992c004da0 0x7f992c00b670 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9934001000 tx=0x7f993400fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:11.167 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.156+0000 7f994b3ac700 1 -- 172.21.15.158:0/2457302442 reap_dead start 2019-12-05T03:51:11.168 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.156+0000 7f994b3ac700 1 --2- 172.21.15.158:0/2457302442 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f992c004da0 0x7f992c00b670 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9934001000 tx=0x7f993400fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:11.168 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.156+0000 7f994b3ac700 1 --2- 172.21.15.158:0/2457302442 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f992c004da0 0x7f992c00b670 secure :-1 s=READY pgs=407 cs=0 l=1 rx=0x7f9934001000 tx=0x7f993400fc70).ready entity=mon.1 client_cookie=178a4ccb13466d7a server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:51:11.168 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.156+0000 7f994b3ac700 1 --2- 172.21.15.158:0/2457302442 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f992c004da0 0x7f992c00b670 secure :-1 s=THROTTLE_DONE pgs=407 cs=0 l=1 rx=0x7f9934001000 tx=0x7f993400fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:11.168 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.156+0000 7f9949ba9700 1 -- 172.21.15.158:0/2457302442 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9934003540 con 0x7f992c004da0 2019-12-05T03:51:11.168 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.156+0000 7f994b3ac700 1 --2- 172.21.15.158:0/2457302442 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f992c004da0 0x7f992c00b670 secure :-1 s=THROTTLE_DONE pgs=407 cs=0 l=1 rx=0x7f9934001000 tx=0x7f993400fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:11.168 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.156+0000 7f9949ba9700 1 -- 172.21.15.158:0/2457302442 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9934003160 con 0x7f992c004da0 2019-12-05T03:51:11.169 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.156+0000 7f994b3ac700 1 --2- 172.21.15.158:0/2457302442 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f992c004da0 0x7f992c00b670 secure :-1 s=THROTTLE_DONE pgs=407 cs=0 l=1 rx=0x7f9934001000 tx=0x7f993400fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:11.169 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.156+0000 7f994c60e700 1 -- 172.21.15.158:0/2457302442 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f992c004da0 msgr2=0x7f992c00b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:11.169 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.156+0000 7f9949ba9700 1 -- 172.21.15.158:0/2457302442 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9934003b20 con 0x7f992c004da0 2019-12-05T03:51:11.169 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.156+0000 7f994c60e700 1 --2- 172.21.15.158:0/2457302442 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f992c004da0 0x7f992c00b670 secure :-1 s=READY pgs=407 cs=0 l=1 rx=0x7f9934001000 tx=0x7f993400fc70).stop 2019-12-05T03:51:11.169 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.156+0000 7f994c60e700 1 -- 172.21.15.158:0/2457302442 shutdown_connections 2019-12-05T03:51:11.169 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.156+0000 7f994c60e700 1 --2- 172.21.15.158:0/2457302442 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f992c004da0 0x7f992c00b670 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:11.169 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.156+0000 7f994c60e700 1 -- 172.21.15.158:0/2457302442 shutdown_connections 2019-12-05T03:51:11.170 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.156+0000 7f994c60e700 1 -- 172.21.15.158:0/2457302442 wait complete. 2019-12-05T03:51:11.170 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.156+0000 7f994c60e700 1 -- 172.21.15.158:0/2457302442 >> 172.21.15.158:0/2457302442 conn(0x7f99440b7ef0 msgr2=0x7f99440b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:51:11.173 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.156+0000 7f994c60e700 1 Processor -- start 2019-12-05T03:51:11.173 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.156+0000 7f994c60e700 1 -- start start 2019-12-05T03:51:11.173 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.156+0000 7f994c60e700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f99440b1780 0x7f99440af600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:11.173 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.156+0000 7f994c60e700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f9944141610 0x7f99440b2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:11.173 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.156+0000 7f994c60e700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99440af120 con 0x7f99441411e0 2019-12-05T03:51:11.174 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.156+0000 7f994c60e700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99440b1520 con 0x7f99440b1780 2019-12-05T03:51:11.174 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.156+0000 7f994c60e700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9944141b60 con 0x7f9944141610 2019-12-05T03:51:11.174 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.156+0000 7f994b3ac700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f9944141610 0x7f99440b2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:11.174 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.156+0000 7f994b3ac700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f9944141610 0x7f99440b2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:55400/0 (socket says 172.21.15.158:55400) 2019-12-05T03:51:11.174 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.156+0000 7f994abab700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f99440b1780 0x7f99440af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:11.174 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.156+0000 7f994b3ac700 1 -- 172.21.15.158:0/3950462475 learned_addr learned my addr 172.21.15.158:0/3950462475 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:51:11.174 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.160+0000 7f994b3ac700 1 -- 172.21.15.158:0/3950462475 >> v2:172.21.15.96:3300/0 conn(0x7f99440b1780 msgr2=0x7f99440af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:11.175 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.160+0000 7f994b3ac700 1 --2- 172.21.15.158:0/3950462475 >> v2:172.21.15.96:3300/0 conn(0x7f99440b1780 0x7f99440af600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:11.175 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.160+0000 7f994b3ac700 1 -- 172.21.15.158:0/3950462475 >> v1:172.21.15.96:6789/0 conn(0x7f99441411e0 legacy=0x7f994413cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:11.175 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.160+0000 7f994b3ac700 1 -- 172.21.15.158:0/3950462475 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99440b3310 con 0x7f9944141610 2019-12-05T03:51:11.175 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.160+0000 7f994b3ac700 1 --2- 172.21.15.158:0/3950462475 >> v2:172.21.15.158:3300/0 conn(0x7f9944141610 0x7f99440b2dc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9934001000 tx=0x7f99340012e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:11.175 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.160+0000 7f994b3ac700 1 --2- 172.21.15.158:0/3950462475 >> v2:172.21.15.158:3300/0 conn(0x7f9944141610 0x7f99440b2dc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9934001000 tx=0x7f99340012e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:11.175 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.160+0000 7f994b3ac700 1 --2- 172.21.15.158:0/3950462475 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9944141610 0x7f99440b2dc0 secure :-1 s=READY pgs=408 cs=0 l=1 rx=0x7f9934001000 tx=0x7f99340012e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:51:11.175 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.160+0000 7f994b3ac700 1 --2- 172.21.15.158:0/3950462475 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9944141610 0x7f99440b2dc0 secure :-1 s=THROTTLE_DONE pgs=408 cs=0 l=1 rx=0x7f9934001000 tx=0x7f99340012e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:11.176 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.160+0000 7f994b3ac700 1 --2- 172.21.15.158:0/3950462475 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9944141610 0x7f99440b2dc0 secure :-1 s=THROTTLE_DONE pgs=408 cs=0 l=1 rx=0x7f9934001000 tx=0x7f99340012e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:11.176 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.160+0000 7f994b3ac700 1 --2- 172.21.15.158:0/3950462475 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9944141610 0x7f99440b2dc0 secure :-1 s=THROTTLE_DONE pgs=408 cs=0 l=1 rx=0x7f9934001000 tx=0x7f99340012e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:11.176 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.160+0000 7f993b7fe700 1 -- 172.21.15.158:0/3950462475 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9934011b50 con 0x7f9944141610 2019-12-05T03:51:11.176 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.160+0000 7f993b7fe700 1 -- 172.21.15.158:0/3950462475 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9934003740 con 0x7f9944141610 2019-12-05T03:51:11.177 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.160+0000 7f994c60e700 1 -- 172.21.15.158:0/3950462475 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99440b35e0 con 0x7f9944141610 2019-12-05T03:51:11.177 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.160+0000 7f993b7fe700 1 -- 172.21.15.158:0/3950462475 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9934007640 con 0x7f9944141610 2019-12-05T03:51:11.177 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.160+0000 7f994c60e700 1 -- 172.21.15.158:0/3950462475 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99440b3b10 con 0x7f9944141610 2019-12-05T03:51:11.177 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.160+0000 7f994b3ac700 1 --2- 172.21.15.158:0/3950462475 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9944141610 0x7f99440b2dc0 secure :-1 s=THROTTLE_DONE pgs=408 cs=0 l=1 rx=0x7f9934001000 tx=0x7f99340012e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:11.177 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.160+0000 7f993b7fe700 1 -- 172.21.15.158:0/3950462475 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f9934007840 con 0x7f9944141610 2019-12-05T03:51:11.177 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.160+0000 7f994b3ac700 1 --2- 172.21.15.158:0/3950462475 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9944141610 0x7f99440b2dc0 secure :-1 s=THROTTLE_DONE pgs=408 cs=0 l=1 rx=0x7f9934001000 tx=0x7f99340012e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:11.178 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.160+0000 7f993b7fe700 1 --2- 172.21.15.158:0/3950462475 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f992403ad80 0x7f992403d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:11.178 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.160+0000 7f993b7fe700 1 -- 172.21.15.158:0/3950462475 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6399+0+0 (secure 0 0 0) 0x7f993404bf90 con 0x7f9944141610 2019-12-05T03:51:11.178 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.160+0000 7f994abab700 1 --2- 172.21.15.158:0/3950462475 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f992403ad80 0x7f992403d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:11.179 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.160+0000 7f994abab700 1 --2- 172.21.15.158:0/3950462475 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f992403ad80 0x7f992403d290 crc :-1 s=READY pgs=183 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:51:11.179 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.168+0000 7f994c60e700 1 -- 172.21.15.158:0/3950462475 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9944141d60 con 0x7f9944141610 2019-12-05T03:51:11.180 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.172+0000 7f994b3ac700 1 --2- 172.21.15.158:0/3950462475 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9944141610 0x7f99440b2dc0 secure :-1 s=THROTTLE_DONE pgs=408 cs=0 l=1 rx=0x7f9934001000 tx=0x7f99340012e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:11.180 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.172+0000 7f993b7fe700 1 -- 172.21.15.158:0/3950462475 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f9934030c40 con 0x7f9944141610 2019-12-05T03:51:11.336 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.328+0000 7f994c60e700 1 -- 172.21.15.158:0/3950462475 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"var": "pg_num", "prefix": "osd pool get", "pool": "data_new"} v 0) v1 -- 0x7f99440ac490 con 0x7f9944141610 2019-12-05T03:51:11.337 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.328+0000 7f994b3ac700 1 --2- 172.21.15.158:0/3950462475 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9944141610 0x7f99440b2dc0 secure :-1 s=THROTTLE_DONE pgs=408 cs=0 l=1 rx=0x7f9934001000 tx=0x7f99340012e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:11.337 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.328+0000 7f993b7fe700 1 -- 172.21.15.158:0/3950462475 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"var": "pg_num", "prefix": "osd pool get", "pool": "data_new"}]=0 v36) v1 ==== 97+0+10 (secure 0 0 0) 0x7f9934007b50 con 0x7f9944141610 2019-12-05T03:51:11.337 INFO:teuthology.orchestra.run.smithi158.stdout:pg_num: 8 2019-12-05T03:51:11.341 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.332+0000 7f994c60e700 1 -- 172.21.15.158:0/3950462475 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f992403ad80 msgr2=0x7f992403d290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:11.341 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.332+0000 7f994c60e700 1 --2- 172.21.15.158:0/3950462475 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f992403ad80 0x7f992403d290 crc :-1 s=READY pgs=183 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:11.341 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.332+0000 7f994c60e700 1 -- 172.21.15.158:0/3950462475 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9944141610 msgr2=0x7f99440b2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:11.341 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.332+0000 7f994c60e700 1 --2- 172.21.15.158:0/3950462475 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9944141610 0x7f99440b2dc0 secure :-1 s=READY pgs=408 cs=0 l=1 rx=0x7f9934001000 tx=0x7f99340012e0).stop 2019-12-05T03:51:11.342 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.332+0000 7f994c60e700 1 -- 172.21.15.158:0/3950462475 shutdown_connections 2019-12-05T03:51:11.342 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.332+0000 7f994c60e700 1 --2- 172.21.15.158:0/3950462475 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f9944141610 0x7f99440b2dc0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:11.342 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.332+0000 7f994c60e700 1 --2- 172.21.15.158:0/3950462475 >> v2:172.21.15.96:3300/0 conn(0x7f99440b1780 0x7f99440af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:11.342 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.332+0000 7f994c60e700 1 --2- 172.21.15.158:0/3950462475 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f992403ad80 0x7f992403d290 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:11.343 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.332+0000 7f994c60e700 1 -- 172.21.15.158:0/3950462475 shutdown_connections 2019-12-05T03:51:11.343 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.332+0000 7f994c60e700 1 -- 172.21.15.158:0/3950462475 wait complete. 2019-12-05T03:51:11.343 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.332+0000 7f994c60e700 1 -- 172.21.15.158:0/3950462475 >> 172.21.15.158:0/3950462475 conn(0x7f994409b400 msgr2=0x7f994412f750 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:51:11.354 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-12-05T03:51:11.355 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-12-05T03:51:11.456 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.444+0000 7f786c2a8700 1 Processor -- start 2019-12-05T03:51:11.456 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.444+0000 7f786c2a8700 1 -- start start 2019-12-05T03:51:11.456 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.444+0000 7f786c2a8700 1 --2- >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f786409a320 0x7f786405a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:51:11.456 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.444+0000 7f786c2a8700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78640accb0 con 0x7f786409cf60 2019-12-05T03:51:11.456 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.444+0000 7f786c2a8700 1 -- --> v1:172.21.15.158:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78640b6980 con 0x7f78641553b0 2019-12-05T03:51:11.457 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.444+0000 7f786c2a8700 1 -- --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f786409a750 con 0x7f786409a320 2019-12-05T03:51:11.457 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.444+0000 7f786b046700 1 --1- >> v1:172.21.15.158:6789/0 conn(0x7f78641553b0 0x7f78641557e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.158:6789/0 says I am v1:172.21.15.158:50190/0 (socket says 172.21.15.158:50190) 2019-12-05T03:51:11.457 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.444+0000 7f786b046700 1 -- 172.21.15.158:0/240648863 learned_addr learned my addr 172.21.15.158:0/240648863 (peer_addr_for_me v1:172.21.15.158:0/0) 2019-12-05T03:51:11.457 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.444+0000 7f786a044700 1 --2- 172.21.15.158:0/240648863 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f786409a320 0x7f786405a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:11.457 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.444+0000 7f7869843700 1 -- 172.21.15.158:0/240648863 <== mon.1 v1:172.21.15.158:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3203409718 0 0) 0x7f78640b6980 con 0x7f78641553b0 2019-12-05T03:51:11.457 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.444+0000 7f7869843700 1 -- 172.21.15.158:0/240648863 --> v1:172.21.15.158:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78500030b0 con 0x7f78641553b0 2019-12-05T03:51:11.458 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.444+0000 7f7869843700 1 -- 172.21.15.158:0/240648863 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 348279772 0 0) 0x7f78640accb0 con 0x7f786409cf60 2019-12-05T03:51:11.458 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.444+0000 7f7869843700 1 -- 172.21.15.158:0/240648863 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78640b6980 con 0x7f786409cf60 2019-12-05T03:51:11.458 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.444+0000 7f7869843700 1 -- 172.21.15.158:0/240648863 <== mon.1 v1:172.21.15.158:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2768382826 0 0) 0x7f78500030b0 con 0x7f78641553b0 2019-12-05T03:51:11.458 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.444+0000 7f7869843700 1 -- 172.21.15.158:0/240648863 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f786409a320 msgr2=0x7f786405a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:51:11.458 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.444+0000 7f7869843700 1 --2- 172.21.15.158:0/240648863 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f786409a320 0x7f786405a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:51:11.458 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.444+0000 7f7869843700 1 -- 172.21.15.158:0/240648863 >> v1:172.21.15.96:6789/0 conn(0x7f786409cf60 legacy=0x7f7864151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:11.458 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.444+0000 7f7869843700 1 -- 172.21.15.158:0/240648863 --> v1:172.21.15.158:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7864155fe0 con 0x7f78641553b0 2019-12-05T03:51:11.459 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.444+0000 7f7869843700 1 -- 172.21.15.158:0/240648863 <== mon.1 v1:172.21.15.158:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 828730332 0 0) 0x7f785c001ad0 con 0x7f78641553b0 2019-12-05T03:51:11.459 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.444+0000 7f786a044700 1 --2- 172.21.15.158:0/240648863 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f786409a320 0x7f786405a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2019-12-05T03:51:11.459 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.444+0000 7f7869843700 1 -- 172.21.15.158:0/240648863 >> v1:172.21.15.158:6789/0 conn(0x7f78641553b0 legacy=0x7f78641557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:11.459 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.444+0000 7f7869843700 1 --2- 172.21.15.158:0/240648863 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7850003940 0x7f7850003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:51:11.459 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.444+0000 7f7869843700 1 --2- 172.21.15.158:0/240648863 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7850004420 0x7f7850004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:51:11.459 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.444+0000 7f7869843700 1 --2- 172.21.15.158:0/240648863 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7850004e30 0x7f785004f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-05T03:51:11.459 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.444+0000 7f7869843700 1 -- 172.21.15.158:0/240648863 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786409a750 con 0x7f7850004e30 2019-12-05T03:51:11.460 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.444+0000 7f7869843700 1 -- 172.21.15.158:0/240648863 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785004fce0 con 0x7f7850003940 2019-12-05T03:51:11.460 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.444+0000 7f7869843700 1 -- 172.21.15.158:0/240648863 --> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f785004ff20 con 0x7f7850004420 2019-12-05T03:51:11.460 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.444+0000 7f786a845700 1 --2- 172.21.15.158:0/240648863 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7850003940 0x7f7850003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:11.460 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.448+0000 7f786b046700 1 --2- 172.21.15.158:0/240648863 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7850004e30 0x7f785004f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:11.460 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.448+0000 7f786a044700 1 --2- 172.21.15.158:0/240648863 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7850004420 0x7f7850004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:11.460 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.448+0000 7f786a845700 1 -- 172.21.15.158:0/240648863 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7850004420 msgr2=0x7f7850004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:51:11.460 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.448+0000 7f786a845700 1 --2- 172.21.15.158:0/240648863 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7850004420 0x7f7850004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:51:11.461 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.448+0000 7f786a845700 1 -- 172.21.15.158:0/240648863 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7850004e30 msgr2=0x7f785004f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2019-12-05T03:51:11.461 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.448+0000 7f786a845700 1 --2- 172.21.15.158:0/240648863 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7850004e30 0x7f785004f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2019-12-05T03:51:11.461 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.448+0000 7f786a845700 1 -- 172.21.15.158:0/240648863 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7850050220 con 0x7f7850003940 2019-12-05T03:51:11.461 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.448+0000 7f786a044700 1 --2- 172.21.15.158:0/240648863 >> [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] conn(0x7f7850004420 0x7f7850004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2019-12-05T03:51:11.461 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.448+0000 7f786a845700 1 --2- 172.21.15.158:0/240648863 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7850003940 0x7f7850003d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7860000fe0 tx=0x7f786000be70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:11.461 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.448+0000 7f786a845700 1 --2- 172.21.15.158:0/240648863 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7850003940 0x7f7850003d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7860000fe0 tx=0x7f786000be70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:11.462 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.448+0000 7f786a845700 1 --2- 172.21.15.158:0/240648863 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7850003940 0x7f7850003d90 secure :-1 s=READY pgs=410 cs=0 l=1 rx=0x7f7860000fe0 tx=0x7f786000be70).ready entity=mon.1 client_cookie=940b62819eb52155 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:51:11.462 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.448+0000 7f786a845700 1 --2- 172.21.15.158:0/240648863 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7850003940 0x7f7850003d90 secure :-1 s=THROTTLE_DONE pgs=410 cs=0 l=1 rx=0x7f7860000fe0 tx=0x7f786000be70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:11.462 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.448+0000 7f786a845700 1 --2- 172.21.15.158:0/240648863 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7850003940 0x7f7850003d90 secure :-1 s=THROTTLE_DONE pgs=410 cs=0 l=1 rx=0x7f7860000fe0 tx=0x7f786000be70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:11.462 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.448+0000 7f7869843700 1 -- 172.21.15.158:0/240648863 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7860010be0 con 0x7f7850003940 2019-12-05T03:51:11.462 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.448+0000 7f786a845700 1 --2- 172.21.15.158:0/240648863 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7850003940 0x7f7850003d90 secure :-1 s=THROTTLE_DONE pgs=410 cs=0 l=1 rx=0x7f7860000fe0 tx=0x7f786000be70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:11.462 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.448+0000 7f7869843700 1 -- 172.21.15.158:0/240648863 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7860010800 con 0x7f7850003940 2019-12-05T03:51:11.462 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.448+0000 7f7869843700 1 -- 172.21.15.158:0/240648863 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f786000c5b0 con 0x7f7850003940 2019-12-05T03:51:11.463 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.448+0000 7f786c2a8700 1 -- 172.21.15.158:0/240648863 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7850003940 msgr2=0x7f7850003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:11.463 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.448+0000 7f786c2a8700 1 --2- 172.21.15.158:0/240648863 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f7850003940 0x7f7850003d90 secure :-1 s=READY pgs=410 cs=0 l=1 rx=0x7f7860000fe0 tx=0x7f786000be70).stop 2019-12-05T03:51:11.463 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.448+0000 7f786b046700 1 -- 172.21.15.158:0/240648863 reap_dead start 2019-12-05T03:51:11.463 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.448+0000 7f786c2a8700 1 -- 172.21.15.158:0/240648863 shutdown_connections 2019-12-05T03:51:11.463 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.448+0000 7f786c2a8700 1 -- 172.21.15.158:0/240648863 shutdown_connections 2019-12-05T03:51:11.463 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.448+0000 7f786c2a8700 1 -- 172.21.15.158:0/240648863 wait complete. 2019-12-05T03:51:11.463 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.448+0000 7f786c2a8700 1 -- 172.21.15.158:0/240648863 >> 172.21.15.158:0/240648863 conn(0x7f78640b7e60 msgr2=0x7f78640b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:51:11.467 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.452+0000 7f786c2a8700 1 Processor -- start 2019-12-05T03:51:11.467 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.452+0000 7f786c2a8700 1 -- start start 2019-12-05T03:51:11.467 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.452+0000 7f786c2a8700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f78640af170 0x7f786412e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:11.467 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.452+0000 7f786c2a8700 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f78640b0710 0x7f7864138010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:11.468 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.452+0000 7f786c2a8700 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7864154ee0 con 0x7f786412ead0 2019-12-05T03:51:11.468 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.452+0000 7f786c2a8700 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78640adc00 con 0x7f78640b0710 2019-12-05T03:51:11.468 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.452+0000 7f786c2a8700 1 -- --> v2:172.21.15.158:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78640adea0 con 0x7f78640af170 2019-12-05T03:51:11.468 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.452+0000 7f786a845700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f78640af170 0x7f786412e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:11.470 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.452+0000 7f786a845700 1 --2- >> v2:172.21.15.158:3300/0 conn(0x7f78640af170 0x7f786412e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.158:3300/0 says I am v2:172.21.15.158:55418/0 (socket says 172.21.15.158:55418) 2019-12-05T03:51:11.471 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.452+0000 7f786a845700 1 -- 172.21.15.158:0/181481486 learned_addr learned my addr 172.21.15.158:0/181481486 (peer_addr_for_me v2:172.21.15.158:0/0) 2019-12-05T03:51:11.471 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.452+0000 7f786b046700 1 --2- 172.21.15.158:0/181481486 >> v2:172.21.15.96:3300/0 conn(0x7f78640b0710 0x7f7864138010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:11.471 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.452+0000 7f786a845700 1 -- 172.21.15.158:0/181481486 >> v2:172.21.15.96:3300/0 conn(0x7f78640b0710 msgr2=0x7f7864138010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:11.471 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.452+0000 7f786a845700 1 --2- 172.21.15.158:0/181481486 >> v2:172.21.15.96:3300/0 conn(0x7f78640b0710 0x7f7864138010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:11.471 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.452+0000 7f786a845700 1 -- 172.21.15.158:0/181481486 >> v1:172.21.15.96:6789/0 conn(0x7f786412ead0 legacy=0x7f78641546e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:11.471 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.452+0000 7f786a845700 1 -- 172.21.15.158:0/181481486 --> v2:172.21.15.158:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7864138560 con 0x7f78640af170 2019-12-05T03:51:11.472 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.452+0000 7f786a845700 1 --2- 172.21.15.158:0/181481486 >> v2:172.21.15.158:3300/0 conn(0x7f78640af170 0x7f786412e580 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f78641552b0 tx=0x7f786000e750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:11.472 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.452+0000 7f786a845700 1 --2- 172.21.15.158:0/181481486 >> v2:172.21.15.158:3300/0 conn(0x7f78640af170 0x7f786412e580 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f78641552b0 tx=0x7f786000e750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:11.472 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.452+0000 7f786a845700 1 --2- 172.21.15.158:0/181481486 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f78640af170 0x7f786412e580 secure :-1 s=READY pgs=411 cs=0 l=1 rx=0x7f78641552b0 tx=0x7f786000e750).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:51:11.472 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.456+0000 7f786a845700 1 --2- 172.21.15.158:0/181481486 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f78640af170 0x7f786412e580 secure :-1 s=THROTTLE_DONE pgs=411 cs=0 l=1 rx=0x7f78641552b0 tx=0x7f786000e750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:11.472 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.456+0000 7f785b7fe700 1 -- 172.21.15.158:0/181481486 <== mon.1 v2:172.21.15.158:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f786000ed50 con 0x7f78640af170 2019-12-05T03:51:11.472 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.456+0000 7f786a845700 1 --2- 172.21.15.158:0/181481486 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f78640af170 0x7f786412e580 secure :-1 s=THROTTLE_DONE pgs=411 cs=0 l=1 rx=0x7f78641552b0 tx=0x7f786000e750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:11.472 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.456+0000 7f786a845700 1 --2- 172.21.15.158:0/181481486 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f78640af170 0x7f786412e580 secure :-1 s=THROTTLE_DONE pgs=411 cs=0 l=1 rx=0x7f78641552b0 tx=0x7f786000e750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:11.473 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.456+0000 7f785b7fe700 1 -- 172.21.15.158:0/181481486 <== mon.1 v2:172.21.15.158:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7860010de0 con 0x7f78640af170 2019-12-05T03:51:11.473 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.456+0000 7f786c2a8700 1 -- 172.21.15.158:0/181481486 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78641387d0 con 0x7f78640af170 2019-12-05T03:51:11.473 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.456+0000 7f785b7fe700 1 -- 172.21.15.158:0/181481486 <== mon.1 v2:172.21.15.158:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f786000c700 con 0x7f78640af170 2019-12-05T03:51:11.473 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.456+0000 7f786c2a8700 1 -- 172.21.15.158:0/181481486 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7864138be0 con 0x7f78640af170 2019-12-05T03:51:11.473 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.456+0000 7f786a845700 1 --2- 172.21.15.158:0/181481486 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f78640af170 0x7f786412e580 secure :-1 s=THROTTLE_DONE pgs=411 cs=0 l=1 rx=0x7f78641552b0 tx=0x7f786000e750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:11.473 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.456+0000 7f785b7fe700 1 -- 172.21.15.158:0/181481486 <== mon.1 v2:172.21.15.158:3300/0 4 ==== mgrmap(e 3) v1 ==== 45131+0+0 (secure 0 0 0) 0x7f786000c9e0 con 0x7f78640af170 2019-12-05T03:51:11.473 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.456+0000 7f786a845700 1 --2- 172.21.15.158:0/181481486 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f78640af170 0x7f786412e580 secure :-1 s=THROTTLE_DONE pgs=411 cs=0 l=1 rx=0x7f78641552b0 tx=0x7f786000e750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:11.474 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.456+0000 7f785b7fe700 1 --2- 172.21.15.158:0/181481486 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f784c03ac70 0x7f784c03d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-05T03:51:11.474 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.456+0000 7f785b7fe700 1 -- 172.21.15.158:0/181481486 <== mon.1 v2:172.21.15.158:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6399+0+0 (secure 0 0 0) 0x7f786004b810 con 0x7f78640af170 2019-12-05T03:51:11.474 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.456+0000 7f786a044700 1 --2- 172.21.15.158:0/181481486 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f784c03ac70 0x7f784c03d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-05T03:51:11.474 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.456+0000 7f786a044700 1 --2- 172.21.15.158:0/181481486 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f784c03ac70 0x7f784c03d180 crc :-1 s=READY pgs=184 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-05T03:51:11.474 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.456+0000 7f786c2a8700 1 -- 172.21.15.158:0/181481486 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7864153450 con 0x7f78640af170 2019-12-05T03:51:11.475 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.464+0000 7f786a845700 1 --2- 172.21.15.158:0/181481486 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f78640af170 0x7f786412e580 secure :-1 s=THROTTLE_DONE pgs=411 cs=0 l=1 rx=0x7f78641552b0 tx=0x7f786000e750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:11.475 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.464+0000 7f785b7fe700 1 -- 172.21.15.158:0/181481486 <== mon.1 v2:172.21.15.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111599 (secure 0 0 0) 0x7f7860032870 con 0x7f78640af170 2019-12-05T03:51:11.632 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.624+0000 7f786c2a8700 1 -- 172.21.15.158:0/181481486 --> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78640554e0 con 0x7f78640af170 2019-12-05T03:51:11.633 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.628+0000 7f786a845700 1 --2- 172.21.15.158:0/181481486 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f78640af170 0x7f786412e580 secure :-1 s=THROTTLE_DONE pgs=411 cs=0 l=1 rx=0x7f78641552b0 tx=0x7f786000e750).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-05T03:51:11.633 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.628+0000 7f785b7fe700 1 -- 172.21.15.158:0/181481486 <== mon.1 v2:172.21.15.158:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2111 (secure 0 0 0) 0x7f7860032ad0 con 0x7f78640af170 2019-12-05T03:51:11.635 INFO:teuthology.orchestra.run.smithi158.stdout: 2019-12-05T03:51:11.635 INFO:teuthology.orchestra.run.smithi158.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4604,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.96:6835/4291398037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":4291398037},{"type":"v1","addr":"172.21.15.96:6835","nonce":4291398037}]},"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":15}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-12-05T03:50:44.549123+0000","modified":"2019-12-05T03:50:52.631965+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5095},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5095":{"gid":5095,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":2,"addr":"172.21.15.158:6833/2078196109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.158:6832","nonce":2078196109},{"type":"v1","addr":"172.21.15.158:6833","nonce":2078196109}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[5,6],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2019-12-05T03:51:11.635 INFO:teuthology.orchestra.run.smithi158.stderr:dumped fsmap epoch 16 2019-12-05T03:51:11.637 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.632+0000 7f786c2a8700 1 -- 172.21.15.158:0/181481486 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f784c03ac70 msgr2=0x7f784c03d180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:11.638 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.632+0000 7f786c2a8700 1 --2- 172.21.15.158:0/181481486 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f784c03ac70 0x7f784c03d180 crc :-1 s=READY pgs=184 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:11.638 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.632+0000 7f786c2a8700 1 -- 172.21.15.158:0/181481486 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f78640af170 msgr2=0x7f786412e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-05T03:51:11.638 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.632+0000 7f786c2a8700 1 --2- 172.21.15.158:0/181481486 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f78640af170 0x7f786412e580 secure :-1 s=READY pgs=411 cs=0 l=1 rx=0x7f78641552b0 tx=0x7f786000e750).stop 2019-12-05T03:51:11.638 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.632+0000 7f786c2a8700 1 -- 172.21.15.158:0/181481486 shutdown_connections 2019-12-05T03:51:11.638 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.632+0000 7f786c2a8700 1 --2- 172.21.15.158:0/181481486 >> v2:172.21.15.96:3300/0 conn(0x7f78640b0710 0x7f7864138010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:11.638 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.632+0000 7f786c2a8700 1 --2- 172.21.15.158:0/181481486 >> [v2:172.21.15.158:3300/0,v1:172.21.15.158:6789/0] conn(0x7f78640af170 0x7f786412e580 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:11.639 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.632+0000 7f786c2a8700 1 --2- 172.21.15.158:0/181481486 >> [v2:172.21.15.96:6800/12043,v1:172.21.15.96:6801/12043] conn(0x7f784c03ac70 0x7f784c03d180 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rx=0 tx=0).stop 2019-12-05T03:51:11.639 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.632+0000 7f786c2a8700 1 -- 172.21.15.158:0/181481486 shutdown_connections 2019-12-05T03:51:11.639 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.632+0000 7f786c2a8700 1 -- 172.21.15.158:0/181481486 wait complete. 2019-12-05T03:51:11.639 INFO:teuthology.orchestra.run.smithi158.stderr:2019-12-05T03:51:11.632+0000 7f786c2a8700 1 -- 172.21.15.158:0/181481486 >> 172.21.15.158:0/181481486 conn(0x7f78640b3e30 msgr2=0x7f786407db40 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-05T03:51:11.849 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 5095}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 4, u'failed': [], u'epoch': 16, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [5, 6], u'info': {u'gid_5095': {u'export_targets': [], u'name': u'a', u'incarnation': 13, u'state_seq': 2, u'state': u'up:active', u'gid': 5095, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 2078196109, u'type': u'v2', u'addr': u'172.21.15.158:6832'}, {u'nonce': 2078196109, u'type': u'v1', u'addr': u'172.21.15.158:6833'}]}, u'addr': u'172.21.15.158:6833/2078196109'}}, u'fs_name': u'cephfs', u'created': u'2019-12-05T03:50:44.549123+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-12-05T03:50:52.631965+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-12-05T03:51:11.850 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-12-05T03:51:11.850 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2019-12-05T03:51:11.942 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2019-12-05T03:51:11.943 INFO:teuthology.orchestra.run.smithi158.stdout: "cluster_fsid": "a91186ae-f496-4de1-918d-820c55ff1feb", 2019-12-05T03:51:11.943 INFO:teuthology.orchestra.run.smithi158.stdout: "whoami": 0, 2019-12-05T03:51:11.943 INFO:teuthology.orchestra.run.smithi158.stdout: "id": 5095, 2019-12-05T03:51:11.943 INFO:teuthology.orchestra.run.smithi158.stdout: "want_state": "up:active", 2019-12-05T03:51:11.943 INFO:teuthology.orchestra.run.smithi158.stdout: "state": "up:active", 2019-12-05T03:51:11.943 INFO:teuthology.orchestra.run.smithi158.stdout: "rank_uptime": 24.678161177, 2019-12-05T03:51:11.944 INFO:teuthology.orchestra.run.smithi158.stdout: "mdsmap_epoch": 16, 2019-12-05T03:51:11.944 INFO:teuthology.orchestra.run.smithi158.stdout: "osdmap_epoch": 36, 2019-12-05T03:51:11.944 INFO:teuthology.orchestra.run.smithi158.stdout: "osdmap_epoch_barrier": 33, 2019-12-05T03:51:11.944 INFO:teuthology.orchestra.run.smithi158.stdout: "uptime": 24.961651018000001 2019-12-05T03:51:11.944 INFO:teuthology.orchestra.run.smithi158.stdout:} 2019-12-05T03:51:11.949 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "a91186ae-f496-4de1-918d-820c55ff1feb", "whoami": 0, "id": 5095, "want_state": "up:active", "state": "up:active", "rank_uptime": 24.678161177, "mdsmap_epoch": 16, "osdmap_epoch": 36, "osdmap_epoch_barrier": 33, "uptime": 24.961651018000001 } 2019-12-05T03:51:11.949 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2019-12-05T03:51:11.949 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2019-12-05T03:51:11.949 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi158.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2019-12-05T03:51:11.950 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:51:11.950 INFO:teuthology.orchestra.run.smithi158:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-12-05T03:51:11.963 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:51:11.963 INFO:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2019-12-05T03:51:12.043 DEBUG:teuthology.orchestra.run:got remote process result: 32 2019-12-05T03:51:12.045 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2019-12-05T03:51:12.046 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:51:12.046 INFO:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2019-12-05T03:51:12.121 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2019-12-05T03:51:12.122 INFO:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0 2019-12-05T03:51:12.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:51:12.191 INFO:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2019-12-05T03:51:12.208 DEBUG:teuthology.orchestra.run:got remote process result: 32 2019-12-05T03:51:12.212 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2019-12-05T03:51:12.212 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:51:12.213 INFO:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2019-12-05T03:51:12.246 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi158.stderr:2019-12-05T03:51:12.240+0000 7f1638ff0f40 -1 init, newargv = 0x56384c116560 newargc=7ceph-fuse[17160]: starting ceph client 2019-12-05T03:51:12.247 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi158.stderr: 2019-12-05T03:51:12.255 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi158.stderr:ceph-fuse[17160]: starting fuse 2019-12-05T03:51:13.355 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:51:13.355 INFO:teuthology.orchestra.run.smithi158:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2019-12-05T03:51:13.374 DEBUG:teuthology.orchestra.run:got remote process result: 32 2019-12-05T03:51:13.375 INFO:teuthology.orchestra.run.smithi158.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2019-12-05T03:51:13.375 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:51:13.376 INFO:teuthology.orchestra.run.smithi158:> ls /sys/fs/fuse/connections 2019-12-05T03:51:13.450 INFO:teuthology.orchestra.run.smithi158.stdout:49 2019-12-05T03:51:13.450 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2019-12-05T03:51:13.451 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:51:13.451 INFO:teuthology.orchestra.run.smithi158:> sudo python2 -c ' 2019-12-05T03:51:13.451 INFO:teuthology.orchestra.run.smithi158:> import glob 2019-12-05T03:51:13.451 INFO:teuthology.orchestra.run.smithi158:> import re 2019-12-05T03:51:13.451 INFO:teuthology.orchestra.run.smithi158:> import os 2019-12-05T03:51:13.452 INFO:teuthology.orchestra.run.smithi158:> import subprocess 2019-12-05T03:51:13.452 INFO:teuthology.orchestra.run.smithi158:> 2019-12-05T03:51:13.452 INFO:teuthology.orchestra.run.smithi158:> def find_socket(client_name): 2019-12-05T03:51:13.452 INFO:teuthology.orchestra.run.smithi158:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2019-12-05T03:51:13.452 INFO:teuthology.orchestra.run.smithi158:> files = glob.glob(asok_path) 2019-12-05T03:51:13.453 INFO:teuthology.orchestra.run.smithi158:> 2019-12-05T03:51:13.453 INFO:teuthology.orchestra.run.smithi158:> # Given a non-glob path, it better be there 2019-12-05T03:51:13.453 INFO:teuthology.orchestra.run.smithi158:> if "*" not in asok_path: 2019-12-05T03:51:13.453 INFO:teuthology.orchestra.run.smithi158:> assert(len(files) == 1) 2019-12-05T03:51:13.453 INFO:teuthology.orchestra.run.smithi158:> return files[0] 2019-12-05T03:51:13.454 INFO:teuthology.orchestra.run.smithi158:> 2019-12-05T03:51:13.454 INFO:teuthology.orchestra.run.smithi158:> for f in files: 2019-12-05T03:51:13.454 INFO:teuthology.orchestra.run.smithi158:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2019-12-05T03:51:13.454 INFO:teuthology.orchestra.run.smithi158:> if os.path.exists("/proc/{0}".format(pid)): 2019-12-05T03:51:13.454 INFO:teuthology.orchestra.run.smithi158:> return f 2019-12-05T03:51:13.455 INFO:teuthology.orchestra.run.smithi158:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2019-12-05T03:51:13.455 INFO:teuthology.orchestra.run.smithi158:> 2019-12-05T03:51:13.455 INFO:teuthology.orchestra.run.smithi158:> print(find_socket("client.0")) 2019-12-05T03:51:13.455 INFO:teuthology.orchestra.run.smithi158:> ' 2019-12-05T03:51:13.556 INFO:teuthology.orchestra.run.smithi158.stdout:/var/run/ceph/ceph-client.0.17160.asok 2019-12-05T03:51:13.556 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.17160.asok 2019-12-05T03:51:13.556 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:51:13.557 INFO:teuthology.orchestra.run.smithi158:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.17160.asok status 2019-12-05T03:51:13.740 INFO:teuthology.orchestra.run.smithi158.stdout:{ 2019-12-05T03:51:13.740 INFO:teuthology.orchestra.run.smithi158.stdout: "metadata": { 2019-12-05T03:51:13.740 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_sha1": "c5290805033483ba0cec165c06bde07dae5f19ec", 2019-12-05T03:51:13.741 INFO:teuthology.orchestra.run.smithi158.stdout: "ceph_version": "ceph version 15.0.0-8014-gc529080 (c5290805033483ba0cec165c06bde07dae5f19ec) octopus (dev)", 2019-12-05T03:51:13.741 INFO:teuthology.orchestra.run.smithi158.stdout: "entity_id": "0", 2019-12-05T03:51:13.741 INFO:teuthology.orchestra.run.smithi158.stdout: "hostname": "smithi158", 2019-12-05T03:51:13.741 INFO:teuthology.orchestra.run.smithi158.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2019-12-05T03:51:13.742 INFO:teuthology.orchestra.run.smithi158.stdout: "pid": "17160", 2019-12-05T03:51:13.742 INFO:teuthology.orchestra.run.smithi158.stdout: "root": "/" 2019-12-05T03:51:13.742 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:51:13.742 INFO:teuthology.orchestra.run.smithi158.stdout: "dentry_count": 0, 2019-12-05T03:51:13.743 INFO:teuthology.orchestra.run.smithi158.stdout: "dentry_pinned_count": 0, 2019-12-05T03:51:13.743 INFO:teuthology.orchestra.run.smithi158.stdout: "id": 5311, 2019-12-05T03:51:13.743 INFO:teuthology.orchestra.run.smithi158.stdout: "inst": { 2019-12-05T03:51:13.743 INFO:teuthology.orchestra.run.smithi158.stdout: "name": { 2019-12-05T03:51:13.744 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "client", 2019-12-05T03:51:13.744 INFO:teuthology.orchestra.run.smithi158.stdout: "num": 5311 2019-12-05T03:51:13.744 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:51:13.744 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": { 2019-12-05T03:51:13.745 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:51:13.745 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:0", 2019-12-05T03:51:13.745 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 833099445 2019-12-05T03:51:13.745 INFO:teuthology.orchestra.run.smithi158.stdout: } 2019-12-05T03:51:13.746 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:51:13.746 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": { 2019-12-05T03:51:13.746 INFO:teuthology.orchestra.run.smithi158.stdout: "type": "v1", 2019-12-05T03:51:13.746 INFO:teuthology.orchestra.run.smithi158.stdout: "addr": "172.21.15.158:0", 2019-12-05T03:51:13.747 INFO:teuthology.orchestra.run.smithi158.stdout: "nonce": 833099445 2019-12-05T03:51:13.747 INFO:teuthology.orchestra.run.smithi158.stdout: }, 2019-12-05T03:51:13.747 INFO:teuthology.orchestra.run.smithi158.stdout: "inst_str": "client.5311 172.21.15.158:0/833099445", 2019-12-05T03:51:13.747 INFO:teuthology.orchestra.run.smithi158.stdout: "addr_str": "172.21.15.158:0/833099445", 2019-12-05T03:51:13.748 INFO:teuthology.orchestra.run.smithi158.stdout: "inode_count": 1, 2019-12-05T03:51:13.748 INFO:teuthology.orchestra.run.smithi158.stdout: "mds_epoch": 16, 2019-12-05T03:51:13.748 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_epoch": 36, 2019-12-05T03:51:13.748 INFO:teuthology.orchestra.run.smithi158.stdout: "osd_epoch_barrier": 0, 2019-12-05T03:51:13.748 INFO:teuthology.orchestra.run.smithi158.stdout: "blacklisted": false 2019-12-05T03:51:13.749 INFO:teuthology.orchestra.run.smithi158.stdout:} 2019-12-05T03:51:13.749 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:51:13.750 INFO:teuthology.orchestra.run.smithi158:> stat --file-system '--printf=%T 2019-12-05T03:51:13.750 INFO:teuthology.orchestra.run.smithi158:> ' -- /home/ubuntu/cephtest/mnt.0 2019-12-05T03:51:13.762 INFO:teuthology.orchestra.run.smithi158.stdout:fuseblk 2019-12-05T03:51:13.763 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2019-12-05T03:51:13.763 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-05T03:51:13.763 INFO:teuthology.orchestra.run.smithi158:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2019-12-05T03:51:13.846 INFO:teuthology.orchestra.run.smithi158:> cd /home/ubuntu/cephtest/mnt.0 && sudo setfattr -n ceph.file.layout.pool -v data_new layoutfile 2019-12-05T03:51:13.934 INFO:teuthology.orchestra.run.smithi158:> cd /home/ubuntu/cephtest/mnt.0 && sudo setfattr -n ceph.dir.layout.pool -v data_new layoutdir 2019-12-05T03:51:27.900 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:51:27.904 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:51:58.062 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:51:58.065 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:52:28.106 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:52:28.110 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:52:58.256 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:52:58.259 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:53:28.330 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:53:28.334 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:53:58.424 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:53:58.447 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:54:28.595 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:54:28.598 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:54:58.722 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:54:58.727 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:55:28.868 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:55:28.871 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:55:58.937 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:55:58.945 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:56:28.998 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:56:29.004 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:56:59.119 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:56:59.123 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:57:29.159 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:57:29.163 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:57:59.206 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:57:59.209 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:58:29.253 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:58:29.257 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:58:59.300 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:58:59.304 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:59:29.388 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:59:29.395 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:59:59.505 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T03:59:59.509 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:00:29.605 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:00:29.609 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:00:59.692 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:00:59.696 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:01:29.795 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:01:29.799 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:01:59.857 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:01:59.861 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:02:29.987 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:02:29.991 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:03:00.031 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:03:00.035 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:03:30.079 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:03:30.083 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:04:00.196 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:04:00.199 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:04:30.298 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:04:30.302 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:05:00.405 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:05:00.409 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:05:30.532 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:05:30.561 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:06:00.880 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:06:00.884 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:06:30.930 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:06:30.934 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:07:00.974 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:07:00.978 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:07:31.173 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:07:31.177 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:08:01.218 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:08:01.221 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:08:31.327 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:08:31.331 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:09:01.379 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:09:01.383 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:09:31.743 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:09:31.747 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:10:01.864 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:10:01.867 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:10:31.917 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:10:31.921 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:11:01.966 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:11:01.970 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:11:32.074 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:11:32.078 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:12:02.114 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:12:02.119 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:12:32.232 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:12:32.235 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:13:02.353 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:13:02.357 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:13:32.480 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:13:32.486 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:14:02.534 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:14:02.540 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:14:32.606 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:14:32.635 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:15:02.679 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:15:02.684 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:15:32.743 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:15:32.746 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:16:02.873 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:16:02.878 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:16:32.924 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:16:32.928 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:17:03.144 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:17:03.149 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:17:33.208 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:17:33.211 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:18:03.254 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:18:03.258 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:18:33.347 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:18:33.351 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:19:03.390 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:19:03.394 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:19:33.463 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:19:33.467 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:20:03.570 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:20:03.575 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:20:33.632 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:20:33.666 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:21:03.766 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:21:03.772 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:21:33.896 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:21:33.900 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:22:04.140 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:22:04.146 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:22:34.260 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:22:34.265 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:23:04.330 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:23:04.334 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:23:34.468 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:23:34.475 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:24:04.572 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:24:04.575 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:24:34.634 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:24:34.638 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:25:04.720 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:25:04.724 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:25:34.855 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:25:34.859 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:26:04.893 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:26:04.896 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:26:34.989 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:26:34.994 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:27:05.045 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:27:05.048 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:27:35.092 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:27:35.096 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:28:05.218 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:28:05.221 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:28:35.270 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:28:35.274 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:29:05.374 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:29:05.378 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:29:35.436 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:29:35.444 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:30:05.510 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:30:05.514 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:30:35.558 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:30:35.566 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:31:05.688 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:31:05.697 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:31:35.800 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:31:35.804 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:32:05.847 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:32:05.851 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:32:35.901 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:32:35.905 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:33:06.010 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:33:06.013 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:33:36.150 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:33:36.154 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:34:06.228 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:34:06.231 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:34:36.294 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:34:36.298 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:35:06.418 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:35:06.432 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:35:36.532 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:35:36.537 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:36:06.584 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:36:06.588 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:36:36.695 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:36:36.698 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:37:06.816 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:37:06.819 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:37:36.882 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:37:36.891 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:38:07.015 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:38:07.043 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:38:37.112 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:38:37.115 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:39:07.213 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:39:07.221 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:39:37.279 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:39:37.283 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:40:07.325 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:40:07.334 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:40:37.451 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:40:37.454 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:41:07.560 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:41:07.564 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:41:37.689 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:41:37.705 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:42:07.756 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:42:07.772 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:42:37.904 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:42:37.909 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:43:07.943 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:43:07.952 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:43:38.219 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:43:38.224 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:44:08.271 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:44:08.275 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:44:38.336 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:44:38.341 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:45:08.456 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:45:08.460 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:45:38.575 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:45:38.579 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:46:08.620 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:46:08.625 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:46:38.765 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:46:38.768 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:47:08.806 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:47:08.811 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:47:38.987 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:47:38.991 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:48:09.045 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:48:09.054 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:48:39.181 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:48:39.184 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:49:09.275 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:49:09.279 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:49:39.338 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:49:39.341 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:50:09.433 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:50:09.437 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:50:39.479 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:50:39.483 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:51:09.564 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:51:09.568 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:51:39.610 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:51:39.614 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:52:09.660 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:52:09.664 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:52:39.751 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:52:39.755 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:53:09.837 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:53:09.841 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:53:39.949 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:53:39.953 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:54:10.070 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:54:10.074 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:54:40.136 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:54:40.140 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:55:10.260 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:55:10.264 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:55:40.388 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:55:40.392 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:56:10.435 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:56:10.440 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:56:40.482 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:56:40.485 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:57:10.541 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:57:10.545 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:57:40.769 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:57:40.778 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:58:10.894 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:58:10.899 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:58:40.985 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:58:40.991 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:59:11.113 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:59:11.118 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:59:41.183 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T04:59:41.190 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:00:11.234 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:00:11.238 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:00:41.349 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:00:41.353 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:01:11.480 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:01:11.484 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:01:41.627 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:01:41.630 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:02:11.768 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:02:11.771 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:02:41.879 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:02:41.883 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:03:11.992 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:03:11.996 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:03:42.128 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:03:42.132 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:04:12.233 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:04:12.236 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:04:42.601 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:04:42.609 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:05:12.730 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:05:12.734 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:05:42.836 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:05:42.840 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:06:12.947 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:06:12.951 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:06:43.055 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:06:43.059 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:07:13.202 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:07:13.205 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:07:43.489 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:07:43.493 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:08:13.537 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:08:13.541 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:08:43.698 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:08:43.702 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:09:13.781 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:09:13.785 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:09:43.937 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:09:43.941 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:10:14.076 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:10:14.079 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:10:44.189 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:10:44.192 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:11:14.316 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:11:14.320 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:11:44.395 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:11:44.402 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:12:14.507 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:12:14.511 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:12:44.628 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:12:44.632 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:13:14.896 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:13:14.903 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:13:44.947 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:13:44.951 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:14:15.112 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:14:15.116 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:14:45.400 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:14:45.404 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:15:15.711 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:15:15.715 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:15:45.839 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:15:45.842 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:16:15.950 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:16:15.954 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:16:46.205 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:16:46.209 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:17:16.309 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:17:16.313 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:17:46.412 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:17:46.416 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:18:16.538 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:18:16.542 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:18:46.668 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:18:46.672 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:19:16.765 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:19:16.768 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:19:46.896 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:19:46.900 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:20:17.018 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:20:17.021 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:20:47.301 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:20:47.305 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:21:17.395 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:21:17.399 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:21:47.440 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:21:47.444 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:22:17.578 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:22:17.581 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:22:47.640 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:22:47.643 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:23:17.805 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:23:17.809 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:23:47.863 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:23:47.867 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:24:17.958 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:24:17.962 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:24:48.338 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:24:48.500 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:25:18.546 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:25:18.550 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:25:48.661 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:25:48.665 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:26:18.773 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:26:18.777 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:26:48.893 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:26:49.232 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:27:19.270 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:27:19.274 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:27:49.396 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:27:49.401 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:28:19.518 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:28:19.522 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:28:49.635 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:28:49.638 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:29:19.751 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:29:19.756 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:29:49.897 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:29:49.900 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:30:20.018 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:30:20.332 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:30:50.404 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:30:50.408 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:31:20.523 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:31:20.527 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:31:50.646 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:31:50.650 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:32:20.974 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:32:20.977 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:32:51.026 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:32:51.030 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:33:21.148 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:33:21.152 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:33:51.244 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:33:51.250 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:34:21.357 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:34:21.362 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:34:51.655 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:34:51.659 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:35:21.719 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:35:21.722 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:35:51.851 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:35:51.859 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:36:21.939 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:36:21.949 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:36:52.052 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:36:52.056 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:37:22.181 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:37:22.185 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:37:52.304 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:37:52.308 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:38:22.417 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:38:22.421 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:38:52.676 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:38:52.680 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:39:22.728 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:39:22.732 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:39:53.041 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:39:53.044 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:40:23.261 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:40:23.264 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:40:53.305 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:40:53.309 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:41:23.483 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:41:23.488 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:41:53.562 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:41:53.566 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:42:23.690 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:42:23.694 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:42:53.756 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:42:53.764 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:43:23.863 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:43:23.866 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:43:53.976 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:43:53.980 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:44:24.063 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:44:24.067 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:44:54.259 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:44:54.262 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:45:24.311 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:45:24.317 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:45:54.556 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:45:54.560 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:46:24.604 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:46:24.607 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:46:54.701 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:46:54.705 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:47:24.742 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:47:24.745 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:47:54.870 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:47:54.874 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:48:25.090 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:48:25.094 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:48:55.130 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:48:55.134 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:49:25.253 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:49:25.257 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:49:55.534 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:49:55.538 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:50:25.581 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:50:25.584 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:50:55.687 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:50:55.690 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:51:25.812 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:51:25.817 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:51:55.932 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:51:55.936 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:52:26.052 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:52:26.058 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:52:56.200 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:52:56.204 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:53:26.241 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:53:26.244 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:53:56.362 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:53:56.366 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:54:26.486 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:54:26.489 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:54:56.849 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:54:56.854 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:55:26.973 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:55:26.976 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:55:57.085 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:55:57.089 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:56:27.222 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:56:27.225 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:56:57.259 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:56:57.262 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:57:27.372 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:57:27.377 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:57:57.515 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:57:57.519 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:58:27.628 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:58:27.632 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:58:57.759 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:58:57.763 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:59:27.873 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:59:27.877 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:59:58.014 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T05:59:58.018 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:00:28.118 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:00:28.129 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:00:58.224 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:00:58.228 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:01:28.340 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:01:28.345 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:01:58.635 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:01:58.639 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:02:28.732 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:02:28.736 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:02:58.942 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:02:58.948 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:03:29.041 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:03:29.045 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:03:59.175 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:03:59.180 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:04:29.436 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:04:29.440 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:04:59.782 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:04:59.785 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:05:30.113 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:05:30.117 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:06:00.155 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:06:00.159 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:06:30.278 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:06:30.282 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:07:00.357 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:07:00.361 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:07:30.470 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:07:30.474 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:08:00.568 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:08:00.572 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:08:30.699 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:08:30.703 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:09:00.845 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:09:00.849 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:09:30.979 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:09:30.983 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:10:01.279 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:10:01.282 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:10:31.352 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:10:31.356 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:11:01.511 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:11:01.518 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:11:31.579 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:11:31.583 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:12:01.693 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:12:01.705 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:12:31.790 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:12:31.793 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:13:01.915 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:13:01.918 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:13:32.051 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:13:32.055 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:14:02.124 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:14:02.128 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:14:32.235 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:14:32.239 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:15:02.531 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:15:02.538 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:15:32.752 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:15:32.755 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:16:02.811 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:16:02.815 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:16:32.964 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:16:32.968 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:17:03.003 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:17:03.007 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:17:33.108 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:17:33.112 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:18:03.231 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:18:03.234 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:18:33.402 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:18:33.406 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:19:03.462 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:19:03.466 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:19:33.587 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:19:33.591 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:20:03.859 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:20:03.862 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:20:33.973 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:20:33.977 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:21:04.116 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:21:04.120 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:21:34.216 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:21:34.220 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:22:04.340 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:22:04.344 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:22:34.451 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:22:34.455 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:23:04.582 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:23:04.585 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:23:34.678 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:23:34.682 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:24:04.724 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:24:04.728 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:24:34.831 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:24:34.835 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:25:05.127 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:25:05.131 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:25:35.194 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:25:35.198 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:26:05.307 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:26:05.311 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:26:35.438 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:26:35.442 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:27:05.546 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:27:05.550 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:27:35.665 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:27:35.669 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:28:05.800 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:28:05.807 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:28:35.950 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:28:35.954 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:29:06.031 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:29:06.035 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:29:36.269 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:29:36.273 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:30:06.390 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:30:06.404 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:30:36.531 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:30:36.535 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:31:06.697 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:31:06.701 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:31:36.815 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:31:36.820 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:32:06.947 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:32:06.950 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:32:37.077 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:32:37.081 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:33:07.140 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:33:07.144 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:33:37.270 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:33:37.275 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:34:07.326 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:34:07.331 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:34:37.464 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:34:37.468 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:35:07.780 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:35:07.788 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:35:37.932 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:35:37.936 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:36:08.213 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:36:08.218 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:36:38.349 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:36:38.353 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:37:08.427 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:37:08.431 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:37:38.557 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:37:38.561 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:38:08.705 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:38:08.721 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:38:38.844 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:38:38.848 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:39:08.968 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:39:08.972 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:39:39.089 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:39:39.093 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:40:09.388 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:40:09.403 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:40:39.457 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:40:39.461 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:41:09.562 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:41:09.566 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:41:39.709 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:41:39.713 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:42:09.840 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:42:09.844 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:42:39.979 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:42:39.994 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:43:10.109 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:43:10.113 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:43:40.231 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:43:40.235 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:44:10.362 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:44:10.366 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:44:40.484 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:44:40.497 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:45:10.648 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:45:10.651 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:45:40.704 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:45:40.708 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:46:10.834 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:46:10.838 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:46:40.914 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:46:40.917 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:47:11.245 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:47:11.257 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:47:41.308 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:47:41.312 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:48:11.439 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:48:11.443 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:48:41.562 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:48:41.566 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:49:11.693 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:49:11.697 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:49:41.749 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:49:41.761 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:50:12.034 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:50:12.038 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:50:42.085 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:50:42.089 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:51:12.199 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:51:12.202 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:51:42.330 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:51:42.334 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:52:12.469 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:52:12.473 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:52:42.551 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:52:42.554 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:53:12.681 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:53:12.684 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:53:42.820 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:53:42.824 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:54:12.916 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:54:12.920 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:54:43.047 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:54:43.051 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:55:13.403 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:55:13.407 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:55:43.526 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:55:43.529 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:56:13.647 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:56:13.651 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:56:43.778 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:56:43.782 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:57:13.897 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:57:13.901 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:57:44.039 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:57:44.043 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:58:14.186 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:58:14.190 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:58:44.299 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:58:44.304 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:59:14.441 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:59:14.444 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:59:44.657 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T06:59:44.661 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T07:00:14.799 INFO:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T07:00:14.803 INFO:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2019-12-05T07:00:38.219 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2019-12-05T07:00:38.219 DEBUG:teuthology.task.console_log:Killing console logger for smithi158 2019-12-05T07:00:38.220 DEBUG:teuthology.task.console_log:Killing console logger for smithi096 2019-12-05T07:00:38.220 DEBUG:teuthology.task.console_log:Killing console logger for smithi158 2019-12-05T07:00:38.221 DEBUG:teuthology.task.console_log:Killing console logger for smithi096 2019-12-05T07:00:38.221 DEBUG:teuthology.exit:Finished running handlers